-- Logs begin at Wed 2022-04-06 15:52:54 UTC, end at Wed 2022-04-06 17:30:57 UTC. -- Apr 06 16:29:07.861130 dv-cinder-836848-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 06 16:29:07.869971 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 06 16:29:07.871970 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Apr 6 16:29:07 2022] *** Apr 06 16:29:07.871970 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 06 16:29:07.871970 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 06 16:29:07.871970 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: nodename: dv-cinder-836848-1-iscsi Apr 06 16:29:07.871970 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: machine: x86_64 Apr 06 16:29:07.871970 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: clock source: unix Apr 06 16:29:07.871970 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: pcre jit disabled Apr 06 16:29:07.871970 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: detected number of CPU cores: 4 Apr 06 16:29:07.871970 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: current working directory: / Apr 06 16:29:07.871970 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: detected binary path: /usr/bin/uwsgi-core Apr 06 16:29:07.871970 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: your processes number limit is 47680 Apr 06 16:29:07.871970 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: your memory page size is 4096 bytes Apr 06 16:29:07.871970 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: detected max file descriptor number: 2048 Apr 06 16:29:07.871970 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: lock engine: pthread robust mutexes Apr 06 16:29:07.871970 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: thunder lock: enabled Apr 06 16:29:07.873184 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 06 16:29:07.873184 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 06 16:29:07.916543 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: Python main interpreter initialized at 0x5603d2a3e9c0 Apr 06 16:29:07.916543 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: python threads support enabled Apr 06 16:29:07.916543 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: your server socket listen backlog is limited to 100 connections Apr 06 16:29:07.916543 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: your mercy for graceful operations on workers is 90 seconds Apr 06 16:29:07.916953 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: mapped 403077 bytes (393 KB) for 2 cores Apr 06 16:29:07.917034 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: *** Operational MODE: preforking *** Apr 06 16:29:07.917239 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: *** uWSGI is running in multiple interpreter mode *** Apr 06 16:29:07.917239 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: spawned uWSGI master process (pid: 102882) Apr 06 16:29:07.917479 dv-cinder-836848-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 06 16:29:07.918605 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: spawned uWSGI worker 1 (pid: 102883, cores: 1) Apr 06 16:29:07.918605 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: spawned uWSGI worker 2 (pid: 102884, cores: 1) Apr 06 16:29:07.918605 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 06 16:29:09.125318 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 06 16:29:09.126743 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 06 16:29:09.984616 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 06 16:29:09.984616 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: from cryptography.utils import int_from_bytes Apr 06 16:29:09.984962 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 06 16:29:09.984962 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: from cryptography.utils import int_from_bytes Apr 06 16:29:09.990484 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 06 16:29:09.990484 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: from cryptography.utils import int_from_bytes Apr 06 16:29:09.990823 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 06 16:29:09.990823 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: from cryptography.utils import int_from_bytes Apr 06 16:29:12.530581 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 06 16:29:12.531175 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 06 16:29:12.531353 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 06 16:29:12.531695 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 06 16:29:12.531944 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 06 16:29:12.532321 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.532641 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.532993 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.533307 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.533629 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.533938 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.534239 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.534339 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 06 16:29:12.534731 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 06 16:29:12.534822 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.534822 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.534987 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 06 16:29:12.535070 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.535352 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 06 16:29:12.535465 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.535613 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 06 16:29:12.535714 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836848-1-iscsi {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.535973 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.536108 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.536269 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.536374 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.536573 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.536662 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.536925 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.537056 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.537257 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.537349 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.537568 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.537665 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.537885 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.537974 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.538200 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.538417 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.538552 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.538773 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.538869 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.539083 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.539170 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.539402 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836848-1-iscsi {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.539490 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.539726 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.539831 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.540031 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.540136 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.540337 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.540440 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.540649 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.540781 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.540980 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.541075 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.541292 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.541389 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.541593 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.541689 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.541981 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836848-1-iscsi {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.542096 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.542407 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.542662 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.542779 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.543094 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.543210 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.543499 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.543609 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.543805 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.543895 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.544108 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.544196 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.544423 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.544610 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.544760 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.544852 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.545064 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.545166 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.545383 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.545492 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.545697 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.545786 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.546005 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.546139 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836848-1-iscsi {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.546315 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.546413 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.546612 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.546710 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.546913 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.547003 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.547212 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.547393 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.547521 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.547706 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.547803 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.548015 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.548103 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.548329 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.548443 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.548628 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.548779 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.548968 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.549066 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.549279 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.549377 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.549594 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.549695 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.549837 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.549934 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.550080 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.550215 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.550389 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.550515 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.550699 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.550822 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.551003 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.551125 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.551305 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.551440 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.551603 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.551744 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.551901 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.552046 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.552199 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.552290 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.552498 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.552596 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.552823 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.552925 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.553127 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.553216 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.553439 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.553545 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.553747 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.553837 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.553991 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.554082 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.554308 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.554397 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.554623 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.554712 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.554929 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.555018 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.555235 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.555331 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.555534 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.555623 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.555834 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.555921 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.556140 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.556273 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.556443 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.556532 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.556767 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.556872 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.557073 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.557164 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.557375 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.557472 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.557673 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.557775 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.557997 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.558140 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.558373 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.558638 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.558734 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.558975 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.559066 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.559218 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.559424 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.559513 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.559683 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.559782 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.559990 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.560079 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.560329 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.560424 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.560647 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.560768 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.560972 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.561061 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.561265 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.561355 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.561564 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.561662 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.561862 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.561956 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.562161 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.562251 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.562458 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.562558 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.562755 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.562853 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.563056 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.563144 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.563353 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.563446 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.563600 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.563688 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.563900 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.563988 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.564202 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.564304 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.564516 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.564613 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.564836 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.564926 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.565135 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.565226 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.565432 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.565531 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.565730 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.565819 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.566032 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.566129 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.566327 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.566415 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.566624 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.566724 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.566925 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.567013 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.567221 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.567316 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.567516 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.567619 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.567817 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.567905 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.568113 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.568200 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.568410 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.568508 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.568771 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.568864 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.569028 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.569123 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.569325 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.569497 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.569633 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.569724 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.569930 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.570027 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.570227 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.570329 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.570520 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.570617 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.570814 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.570910 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.571106 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.571204 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.571401 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.571490 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.571694 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.571784 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.571989 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.572086 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.572280 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.572376 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.572587 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.572673 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.572913 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.573003 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.573226 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.573359 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.573568 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.573663 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.573866 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.574133 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.574224 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.574507 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.574595 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.574817 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.574916 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.575124 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.575245 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.575425 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.575555 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.575728 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.575881 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.576029 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.576209 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.576333 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.576520 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.576621 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.576854 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.576946 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.577160 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.577256 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.577481 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.577579 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.577787 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.577883 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.578091 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.578187 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.578395 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.578492 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.578709 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.578796 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.579022 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.579118 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:29:12.579344 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.579448 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.579699 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.579796 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.579960 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.580049 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.580270 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.580360 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.580575 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.580663 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.580912 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.581002 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.581237 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.581327 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.581553 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.581655 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.581864 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.581953 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.582194 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.582294 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.582503 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.582614 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.582811 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.582914 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.583121 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.583239 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.583438 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.583556 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.583752 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.583863 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.584084 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.584208 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.584402 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.584504 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.584731 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.584834 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.585052 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.585149 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.585362 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.585453 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.585676 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.585779 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.585984 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.586073 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.586289 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.586378 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.586594 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.586730 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.586895 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.586984 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.587197 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.587286 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.587527 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.587625 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.587838 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.587934 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.588148 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.588237 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.588455 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.588554 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.588782 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.588874 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.589127 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.589253 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.589747 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.589907 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.590050 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.590350 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.590445 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.590649 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.590747 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.590947 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.591037 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.591251 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.591339 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.591547 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.591716 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.591863 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.591959 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.592185 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.592273 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.592477 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.592575 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.592839 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.592939 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.593142 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.593239 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.593465 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.593560 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.593751 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.593856 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.594057 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.594165 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.594357 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.594454 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.594662 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.594751 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.594967 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.595054 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.595262 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.595359 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.595565 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.595652 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.595869 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.595957 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.596169 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.596259 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.596468 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.596554 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.596797 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.596907 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.597097 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.597225 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.597406 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.597506 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.597708 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.597806 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.598010 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.598106 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.598313 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.598401 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.598619 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.598717 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.598926 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.599014 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.599230 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.599326 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.599532 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.599636 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.599844 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.599949 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.600145 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.600238 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.600456 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.600544 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.600797 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.600890 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.601121 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.601244 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.601433 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.601535 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.601728 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.601836 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.602031 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.602121 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.602329 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.602419 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.602636 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.602736 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.602931 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.603021 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.603232 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.603323 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.603526 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.603635 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.603825 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.603934 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.604117 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.604207 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.604411 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.604500 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.604770 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.604888 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.605091 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.605335 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.605424 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.605758 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.605846 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.606073 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.606162 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.606374 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.606523 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.606720 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.606868 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.607010 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.607100 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.607325 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.607421 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.607627 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.607729 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.607930 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.608020 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.608232 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.608321 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.608541 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.608643 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.608867 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.608958 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.609170 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.609258 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.609472 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.609579 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.609776 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.609865 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.610073 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.610164 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.610384 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.610481 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.610687 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.610776 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.610985 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.611072 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.611287 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.611383 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.611586 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.611673 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.611908 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.612005 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.612202 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.612292 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.612498 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.612726 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.612820 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.612903 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.613152 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.613242 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.613475 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.613565 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.613783 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.613884 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.614097 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.614196 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.614398 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.614486 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.614703 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.614802 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.615003 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.615093 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.615304 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.615393 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.615607 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.615711 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.615909 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.616005 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.616216 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.616305 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.616516 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.616613 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.616848 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.616950 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.617150 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.617256 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.617461 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.617559 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.617762 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.617850 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.618069 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.618164 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.618364 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.618466 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.618668 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.618758 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.618987 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.619075 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.619310 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.619408 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.619615 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.619717 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.619918 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.620011 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.620219 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.620311 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.620620 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.620731 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.621052 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.621276 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.621410 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.621549 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.621643 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.621874 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.621964 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.622187 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.622287 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.622509 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.622599 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.622821 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.622909 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.623125 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.623228 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.623423 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.623513 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.623732 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.623828 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.624031 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.624120 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.624331 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.624434 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.624626 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.624751 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.624956 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.625054 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.625270 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.625367 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.625574 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.625664 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.625887 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.625976 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.626193 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.626289 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.626489 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.626585 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.626788 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.626879 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.627091 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.627191 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.627389 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.627512 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.627686 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.627776 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.627986 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.628075 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.628286 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.628384 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.628591 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.628701 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.628918 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.629018 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.629219 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.629321 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.629524 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.629613 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.629832 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.629928 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.630198 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.630305 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.630438 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.630527 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.630738 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.630825 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.631041 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.631132 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.631354 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.631468 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.631661 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.631760 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.631961 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.632049 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.632260 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.632348 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.632568 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.632664 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.632898 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.633050 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.633190 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.633325 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.633485 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.633621 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.633769 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.633911 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.634074 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.634240 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.634375 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.634471 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.634658 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.634755 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.634963 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.635058 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.635271 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.635396 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.635580 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.635839 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.635928 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.637199 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.637344 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.637451 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.637451 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.637604 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.637686 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.637777 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.637867 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.637960 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.638067 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.638152 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.638234 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.638316 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.638496 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.638601 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.638797 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.638888 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.639102 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.639198 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.639404 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.639500 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.639705 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.639803 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.640009 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.640098 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.640307 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.640404 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.640606 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.640714 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.640929 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.641027 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.641234 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.641332 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.641534 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.641822 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.641911 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.642117 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.642205 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.642416 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.642506 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.642729 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.642818 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.643027 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.643125 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.643332 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.643423 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.643630 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.643719 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.643944 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.644047 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.644248 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.644337 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.644550 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.644794 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.644938 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.645076 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.645220 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.645355 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.645490 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.645630 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.645763 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.645896 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.646082 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.646221 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.646368 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.646501 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.646669 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.646813 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.646957 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.647091 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.647263 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.647398 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.647566 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.647703 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.647849 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.647990 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.648140 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.648276 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.648449 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.648600 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.648781 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.648926 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.649069 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.649203 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.649367 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.649517 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.649652 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.649793 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.649958 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.650105 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.650259 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.650407 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.650550 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.650689 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.650826 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.650960 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.651129 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.651275 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.651413 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.651552 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.651743 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.651884 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.652036 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.652330 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.652477 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.652612 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.652777 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.652941 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.653096 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.653231 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.653366 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.653523 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.653660 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.653822 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.653968 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.654113 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.654246 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.654413 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.654527 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.654708 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.654851 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.655005 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.655142 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.655283 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.655419 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.655587 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.655734 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.655870 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.656016 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.656170 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.656306 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.656485 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.656623 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.656811 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.656946 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.657111 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.657257 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.657428 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.657564 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.657702 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.657847 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.657983 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.658117 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.658260 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.658399 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.658541 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.658676 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.658848 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.658993 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.659156 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.659292 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.659450 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.659594 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.659739 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.659884 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.660018 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.660159 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.660294 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.660428 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.660594 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.660796 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.660932 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.661067 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.661212 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.661346 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.661486 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.661640 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.661775 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.661908 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.662042 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.662174 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.662317 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.662460 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.662624 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.662764 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.662926 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.663066 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.663208 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.663349 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.663502 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.663637 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.663774 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.663907 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.664105 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.664245 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.664401 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.664540 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.664758 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.664899 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.665075 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.665222 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.665372 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.665507 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.665675 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.665827 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.665963 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.666098 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.666241 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.666377 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.666579 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.666787 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.666936 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.667081 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.667231 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.667415 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.667636 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.667786 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.667988 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.668174 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.668348 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.668489 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.668626 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.668801 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.668979 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.669117 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.669293 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.669431 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.669587 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.669723 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.669894 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.670038 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.670182 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.670319 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.670524 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.670680 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.670815 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.670947 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.671134 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.671266 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.671439 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.671595 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.671728 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.671863 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.672030 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.672163 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.672379 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.672514 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.672651 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.672827 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.672961 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.673095 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.673243 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.673399 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.673549 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.673685 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.673827 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.673968 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.674110 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.674243 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.674382 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.674518 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.674677 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.674821 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.674958 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.675092 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.675278 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.675424 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.675569 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.675712 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.675852 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.675985 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.676153 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.676289 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.676450 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.676596 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.676763 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.676902 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.677040 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.677191 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.677425 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.677545 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.677725 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.677869 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.678025 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.678163 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.678312 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.678445 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.678618 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.678755 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.678921 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.679057 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.679212 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.679354 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.679521 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.679658 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.679815 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.679951 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.680124 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.680260 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.680432 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.680569 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.680759 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.680908 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.681046 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.681194 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.681368 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.681506 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.681674 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.681823 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.681960 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.682098 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.682268 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.682413 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.682568 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.682712 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.682907 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.683116 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.683312 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.683404 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.683552 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.683853 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.683991 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.684165 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.684303 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.684558 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.684724 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.684892 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.685030 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.685173 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.685319 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.685497 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.685641 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.685818 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.685956 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.686134 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.686271 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.686440 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.686587 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.686752 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.686889 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.687071 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.687216 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.687361 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.687503 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.687663 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.687796 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.687965 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.688105 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.688283 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.688423 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.688597 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.688754 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.688924 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.689062 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.689230 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.689377 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.689511 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.689645 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.689828 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.689981 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.690128 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.690263 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.690433 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.690579 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.690735 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.690894 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.691132 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.691279 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.691446 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.691579 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.691744 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.691883 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.692060 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.692194 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.692383 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.692519 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.692667 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.692860 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.692996 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.693141 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.693291 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.693426 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.693587 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.693724 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.693867 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.694015 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.694149 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.694282 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.694444 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.694582 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.694749 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.694896 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.695051 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.695206 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.695341 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.695477 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.695632 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.695783 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.695925 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.696059 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.696229 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.696366 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.696529 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.696664 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.696870 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.697017 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.697165 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.697302 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.697479 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.697685 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.697843 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.698008 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.698143 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.698315 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.698478 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.698745 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.698878 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.699029 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.699322 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.699553 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.699700 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.699837 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.699970 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.700108 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.700254 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.700403 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.700561 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.700756 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.700891 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.701036 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.701174 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.701325 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.701467 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.701604 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.701767 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.701903 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.702078 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.702224 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.702385 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.702537 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.702689 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.702827 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.702992 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.703145 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.703294 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.703436 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.703570 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.703713 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.703861 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.703952 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.704157 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.704246 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.704454 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.704544 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.704774 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.704869 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.705077 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.705167 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.705371 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.705460 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.705667 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.705758 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.705964 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.706054 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.706285 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.706383 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.706569 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.706660 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.706882 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.706972 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.707186 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.707284 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.707485 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.707581 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.707784 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.707910 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.708082 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.708184 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.708417 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.708515 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.708734 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.708826 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.709062 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.709171 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.709378 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.709467 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.709689 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.709779 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.710010 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.710112 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.710310 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.710399 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.710613 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.710703 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.710919 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.711010 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.711221 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.711311 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.711523 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.711612 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.711827 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.711917 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.712133 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.712223 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.712431 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.712579 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.712753 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.712847 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.713057 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.713154 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.713363 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.713451 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.713661 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.713788 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.713968 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.714057 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.714840 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.714950 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.715231 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.715360 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.715542 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.715680 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.715852 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.715989 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.716161 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.716336 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.716468 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.716646 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.716799 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.717004 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.717102 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.717326 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.717423 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.717650 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.717748 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.717978 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.718067 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.718285 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.718377 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.718599 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.718726 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.718913 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.719001 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.719226 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.719325 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.719536 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.719638 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.719847 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.719938 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.720157 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.720247 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.720465 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.720581 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.720803 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.720905 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.721114 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.721203 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.721421 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.721517 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.721728 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.721818 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.722036 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.722125 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.722350 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.722552 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.722672 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.722881 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.722979 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.723195 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.723286 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.723507 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.723597 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.723818 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.723908 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.724118 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.724213 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.724424 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.724513 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.724754 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.724844 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.725067 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.725157 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.725374 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.725466 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.725681 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.725782 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.725988 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.726083 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.726294 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.726384 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.726603 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.726701 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.726934 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.727116 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.727251 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.727424 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.727567 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.727754 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.727879 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.728072 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.728193 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.728388 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.728550 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.728732 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.728885 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.729032 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.729191 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.729351 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.729503 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.729650 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.729950 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.730087 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.730398 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.730487 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.730700 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.730851 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.731001 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.731163 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.731316 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.731476 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.731622 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.731790 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.731918 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.732099 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.732230 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.732412 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.732535 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.732808 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.733091 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.733192 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.733434 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.733534 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.733749 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.733839 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.734073 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.734178 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.734386 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.734487 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.734697 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.734786 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.735000 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.735098 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.735385 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.735500 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.735599 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.735815 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.735906 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.736143 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.736243 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.736466 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.736558 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.736786 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.736879 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.737087 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.737197 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.737395 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.737486 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.737698 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.737787 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.737994 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.738111 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.738297 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.738394 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.738593 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.738691 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.738897 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.738986 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.739197 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.739295 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.739496 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.739586 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.739794 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.739892 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.740098 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.740189 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.740396 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.740485 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.740702 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.740795 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.741010 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.741242 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.741361 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.741589 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.741687 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.741881 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.741970 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.742181 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.742272 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.742484 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.742577 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.742788 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.742879 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.743085 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.743174 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.743384 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.743484 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.743707 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.743796 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.744010 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.744097 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.744330 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.744427 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.744618 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.744727 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.744946 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.745034 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.745250 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.745353 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.745649 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.745771 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.745962 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.746237 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.746380 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.746561 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.746730 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.746873 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.747043 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.747180 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.747508 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.747605 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.747819 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.747909 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.748125 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.748225 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.748432 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.748527 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.748762 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.748856 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.749075 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.749167 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.749379 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.749469 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.749682 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.749771 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.749982 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.750073 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.750289 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.750378 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.750587 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.750675 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.750888 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.750977 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.751187 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.751283 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.751485 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.751581 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.751788 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.751878 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.752088 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.752183 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.752395 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.752494 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.752719 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.752813 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.753021 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.753112 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.753324 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.753427 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.753626 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.753716 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.753933 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.754022 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.754252 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.754350 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.754561 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.754650 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.754866 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.754956 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.755172 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.755269 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.755480 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.755608 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.755783 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.756031 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.756134 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.756370 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.756461 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.756671 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.756789 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.757005 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.757107 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.757324 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.757417 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.757629 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.757720 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.757928 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.758026 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.758233 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.758327 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.758558 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.758651 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.758869 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.758968 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.759182 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.759283 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.759492 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.759582 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.759802 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.759892 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.760107 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.760196 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.760417 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.760507 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.760746 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.760840 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.761097 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.761187 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.761496 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.761644 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.761827 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.761987 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.762148 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.762301 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.762470 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.762612 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.762769 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.762927 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.763068 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.763267 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.763356 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.763587 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.763678 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.763902 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.763991 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.764215 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.764358 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.764521 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.764618 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.764842 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.764933 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.765147 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.765255 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.765441 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.765539 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.765738 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.765828 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.766033 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.766131 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.766329 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.766424 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.766629 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.766718 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.766924 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.767022 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.767220 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.767344 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.767518 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.767653 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.767813 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.767969 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.768108 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.768288 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.768406 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.768596 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.768748 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.768941 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.769033 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.769262 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.769352 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.769570 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.769668 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.769866 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.769966 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.770161 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.770250 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.770487 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.770587 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.770813 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.770903 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.771125 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.771215 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.771438 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.771530 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.771740 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.771883 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.772024 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.772162 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.772310 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.772447 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.772621 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.772825 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.772965 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.773112 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.773269 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.773416 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.773565 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.773710 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.773846 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.773990 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.774129 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.774273 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.774398 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.774575 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.774712 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.774860 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.775005 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.775158 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.775301 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.775437 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.775573 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.775723 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.775858 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.775945 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.776132 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.776235 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.776435 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.776539 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.776875 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.776982 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.777205 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.777417 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.777519 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.777738 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.777829 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.778050 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.778142 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.778357 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.778520 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.778655 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.778743 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.778956 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.779088 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.779260 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.779370 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.779564 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.779654 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.779864 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.779953 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.780173 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.780278 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.780481 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.780571 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.780824 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.780929 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.781146 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.781236 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.781461 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.781551 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.781768 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.781856 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.782089 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.782180 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.782400 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.782490 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.782712 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.782801 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.783021 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.783112 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.783339 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.783429 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.783643 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.783745 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.783952 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.784047 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.784244 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 06 16:29:12.784335 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.784556 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.784885 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.785192 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.785515 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.785836 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.786137 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.786457 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.786772 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.787095 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.787409 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.787716 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.788040 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.788349 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.788653 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.788986 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.789289 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.789597 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.789914 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.790225 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.790546 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.790867 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.791190 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.791510 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.791852 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.792163 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.792671 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.793268 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.793596 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.793912 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.794221 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:29:12.794465 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 06 16:29:12.812149 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG oslo_db.sqlalchemy.engines [None req-f3762809-4c3d-42d3-a90c-8a74b4244391 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 06 16:29:12.820232 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG oslo_db.sqlalchemy.engines [None req-faf4d975-c670-4a4f-806c-a1ffbe6cd3fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 06 16:29:12.874829 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.context [None req-f3762809-4c3d-42d3-a90c-8a74b4244391 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1d668fef-de9c-4391-8526-0546ba1208c8(cell1) {{(pid=102884) load_cells /opt/stack/nova/nova/context.py:464}} Apr 06 16:29:12.880551 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG oslo_concurrency.lockutils [None req-f3762809-4c3d-42d3-a90c-8a74b4244391 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:29:12.882128 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG oslo_concurrency.lockutils [None req-f3762809-4c3d-42d3-a90c-8a74b4244391 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:29:12.882901 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG oslo_concurrency.lockutils [None req-f3762809-4c3d-42d3-a90c-8a74b4244391 None None] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:29:12.883052 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.context [None req-faf4d975-c670-4a4f-806c-a1ffbe6cd3fb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1d668fef-de9c-4391-8526-0546ba1208c8(cell1) {{(pid=102883) load_cells /opt/stack/nova/nova/context.py:464}} Apr 06 16:29:12.884794 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG oslo_concurrency.lockutils [None req-f3762809-4c3d-42d3-a90c-8a74b4244391 None None] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:29:12.889189 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG oslo_concurrency.lockutils [None req-faf4d975-c670-4a4f-806c-a1ffbe6cd3fb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:29:12.891733 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG oslo_concurrency.lockutils [None req-faf4d975-c670-4a4f-806c-a1ffbe6cd3fb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:29:12.892624 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG oslo_concurrency.lockutils [None req-faf4d975-c670-4a4f-806c-a1ffbe6cd3fb None None] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:29:12.894528 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG oslo_concurrency.lockutils [None req-faf4d975-c670-4a4f-806c-a1ffbe6cd3fb None None] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:29:12.895196 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG oslo_db.sqlalchemy.engines [None req-f3762809-4c3d-42d3-a90c-8a74b4244391 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 06 16:29:12.897704 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG oslo_db.sqlalchemy.engines [None req-f3762809-4c3d-42d3-a90c-8a74b4244391 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 06 16:29:12.907932 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG oslo_db.sqlalchemy.engines [None req-faf4d975-c670-4a4f-806c-a1ffbe6cd3fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 06 16:29:12.910578 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG oslo_db.sqlalchemy.engines [None req-faf4d975-c670-4a4f-806c-a1ffbe6cd3fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 06 16:29:13.053292 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG oslo_db.sqlalchemy.engines [None req-f3762809-4c3d-42d3-a90c-8a74b4244391 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 06 16:29:13.066788 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG oslo_db.sqlalchemy.engines [None req-faf4d975-c670-4a4f-806c-a1ffbe6cd3fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 06 16:29:13.507664 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: WARNING keystonemiddleware.auth_token [None req-f3762809-4c3d-42d3-a90c-8a74b4244391 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 06 16:29:13.514574 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: WARNING keystonemiddleware.auth_token [None req-f3762809-4c3d-42d3-a90c-8a74b4244391 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 06 16:29:13.518839 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: WARNING keystonemiddleware.auth_token [None req-faf4d975-c670-4a4f-806c-a1ffbe6cd3fb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 06 16:29:13.525489 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: WARNING keystonemiddleware.auth_token [None req-faf4d975-c670-4a4f-806c-a1ffbe6cd3fb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 06 16:29:13.731925 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: WARNING keystonemiddleware.auth_token [None req-f3762809-4c3d-42d3-a90c-8a74b4244391 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 06 16:29:13.737146 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: WARNING keystonemiddleware.auth_token [None req-f3762809-4c3d-42d3-a90c-8a74b4244391 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 06 16:29:13.742464 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5603d2a3e9c0 pid: 102884 (default app) Apr 06 16:29:13.744530 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-f3762809-4c3d-42d3-a90c-8a74b4244391 None None] Calling method '>' {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:29:13.744744 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: WARNING keystonemiddleware.auth_token [None req-faf4d975-c670-4a4f-806c-a1ffbe6cd3fb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 06 16:29:13.745734 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-f3762809-4c3d-42d3-a90c-8a74b4244391 None None] 10.222.0.64 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001737 Apr 06 16:29:13.746520 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 788 bytes} [Wed Apr 6 16:29:13 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:29:13.749998 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: WARNING keystonemiddleware.auth_token [None req-faf4d975-c670-4a4f-806c-a1ffbe6cd3fb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 06 16:29:13.755265 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5603d2a3e9c0 pid: 102883 (default app) Apr 06 16:30:33.809040 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-f3762809-4c3d-42d3-a90c-8a74b4244391 None None] Calling method '>' {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:30:33.810999 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-f3762809-4c3d-42d3-a90c-8a74b4244391 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002441 Apr 06 16:30:33.812531 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 2/2] 10.222.0.64 () {54 vars in 930 bytes} [Wed Apr 6 16:30:33 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:30:34.316277 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-d5547db3-cb97-47e5-9633-51649e7c8a4f admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:30:34.371874 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-d5547db3-cb97-47e5-9633-51649e7c8a4f admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.551100 Apr 06 16:30:34.373580 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 1/3] 10.222.0.64 () {60 vars in 1291 bytes} [Wed Apr 6 16:30:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:30:36.736270 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-f3762809-4c3d-42d3-a90c-8a74b4244391 None None] Calling method '>' {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:30:36.738141 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-f3762809-4c3d-42d3-a90c-8a74b4244391 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002297 Apr 06 16:30:36.741081 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 3/4] 10.222.0.64 () {54 vars in 930 bytes} [Wed Apr 6 16:30:36 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:30:36.815475 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-a11888a1-84f2-4269-b015-c24b23e8daea admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "cirros256", "os-flavor-access:is_public": true, "vcpus": 1, "id": "c1"}} {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:30:36.834420 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 16:30:36.834420 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: warnings.warn(msg) Apr 06 16:30:36.869968 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-a11888a1-84f2-4269-b015-c24b23e8daea admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.119811 Apr 06 16:30:36.870883 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 2/5] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Apr 6 16:30:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:30:37.110302 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-cddc00e9-670c-452e-ad71-6b185c9110fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:30:37.112950 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 16:30:37.112950 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: warnings.warn(msg) Apr 06 16:30:37.160857 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-cddc00e9-670c-452e-ad71-6b185c9110fc admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.281569 Apr 06 16:30:37.161641 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 4/6] 10.222.0.64 () {64 vars in 1335 bytes} [Wed Apr 6 16:30:36 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:30:39.527704 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-a11888a1-84f2-4269-b015-c24b23e8daea admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:30:39.529172 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-a11888a1-84f2-4269-b015-c24b23e8daea admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Apr 06 16:30:39.529583 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 3/7] 10.222.0.64 () {54 vars in 930 bytes} [Wed Apr 6 16:30:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:30:39.636629 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-cff28e5f-25fc-4bfa-b9da-e703ebe4ac47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "id": "d1", "disk": 5, "swap": 0, "os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:30:39.655679 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 16:30:39.655679 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: warnings.warn(msg) Apr 06 16:30:39.675399 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-cff28e5f-25fc-4bfa-b9da-e703ebe4ac47 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139880 Apr 06 16:30:39.675955 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 5/8] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Apr 6 16:30:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:30:39.688079 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-c877397c-e50a-405b-b954-b96ffe882366 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:30:39.689800 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 16:30:39.689800 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: warnings.warn(msg) Apr 06 16:30:39.723086 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-c877397c-e50a-405b-b954-b96ffe882366 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038878 Apr 06 16:30:39.723784 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 4/9] 10.222.0.64 () {64 vars in 1335 bytes} [Wed Apr 6 16:30:39 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:30:42.085736 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-cff28e5f-25fc-4bfa-b9da-e703ebe4ac47 admin admin] Calling method '>' {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:30:42.086736 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-cff28e5f-25fc-4bfa-b9da-e703ebe4ac47 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Apr 06 16:30:42.087104 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 6/10] 10.222.0.64 () {54 vars in 930 bytes} [Wed Apr 6 16:30:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:30:42.151361 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-260953aa-2220-4c3f-9d46-3163071c6a4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "disk": 10, "id": "d2", "name": "ds1G", "ram": 1024, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:30:42.174205 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-260953aa-2220-4c3f-9d46-3163071c6a4b admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080817 Apr 06 16:30:42.175065 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 5/11] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Apr 6 16:30:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:30:42.188514 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-46b43e71-4551-41f3-a3f6-2417f62cc1bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:30:42.213642 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-46b43e71-4551-41f3-a3f6-2417f62cc1bb admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029185 Apr 06 16:30:42.214784 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 7/12] 10.222.0.64 () {64 vars in 1335 bytes} [Wed Apr 6 16:30:42 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:30:44.589717 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-260953aa-2220-4c3f-9d46-3163071c6a4b admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:30:44.590670 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-260953aa-2220-4c3f-9d46-3163071c6a4b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Apr 06 16:30:44.591025 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 6/13] 10.222.0.64 () {54 vars in 930 bytes} [Wed Apr 6 16:30:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:30:44.657712 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-3d95bec7-5f31-4a7a-b568-f1734abeb3f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds2G", "swap": 0, "id": "d3", "vcpus": 2, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:30:44.677079 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-3d95bec7-5f31-4a7a-b568-f1734abeb3f7 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079190 Apr 06 16:30:44.677646 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 8/14] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Apr 6 16:30:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:30:44.690124 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-f4c200e6-40df-4687-b52d-c099715e049f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:30:44.716226 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-f4c200e6-40df-4687-b52d-c099715e049f admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029924 Apr 06 16:30:44.717140 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 7/15] 10.222.0.64 () {64 vars in 1335 bytes} [Wed Apr 6 16:30:44 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:30:47.042403 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-3d95bec7-5f31-4a7a-b568-f1734abeb3f7 admin admin] Calling method '>' {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:30:47.044028 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-3d95bec7-5f31-4a7a-b568-f1734abeb3f7 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002024 Apr 06 16:30:47.044398 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 9/16] 10.222.0.64 () {54 vars in 930 bytes} [Wed Apr 6 16:30:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:30:47.108294 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-477bddf0-8e95-473d-af10-b1f4b34e063b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "rxtx_factor": 1.0, "disk": 20, "ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G", "swap": 0, "vcpus": 4}} {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:30:47.129455 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-477bddf0-8e95-473d-af10-b1f4b34e063b admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079074 Apr 06 16:30:47.136940 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 8/17] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Apr 6 16:30:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 06 16:30:47.142226 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-1651c50b-8786-49fb-a732-253d9d279de1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:30:47.169154 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-1651c50b-8786-49fb-a732-253d9d279de1 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030710 Apr 06 16:30:47.170716 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 10/18] 10.222.0.64 () {64 vars in 1335 bytes} [Wed Apr 6 16:30:47 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:30:49.508732 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-477bddf0-8e95-473d-af10-b1f4b34e063b admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:30:49.509749 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-477bddf0-8e95-473d-af10-b1f4b34e063b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Apr 06 16:30:49.510160 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 9/19] 10.222.0.64 () {54 vars in 930 bytes} [Wed Apr 6 16:30:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:30:49.570253 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-dae2e427-31e8-47ed-af46-46722a7a60ab admin admin] Calling method '>' {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:30:49.593781 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-dae2e427-31e8-47ed-af46-46722a7a60ab admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.075752 Apr 06 16:30:49.595581 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 11/20] 10.222.0.64 () {60 vars in 1291 bytes} [Wed Apr 6 16:30:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:30:51.946839 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-477bddf0-8e95-473d-af10-b1f4b34e063b admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:30:51.947877 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-477bddf0-8e95-473d-af10-b1f4b34e063b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Apr 06 16:30:51.948294 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 10/21] 10.222.0.64 () {54 vars in 930 bytes} [Wed Apr 6 16:30:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:30:52.010142 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-d6857423-94f6-4c20-8a30-c1ce1bf8dd7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "ram": 512, "id": "1", "swap": 0, "rxtx_factor": 1.0}} {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:30:52.028831 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-d6857423-94f6-4c20-8a30-c1ce1bf8dd7e admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074110 Apr 06 16:30:52.036444 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 12/22] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Apr 6 16:30:51 2022] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:30:52.043586 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-3d335bd7-8025-46d5-88bb-36b051c34fc9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:30:52.067956 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-3d335bd7-8025-46d5-88bb-36b051c34fc9 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028089 Apr 06 16:30:52.068624 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 11/23] 10.222.0.64 () {64 vars in 1332 bytes} [Wed Apr 6 16:30:52 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:30:54.385143 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-d6857423-94f6-4c20-8a30-c1ce1bf8dd7e admin admin] Calling method '>' {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:30:54.386153 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-d6857423-94f6-4c20-8a30-c1ce1bf8dd7e admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Apr 06 16:30:54.386554 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 13/24] 10.222.0.64 () {54 vars in 930 bytes} [Wed Apr 6 16:30:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:30:54.451770 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-7c293f9c-15a4-4fe9-88bd-575a8b92ae4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "2", "disk": 20, "vcpus": 1, "name": "m1.small", "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:30:54.480960 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-7c293f9c-15a4-4fe9-88bd-575a8b92ae4e admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.088196 Apr 06 16:30:54.481699 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 12/25] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Apr 6 16:30:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:30:54.500613 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-25f21fc2-dd53-4d68-a385-e9ba46bc6696 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:30:54.527462 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-25f21fc2-dd53-4d68-a385-e9ba46bc6696 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032754 Apr 06 16:30:54.528128 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 14/26] 10.222.0.64 () {64 vars in 1332 bytes} [Wed Apr 6 16:30:54 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:30:56.895520 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-7c293f9c-15a4-4fe9-88bd-575a8b92ae4e admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:30:56.896530 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-7c293f9c-15a4-4fe9-88bd-575a8b92ae4e admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Apr 06 16:30:56.897002 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 13/27] 10.222.0.64 () {54 vars in 930 bytes} [Wed Apr 6 16:30:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:30:56.963315 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-5bd364ea-ec10-457c-b4f5-a8adf39517ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "id": "3", "vcpus": 2, "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:30:56.983307 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-5bd364ea-ec10-457c-b4f5-a8adf39517ae admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.079968 Apr 06 16:30:56.983956 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 15/28] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Apr 6 16:30:56 2022] POST /compute/v2.1/flavors => generated 406 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:30:56.997034 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-20c11faf-3368-4bf7-9ec7-1e49e9870f9e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:30:57.025007 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-20c11faf-3368-4bf7-9ec7-1e49e9870f9e admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031656 Apr 06 16:30:57.025883 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 14/29] 10.222.0.64 () {64 vars in 1332 bytes} [Wed Apr 6 16:30:56 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:30:59.428327 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-5bd364ea-ec10-457c-b4f5-a8adf39517ae admin admin] Calling method '>' {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:30:59.430403 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-5bd364ea-ec10-457c-b4f5-a8adf39517ae admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.006189 Apr 06 16:30:59.430789 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 16/30] 10.222.0.64 () {54 vars in 930 bytes} [Wed Apr 6 16:30:59 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:30:59.493160 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-641b61e3-b615-49df-b744-af43006edbdc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "id": "4"}} {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:30:59.514367 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-641b61e3-b615-49df-b744-af43006edbdc admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074103 Apr 06 16:30:59.514936 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 15/31] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Apr 6 16:30:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:30:59.527078 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-c3d2de2c-c054-4ead-a957-63f3d75bad8e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:30:59.553668 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-c3d2de2c-c054-4ead-a957-63f3d75bad8e admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030223 Apr 06 16:30:59.554256 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 17/32] 10.222.0.64 () {64 vars in 1332 bytes} [Wed Apr 6 16:30:59 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:31:01.996454 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-641b61e3-b615-49df-b744-af43006edbdc admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:31:01.997499 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-641b61e3-b615-49df-b744-af43006edbdc admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Apr 06 16:31:01.998121 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 16/33] 10.222.0.64 () {54 vars in 930 bytes} [Wed Apr 6 16:31:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:31:02.060018 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-17ce1438-0aa1-47df-b0de-2509f3a648fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge", "id": "5", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "swap": 0}} {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:31:02.080713 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-17ce1438-0aa1-47df-b0de-2509f3a648fe admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076664 Apr 06 16:31:02.081615 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 18/34] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Apr 6 16:31:02 2022] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:31:02.096500 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-f9bc7d28-56d2-4720-99e1-e992872c2ca5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:31:02.121585 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-f9bc7d28-56d2-4720-99e1-e992872c2ca5 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029156 Apr 06 16:31:02.122621 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 17/35] 10.222.0.64 () {64 vars in 1332 bytes} [Wed Apr 6 16:31:02 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:31:26.726356 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-17ce1438-0aa1-47df-b0de-2509f3a648fe admin admin] Calling method '>' {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:31:26.727631 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-17ce1438-0aa1-47df-b0de-2509f3a648fe admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001923 Apr 06 16:31:26.728227 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 19/36] 10.222.0.64 () {54 vars in 930 bytes} [Wed Apr 6 16:31:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:31:26.814958 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-6859206f-4bf1-4fe1-80e8-e471ee3de781 admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:31:26.837464 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-6859206f-4bf1-4fe1-80e8-e471ee3de781 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.098814 Apr 06 16:31:26.838130 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 18/37] 10.222.0.64 () {60 vars in 1291 bytes} [Wed Apr 6 16:31:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:31:28.224714 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-17ce1438-0aa1-47df-b0de-2509f3a648fe admin admin] Calling method '>' {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:31:28.225749 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-17ce1438-0aa1-47df-b0de-2509f3a648fe admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Apr 06 16:31:28.226147 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 20/38] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Apr 6 16:31:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:31:28.452096 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-5983dc8c-dc51-4c8d-98c3-2532e7d56cca admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:31:28.458078 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.wsgi [None req-5983dc8c-dc51-4c8d-98c3-2532e7d56cca admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 06 16:31:28.458651 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-5983dc8c-dc51-4c8d-98c3-2532e7d56cca admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 16:31:28.459458 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-5983dc8c-dc51-4c8d-98c3-2532e7d56cca admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.069541 Apr 06 16:31:28.459982 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 19/39] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Apr 6 16:31:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 06 16:31:28.469764 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-fdecf4ed-acb7-48db-9641-20159b36d2f2 admin admin] Calling method '>' {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:31:28.491865 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-fdecf4ed-acb7-48db-9641-20159b36d2f2 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025611 Apr 06 16:31:28.492384 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 21/40] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Apr 6 16:31:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:31:28.502508 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-fd1384b8-8d58-45fc-8d06-812bfcc4e29a admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:31:28.524711 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-fd1384b8-8d58-45fc-8d06-812bfcc4e29a admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025752 Apr 06 16:31:28.525259 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 20/41] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Apr 6 16:31:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:31:28.540364 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-a5b1bdf1-5eee-406b-9f33-9470b843167b admin admin] Calling method '>' {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:31:28.549793 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.wsgi [None req-a5b1bdf1-5eee-406b-9f33-9470b843167b admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 06 16:31:28.550520 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-a5b1bdf1-5eee-406b-9f33-9470b843167b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 16:31:28.551387 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-a5b1bdf1-5eee-406b-9f33-9470b843167b admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.017142 Apr 06 16:31:28.551881 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 22/42] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Apr 6 16:31:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 06 16:31:29.833271 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-fd1384b8-8d58-45fc-8d06-812bfcc4e29a admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:31:29.834336 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-fd1384b8-8d58-45fc-8d06-812bfcc4e29a admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Apr 06 16:31:29.834682 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 21/43] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Apr 6 16:31:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:31:30.040612 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-02f4fe3e-819e-4ce4-babf-c6f75c5577a8 admin admin] Calling method '>' {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:31:30.046274 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.wsgi [None req-02f4fe3e-819e-4ce4-babf-c6f75c5577a8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 06 16:31:30.046833 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-02f4fe3e-819e-4ce4-babf-c6f75c5577a8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 16:31:30.047626 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-02f4fe3e-819e-4ce4-babf-c6f75c5577a8 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.071168 Apr 06 16:31:30.048138 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 23/44] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Apr 6 16:31:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 06 16:31:30.058129 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-e8121841-0e85-400a-93f7-20b1935055ec admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:31:30.071923 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-e8121841-0e85-400a-93f7-20b1935055ec admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017411 Apr 06 16:31:30.072452 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 22/45] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Apr 6 16:31:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:31:30.082444 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-bc2139bb-b337-414f-b02b-8926ebef5849 admin admin] Calling method '>' {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:31:30.096343 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-bc2139bb-b337-414f-b02b-8926ebef5849 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017726 Apr 06 16:31:30.097119 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 24/46] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Apr 6 16:31:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:31:30.106093 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-bbf3bd9d-9166-49b0-8dc3-5969a3ab0f81 admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:31:30.111546 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.wsgi [None req-bbf3bd9d-9166-49b0-8dc3-5969a3ab0f81 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 06 16:31:30.112101 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-bbf3bd9d-9166-49b0-8dc3-5969a3ab0f81 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 16:31:30.113038 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-bbf3bd9d-9166-49b0-8dc3-5969a3ab0f81 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010412 Apr 06 16:31:30.113530 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 23/47] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Apr 6 16:31:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 06 16:31:31.400534 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-bc2139bb-b337-414f-b02b-8926ebef5849 admin admin] Calling method '>' {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:31:31.401924 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-bc2139bb-b337-414f-b02b-8926ebef5849 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001930 Apr 06 16:31:31.402408 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 25/48] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Apr 6 16:31:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:31:31.612913 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-2f697a95-31b1-4c9e-9830-20b4668b8b29 admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:31:31.618911 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.wsgi [None req-2f697a95-31b1-4c9e-9830-20b4668b8b29 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 06 16:31:31.619491 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-2f697a95-31b1-4c9e-9830-20b4668b8b29 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 16:31:31.620262 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-2f697a95-31b1-4c9e-9830-20b4668b8b29 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.080545 Apr 06 16:31:31.620803 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 24/49] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Apr 6 16:31:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 06 16:31:31.630781 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-30a80e41-3f59-48e4-99da-9a34e5edeefa admin admin] Calling method '>' {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:31:31.644594 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-30a80e41-3f59-48e4-99da-9a34e5edeefa admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017398 Apr 06 16:31:31.645145 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 26/50] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Apr 6 16:31:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:31:31.660734 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-e5433e62-855d-47da-8240-bfb8b0788f58 admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:31:31.679370 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-e5433e62-855d-47da-8240-bfb8b0788f58 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025285 Apr 06 16:31:31.679901 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 25/51] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Apr 6 16:31:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:31:31.689101 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-5985a9f1-8578-4180-94fb-c5e325de90b0 admin admin] Calling method '>' {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:31:31.695333 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.wsgi [None req-5985a9f1-8578-4180-94fb-c5e325de90b0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 06 16:31:31.695874 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-5985a9f1-8578-4180-94fb-c5e325de90b0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 16:31:31.696635 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-5985a9f1-8578-4180-94fb-c5e325de90b0 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011082 Apr 06 16:31:31.697147 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 27/52] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Apr 6 16:31:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 06 16:31:32.985033 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-e5433e62-855d-47da-8240-bfb8b0788f58 admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:31:32.986039 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-e5433e62-855d-47da-8240-bfb8b0788f58 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Apr 06 16:31:32.986433 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 26/53] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Apr 6 16:31:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:31:33.185020 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-70917f38-1572-46a6-ac8d-f745efb5e2b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:31:33.204141 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-70917f38-1572-46a6-ac8d-f745efb5e2b0 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.079584 Apr 06 16:31:33.204598 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 28/54] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Apr 6 16:31:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:31:34.485169 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-e5433e62-855d-47da-8240-bfb8b0788f58 admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:31:34.486205 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-e5433e62-855d-47da-8240-bfb8b0788f58 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Apr 06 16:31:34.486600 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 27/55] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Apr 6 16:31:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:31:34.689128 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-07ee96cb-8a43-46c3-b406-2e86ac625925 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:31:34.715975 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-07ee96cb-8a43-46c3-b406-2e86ac625925 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.089856 Apr 06 16:31:34.716733 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 29/56] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Apr 6 16:31:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:31:36.003017 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-e5433e62-855d-47da-8240-bfb8b0788f58 admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:31:36.004094 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-e5433e62-855d-47da-8240-bfb8b0788f58 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Apr 06 16:31:36.004551 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 28/57] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Apr 6 16:31:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:31:36.211488 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-271ac4fd-b808-413c-aca2-e212b2e72fb8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:31:36.231402 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-271ac4fd-b808-413c-aca2-e212b2e72fb8 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.089064 Apr 06 16:31:36.232073 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 30/58] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Apr 6 16:31:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 06 16:31:37.497001 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-e5433e62-855d-47da-8240-bfb8b0788f58 admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:31:37.498023 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-e5433e62-855d-47da-8240-bfb8b0788f58 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Apr 06 16:31:37.498424 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 29/59] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Apr 6 16:31:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:31:37.688020 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-2ef1be9a-5dc1-4a8a-81e8-81f7f00e17ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:31:37.708957 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-2ef1be9a-5dc1-4a8a-81e8-81f7f00e17ba admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.074405 Apr 06 16:31:37.709509 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 31/60] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Apr 6 16:31:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:31:38.982346 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-e5433e62-855d-47da-8240-bfb8b0788f58 admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:31:38.983638 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-e5433e62-855d-47da-8240-bfb8b0788f58 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002226 Apr 06 16:31:38.984262 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 30/61] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Apr 6 16:31:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:31:39.181719 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-27255e36-4a9a-44a6-85cd-3b9fe1b5b694 admin admin] Calling method '>' {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:31:39.201802 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-27255e36-4a9a-44a6-85cd-3b9fe1b5b694 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.082623 Apr 06 16:31:39.202346 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 32/62] 10.222.0.64 () {60 vars in 1202 bytes} [Wed Apr 6 16:31:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:32:42.894861 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-e5433e62-855d-47da-8240-bfb8b0788f58 admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:32:42.895867 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-e5433e62-855d-47da-8240-bfb8b0788f58 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Apr 06 16:32:42.896532 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 31/63] 10.222.0.64 () {54 vars in 930 bytes} [Wed Apr 6 16:32:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:32:42.966064 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-2563ec75-5367-474e-b807-bc89a7db4037 admin admin] Calling method '>' {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:32:42.985817 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-2563ec75-5367-474e-b807-bc89a7db4037 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.082885 Apr 06 16:32:42.986308 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 33/64] 10.222.0.64 () {60 vars in 1291 bytes} [Wed Apr 6 16:32:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:32:43.009425 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-59ef422a-0f5b-4cc7-b7e3-dc9dd1103b5a admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:32:43.017906 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-59ef422a-0f5b-4cc7-b7e3-dc9dd1103b5a admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013115 Apr 06 16:32:43.018443 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 32/65] 10.222.0.64 () {60 vars in 1282 bytes} [Wed Apr 6 16:32:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:32:43.032746 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-e76307da-eecb-4795-af1d-df89fcb05c83 admin admin] Calling method '>' {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:32:43.044931 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-e76307da-eecb-4795-af1d-df89fcb05c83 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017557 Apr 06 16:32:43.045540 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 34/66] 10.222.0.64 () {60 vars in 1285 bytes} [Wed Apr 6 16:32:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:32:43.059772 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-e052cc3f-312c-4060-9947-018adef25c79 admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:32:43.067606 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-e052cc3f-312c-4060-9947-018adef25c79 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011409 Apr 06 16:32:43.068312 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 33/67] 10.222.0.64 () {60 vars in 1285 bytes} [Wed Apr 6 16:32:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:32:43.086158 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-8daddf37-5ef5-4db3-9657-582b4c7b886a admin admin] Calling method '>' {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:32:43.097503 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-8daddf37-5ef5-4db3-9657-582b4c7b886a admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017187 Apr 06 16:32:43.098253 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 35/68] 10.222.0.64 () {60 vars in 1282 bytes} [Wed Apr 6 16:32:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:34:26.439900 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-1656a4f7-70f8-4cb6-ad4b-69fa2412eec6 tempest-verify_tempest_config-197527340 tempest-verify_tempest_config-197527340-project] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:34:26.442327 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-1656a4f7-70f8-4cb6-ad4b-69fa2412eec6 tempest-verify_tempest_config-197527340 tempest-verify_tempest_config-197527340-project] 10.222.0.64 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.116527 Apr 06 16:34:26.442857 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 34/69] 10.222.0.64 () {58 vars in 1133 bytes} [Wed Apr 6 16:34:26 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:36:13.879881 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-8daddf37-5ef5-4db3-9657-582b4c7b886a admin admin] Calling method '>' {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:36:13.881516 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-8daddf37-5ef5-4db3-9657-582b4c7b886a admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002096 Apr 06 16:36:13.882003 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 36/70] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Apr 6 16:36:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:36:14.162007 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-a2231122-0e88-4cbd-ad00-a2fb141c0b58 admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:36:14.163344 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 16:36:14.163344 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: warnings.warn(msg) Apr 06 16:36:14.164645 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG oslo_concurrency.lockutils [None req-a2231122-0e88-4cbd-ad00-a2fb141c0b58 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:36:14.165095 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG oslo_concurrency.lockutils [None req-a2231122-0e88-4cbd-ad00-a2fb141c0b58 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:36:14.165858 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG oslo_concurrency.lockutils [None req-a2231122-0e88-4cbd-ad00-a2fb141c0b58 admin admin] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:36:14.166256 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG oslo_concurrency.lockutils [None req-a2231122-0e88-4cbd-ad00-a2fb141c0b58 admin admin] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:36:14.198558 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-a2231122-0e88-4cbd-ad00-a2fb141c0b58 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.176026 Apr 06 16:36:14.199213 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 35/71] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Apr 6 16:36:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:36:15.522955 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-8daddf37-5ef5-4db3-9657-582b4c7b886a admin admin] Calling method '>' {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:36:15.523969 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-8daddf37-5ef5-4db3-9657-582b4c7b886a admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001792 Apr 06 16:36:15.524371 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 37/72] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Apr 6 16:36:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:36:15.722246 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-43484f58-62a7-44ba-b002-f766343034ea admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:36:15.723442 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 16:36:15.723442 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: warnings.warn(msg) Apr 06 16:36:15.724835 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG oslo_concurrency.lockutils [None req-43484f58-62a7-44ba-b002-f766343034ea admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:36:15.725281 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG oslo_concurrency.lockutils [None req-43484f58-62a7-44ba-b002-f766343034ea admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:36:15.726086 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG oslo_concurrency.lockutils [None req-43484f58-62a7-44ba-b002-f766343034ea admin admin] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:36:15.726510 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG oslo_concurrency.lockutils [None req-43484f58-62a7-44ba-b002-f766343034ea admin admin] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:36:15.747621 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-43484f58-62a7-44ba-b002-f766343034ea admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.084241 Apr 06 16:36:15.748424 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 36/73] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Apr 6 16:36:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:36:27.490200 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-8daddf37-5ef5-4db3-9657-582b4c7b886a admin admin] Calling method '>' {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:36:27.491239 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-8daddf37-5ef5-4db3-9657-582b4c7b886a admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Apr 06 16:36:27.491654 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 38/74] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Apr 6 16:36:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:36:27.689958 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-fe04a044-0b8c-48b2-9894-040b504e4cb5 admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:36:27.691387 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 16:36:27.691387 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: warnings.warn(msg) Apr 06 16:36:27.692783 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG oslo_concurrency.lockutils [None req-fe04a044-0b8c-48b2-9894-040b504e4cb5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:36:27.693249 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG oslo_concurrency.lockutils [None req-fe04a044-0b8c-48b2-9894-040b504e4cb5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:36:27.694098 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG oslo_concurrency.lockutils [None req-fe04a044-0b8c-48b2-9894-040b504e4cb5 admin admin] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:36:27.694513 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG oslo_concurrency.lockutils [None req-fe04a044-0b8c-48b2-9894-040b504e4cb5 admin admin] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:36:27.725453 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-fe04a044-0b8c-48b2-9894-040b504e4cb5 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.093347 Apr 06 16:36:27.726040 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 37/75] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Apr 6 16:36:27 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:36:29.055011 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: DEBUG nova.api.openstack.wsgi [None req-8daddf37-5ef5-4db3-9657-582b4c7b886a admin admin] Calling method '>' {{(pid=102884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:36:29.056208 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: INFO nova.api.openstack.requestlog [None req-8daddf37-5ef5-4db3-9657-582b4c7b886a admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001664 Apr 06 16:36:29.056703 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: [pid: 102884|app: 0|req: 39/76] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Apr 6 16:36:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:36:29.248443 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG nova.api.openstack.wsgi [None req-a2e60fc4-cb9d-4581-925c-b552fdd02eba admin admin] Calling method '>' {{(pid=102883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:36:29.249667 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 16:36:29.249667 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: warnings.warn(msg) Apr 06 16:36:29.251230 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG oslo_concurrency.lockutils [None req-a2e60fc4-cb9d-4581-925c-b552fdd02eba admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:36:29.251396 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG oslo_concurrency.lockutils [None req-a2e60fc4-cb9d-4581-925c-b552fdd02eba admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:36:29.252480 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG oslo_concurrency.lockutils [None req-a2e60fc4-cb9d-4581-925c-b552fdd02eba admin admin] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:36:29.252622 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: DEBUG oslo_concurrency.lockutils [None req-a2e60fc4-cb9d-4581-925c-b552fdd02eba admin admin] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:36:29.275719 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: INFO nova.api.openstack.requestlog [None req-a2e60fc4-cb9d-4581-925c-b552fdd02eba admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082245 Apr 06 16:36:29.276221 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: [pid: 102883|app: 0|req: 38/77] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Apr 6 16:36:29 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:37:30.498555 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: Wed Apr 6 16:37:30 2022 - graceful shutdown triggered... Apr 06 16:37:30.499422 dv-cinder-836848-1-iscsi devstack@n-api.service[102884]: Gracefully killing worker 2 (pid: 102884)... Apr 06 16:37:30.498762 dv-cinder-836848-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 06 16:37:30.500453 dv-cinder-836848-1-iscsi devstack@n-api.service[102883]: Gracefully killing worker 1 (pid: 102883)... Apr 06 16:37:31.499778 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: worker 1 buried after 1 seconds Apr 06 16:37:31.499778 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: worker 2 buried after 1 seconds Apr 06 16:37:31.499778 dv-cinder-836848-1-iscsi devstack@n-api.service[102882]: goodbye to uWSGI. Apr 06 16:37:31.501715 dv-cinder-836848-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Apr 06 16:37:31.502923 dv-cinder-836848-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 06 16:37:31.506449 dv-cinder-836848-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 06 16:37:31.529219 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 06 16:37:31.545179 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Apr 6 16:37:31 2022] *** Apr 06 16:37:31.545179 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 06 16:37:31.545179 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 06 16:37:31.545179 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: nodename: dv-cinder-836848-1-iscsi Apr 06 16:37:31.545179 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: machine: x86_64 Apr 06 16:37:31.545179 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: clock source: unix Apr 06 16:37:31.545179 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: pcre jit disabled Apr 06 16:37:31.545179 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: detected number of CPU cores: 4 Apr 06 16:37:31.545179 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: current working directory: / Apr 06 16:37:31.545179 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: detected binary path: /usr/bin/uwsgi-core Apr 06 16:37:31.545179 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: your processes number limit is 47680 Apr 06 16:37:31.545179 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: your memory page size is 4096 bytes Apr 06 16:37:31.545179 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: detected max file descriptor number: 2048 Apr 06 16:37:31.545179 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: lock engine: pthread robust mutexes Apr 06 16:37:31.546390 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: thunder lock: enabled Apr 06 16:37:31.546390 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 06 16:37:31.546390 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 06 16:37:31.598972 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: Python main interpreter initialized at 0x5619a20089c0 Apr 06 16:37:31.598972 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: python threads support enabled Apr 06 16:37:31.598972 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: your server socket listen backlog is limited to 100 connections Apr 06 16:37:31.598972 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: your mercy for graceful operations on workers is 90 seconds Apr 06 16:37:31.599425 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: mapped 403077 bytes (393 KB) for 2 cores Apr 06 16:37:31.599425 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: *** Operational MODE: preforking *** Apr 06 16:37:31.599642 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: *** uWSGI is running in multiple interpreter mode *** Apr 06 16:37:31.599642 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: spawned uWSGI master process (pid: 128843) Apr 06 16:37:31.599873 dv-cinder-836848-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 06 16:37:31.600588 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: spawned uWSGI worker 1 (pid: 128860, cores: 1) Apr 06 16:37:31.600964 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: spawned uWSGI worker 2 (pid: 128861, cores: 1) Apr 06 16:37:31.601094 dv-cinder-836848-1-iscsi devstack@n-api.service[128843]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 06 16:37:32.877326 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 06 16:37:32.919549 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 06 16:37:33.852139 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 06 16:37:33.852139 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: from cryptography.utils import int_from_bytes Apr 06 16:37:33.852455 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 06 16:37:33.852455 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: from cryptography.utils import int_from_bytes Apr 06 16:37:33.852617 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 06 16:37:33.852617 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: from cryptography.utils import int_from_bytes Apr 06 16:37:33.852782 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 06 16:37:33.852782 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: from cryptography.utils import int_from_bytes Apr 06 16:37:36.261379 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 06 16:37:36.262091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 06 16:37:36.262188 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 06 16:37:36.262550 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 06 16:37:36.262814 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 06 16:37:36.263212 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.263546 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.263874 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.264197 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.264534 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.264879 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.265205 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.265533 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.265873 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.266139 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.266925 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.266925 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836848-1-iscsi {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.267245 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.267400 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.267810 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.268139 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.268459 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.268809 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.269274 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.269794 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.271694 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.271694 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.271694 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.271694 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.272262 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.272262 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.272513 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.272924 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.273117 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.273432 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.273792 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836848-1-iscsi {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.274140 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.274449 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.274758 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.275168 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.275505 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.275822 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.276227 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.276624 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.277000 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.277333 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.277556 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.277785 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.278025 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.278340 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.278650 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.278967 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.279296 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.279613 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.279925 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.280177 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.280492 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.280848 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.281179 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.281513 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.281774 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.282047 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.282358 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.282687 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.283118 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.283368 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.283690 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.284108 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.284422 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.284789 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.285071 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.285385 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.285717 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.286042 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.286370 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.286684 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.287010 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.287434 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.287742 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.287998 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.288341 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.288668 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.289006 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.289335 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.289663 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.289977 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.290292 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.290607 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.290936 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.291278 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.291666 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.291847 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.292147 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.292510 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.292811 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.293125 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.293436 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.293747 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.294054 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.294367 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.294678 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.295037 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.295295 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.295595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.295962 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.296220 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.296534 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.297588 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.297999 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.298332 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.298650 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.299071 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.300003 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.300003 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.300322 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.300509 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.300853 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.301190 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.301508 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.301820 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.302151 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.302468 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.302779 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.303106 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.303415 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.303733 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.304058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.304369 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.304888 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.305368 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.305828 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.306301 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.306751 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.307198 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.307666 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.308119 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.308613 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.309130 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.309598 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.310061 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.310536 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.311018 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.311519 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.312024 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.312405 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.312769 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.313116 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.313458 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.313791 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.314116 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.314443 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.314903 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.315237 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.315560 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.315886 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.316217 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.316545 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.316918 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.317243 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.317570 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.317972 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.318215 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.318706 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.319048 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.319385 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.319706 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.320057 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.320422 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.320761 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.321097 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.321434 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.321759 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.322080 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.322400 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.322735 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.323078 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.323400 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.323727 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.324047 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.324366 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.324721 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.325036 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.325358 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.325698 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.326191 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.326651 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.327127 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.327598 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.328052 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.328506 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.328996 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.329452 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.329936 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.330465 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.330935 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.331413 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.331905 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.333285 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.333812 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.334568 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.334913 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.335384 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.338990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.338990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.338990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.338990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.338990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.338990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.338990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.338990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.340202 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.340202 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.340202 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.340202 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.340202 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.340949 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.340949 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.341279 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.341708 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.342682 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.343076 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.343400 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.343747 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.344091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.344406 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.344762 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.345097 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.345421 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.346166 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.347258 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.347258 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.347258 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.347595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.347964 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.348207 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.348518 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.349063 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.349181 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.349469 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.349800 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.350114 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.350421 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.350728 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.351222 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.351578 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.351919 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.352270 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.352941 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.353268 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.354422 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.354422 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.354422 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.355073 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.355073 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.355258 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.355611 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.355918 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.358595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.358595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.358595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.358595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.358595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.358595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.358595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.358595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.359732 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.359732 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.359732 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.359732 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.360185 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.360185 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.360561 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.360849 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.361094 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.362178 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.362808 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.362808 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.363142 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.363460 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.363791 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.364103 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.364426 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.364744 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.365064 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.365452 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.365796 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.366173 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.366486 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.366809 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.367217 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.367528 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.367844 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.368238 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.368559 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.369078 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.369664 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.369994 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.370382 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.370795 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.371123 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.371347 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 06 16:37:36.372015 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 06 16:37:36.372258 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.372258 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.373150 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 06 16:37:36.373379 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.373601 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 06 16:37:36.373844 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.374060 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 06 16:37:36.374060 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.374465 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.374681 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.374900 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.375217 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.375217 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.375647 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.375964 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.376177 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.376399 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.376584 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.376868 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.376868 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.377378 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.377593 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.377593 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.378024 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.378241 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.378241 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836848-1-iscsi {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.378662 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.378870 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.379075 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.379284 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.379495 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.379723 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.380004 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.380222 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.380369 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.380516 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.380670 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.380839 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.380997 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.381138 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.381274 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.381412 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.381583 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.381779 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.381918 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.382052 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.382183 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.382416 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.382554 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.382554 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.382807 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.382960 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.383101 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.383248 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.383397 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.383531 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.383679 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.383827 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.383968 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.384127 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.384279 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.384410 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.384551 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.384551 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836848-1-iscsi {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.384844 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.384994 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.385141 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.385269 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.385404 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.385558 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.385695 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.385695 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.385943 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.386072 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.386211 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.386350 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.386487 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.386628 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.386778 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.386778 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.387149 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.387319 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.387479 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.387624 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.387762 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.387904 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.388043 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.388192 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.388326 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.388463 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.388463 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.388743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.388898 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.389028 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.389154 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.389297 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.389430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.389553 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.389687 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.389820 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.389946 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.390073 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.390225 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.390358 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.390482 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.390626 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.390776 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.390931 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.391086 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.391224 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.391361 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.391494 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.391631 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.391886 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.392034 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.392169 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.392309 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.392448 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.392593 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.393183 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.393380 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.393380 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.393707 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.393874 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.394057 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.394222 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.394373 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.394513 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.394650 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.394791 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.394937 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.395078 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.395278 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.395436 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.395592 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.395734 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.395898 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.396047 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.396193 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.396341 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.396470 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.396610 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.396869 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.396995 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.397147 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.397290 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.397620 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.397765 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.397889 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.398073 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.398207 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.398341 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.398476 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.398627 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.398627 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.398901 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.399150 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.399300 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.399451 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.399589 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.399720 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.399857 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.399995 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.400139 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.400283 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.400408 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.400542 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.400673 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.400673 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.400987 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.401141 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.401275 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.401275 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.401504 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.401631 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.401767 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.401912 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.402055 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.402190 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.402309 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.402489 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.402641 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.402777 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.402933 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.403205 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.403352 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.403502 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.403660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.403808 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.403943 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.404082 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.404203 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.404203 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.404435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.404570 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.404740 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.404904 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.405051 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.405212 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.405355 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.405482 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.405622 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.405766 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.405884 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.406040 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.406200 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.406341 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.406496 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.406636 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.406792 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.406944 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.407079 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.407229 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.407370 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.407513 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.407657 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.407785 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.407912 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.408037 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.408188 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.408345 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.408535 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.408994 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.408994 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.409285 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.409411 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.409546 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.409701 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.409827 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.409827 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.410078 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.410222 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.410366 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.410366 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.410623 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.410756 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.410879 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.411063 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.411209 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.411359 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.411521 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.411665 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.411831 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.411976 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.412070 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.412144 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.412216 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.412304 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.412430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.412569 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.412742 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.412899 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.413057 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.413211 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.413522 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.413830 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.414064 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.414170 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.414337 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.414516 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.414648 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.414744 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.414977 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.415080 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.415336 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.415515 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.415604 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.415680 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.415893 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.416008 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.416202 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.416298 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 16:37:36.416552 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.416657 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.416885 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.416980 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.417249 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.417343 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.417557 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.417658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.417873 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.417975 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.418219 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.418427 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.418520 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.418595 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.418803 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.418907 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.419128 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.419306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.419473 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.419622 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.419777 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.419935 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.420096 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.420241 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.420401 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.420542 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.420662 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.420791 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.421033 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.421363 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.421521 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.421684 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.421847 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.422007 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.422162 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.422330 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.422484 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.422650 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.422802 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.422972 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.423127 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.423302 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.423456 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.423632 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.423765 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.423980 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.424185 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.424516 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.424855 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.425032 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.425239 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.425338 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.425564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.425654 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.425897 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.425998 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.426209 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.426305 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.426528 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.426631 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.426842 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.426944 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.427154 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.427260 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.427462 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.427557 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.427774 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.427922 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.428086 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.428181 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.428393 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.428488 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.428740 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.428852 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.429056 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.429157 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.429637 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.429766 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.429864 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.429974 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.429974 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.430265 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.430380 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.430579 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.430681 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.430883 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.430995 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.431225 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.431372 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.431548 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.431675 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.431864 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.431959 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.432178 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.432272 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.432492 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.432595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.432827 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.432935 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.433139 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.433239 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.433448 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.433551 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.433761 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.433898 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.434071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.434174 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.434398 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.434570 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.434727 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.434890 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.435037 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.435198 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.435394 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.435535 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.435672 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.435775 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.435971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.436120 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.436360 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.436586 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.436842 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.437004 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.437165 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.437317 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.437491 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.437658 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.437825 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.437977 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.438131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.438294 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.438466 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.438683 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.438871 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.439020 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.439178 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.439342 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.439509 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.439509 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.439788 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.439941 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.440218 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.440477 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.440621 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.440917 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.441077 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.441213 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.441497 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.441671 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.441835 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.442132 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.442324 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.442475 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.442757 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.442996 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.443162 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.443323 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.443492 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.443709 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.443937 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.444147 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.444345 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.444473 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.444650 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.444987 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.445165 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.445332 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.445531 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.445685 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.445882 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.446198 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.446497 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.446672 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.446827 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.446975 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.447240 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.447403 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.447618 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.447763 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.448093 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.448270 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.448437 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.448704 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.448845 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.449062 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.449182 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.449399 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.449504 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.449744 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.450101 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.450277 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.450424 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.450775 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.451004 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.451180 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.451416 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.451604 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.451742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.451991 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.452193 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.452359 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.452667 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.453070 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.461055 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.461361 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.461613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.461613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.461919 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.462070 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.462217 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.462374 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.462374 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.462677 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.462825 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.462825 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.463120 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.463280 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.463280 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.463665 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.463876 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.463876 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.464221 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.464370 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.464370 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.464660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.464829 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.464992 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.465180 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.465180 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.465528 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.465673 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.465673 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.465989 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.466216 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.466216 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.466597 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.466742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.466742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.467037 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.467187 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.467187 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.467493 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.467651 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.467651 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.467953 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.468115 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.468115 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.468498 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.468646 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.468646 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.468981 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.469174 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.469174 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.469501 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.469660 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.469809 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.469966 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.469966 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.470262 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.470422 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.470422 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.470716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.471067 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.471067 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.471877 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.471985 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.471985 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.472165 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.472262 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.472262 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.472436 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.472528 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.472613 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.472721 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.472721 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.472721 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.472987 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.473081 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.473177 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.473271 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.473271 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.473540 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.473691 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.473691 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.473969 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.474113 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.474113 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.474427 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.474560 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.474560 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.474723 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.474816 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.474912 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.474999 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.475107 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.475255 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.475255 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.475527 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.475632 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.475726 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.475820 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.475820 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.475985 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.476080 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.476166 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.476260 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.476354 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.476442 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.476535 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.476635 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.476752 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.476848 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.476935 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.477020 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.477113 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.477207 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.477300 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.477386 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.477469 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.477553 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.477650 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.477750 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.477845 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.477931 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.478015 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.478112 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.478207 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.478293 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.478377 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.478462 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.478555 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.478639 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.478737 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.478823 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.479247 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.479337 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.479422 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.479506 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.479608 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.479695 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.479788 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.479874 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.479991 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.479991 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.480174 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.480261 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.480346 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.480429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.480514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.480762 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.480860 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.481101 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.481220 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.481446 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.481575 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.481750 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.481891 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.482110 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.482366 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.482463 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.482695 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.482804 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.483021 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.483123 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.483347 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.483470 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.483670 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.483990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.484121 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.484316 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.484556 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.484649 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.484916 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.485018 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.485242 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.485538 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.485654 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.485874 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.485967 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.486192 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.486644 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.487014 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.487115 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.487331 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.487421 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.487647 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.487744 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.487971 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.488060 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.488283 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.488363 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.488603 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.488719 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.488950 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.489053 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.489269 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.489369 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.489586 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.489676 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.489898 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.489991 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.490210 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.490309 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.490520 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.490621 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.490872 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.490964 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.491198 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.491310 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.491506 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.491639 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.491831 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.491930 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.492189 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.492299 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.492501 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.492608 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.492838 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.492936 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.493160 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.493258 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.493470 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.493567 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.493781 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.493884 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.494090 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.494182 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.494403 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.494494 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.494717 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.494807 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.495026 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.495125 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.495339 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.495432 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.495652 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.495751 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.495967 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.496066 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.496281 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.496374 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.496588 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.496708 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.496929 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.497030 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.497238 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.497330 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.497558 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.497668 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.497871 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.497963 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.498178 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.498284 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.498493 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.498736 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.498829 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.499058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.499150 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.499398 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.499491 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.499708 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.499807 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.500016 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.500107 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.500339 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.500431 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.500647 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.500786 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.500981 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.501082 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.501304 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.501421 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.501602 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.501708 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.501915 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.502019 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.502373 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.502919 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.502919 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.503077 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.503077 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.503228 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.503303 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.503391 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.503501 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.503664 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.503815 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.503989 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.504123 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.504303 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.504430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.504842 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.504950 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.505174 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.505283 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.505498 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.505591 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.505812 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.505912 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.506128 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.506234 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.506438 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.506537 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.506748 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.506848 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.507058 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.507236 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.507372 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.507472 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.507681 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.507780 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.507990 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.508091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.508302 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.508395 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.508609 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.508728 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.508943 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.509080 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.509260 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.509360 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.509573 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.509670 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.509880 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.509978 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.510188 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.510279 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.510493 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.510658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.510823 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.511198 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.511296 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.511513 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.511624 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.511819 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.511952 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.512203 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.512320 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.512434 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.512518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.512751 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.512856 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.513060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.513155 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.513370 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.513469 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.513685 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.513785 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.513993 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.514089 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.514304 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.514396 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.514613 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.514713 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.514927 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.515031 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.515238 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.515488 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.515671 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.515895 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.515986 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.516222 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.516353 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.516573 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.516676 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.516862 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.517024 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.517192 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.517740 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.517862 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.518000 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.518313 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.523585 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.523788 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.523960 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.524133 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.524290 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.524446 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.524613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.524613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.524933 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.525109 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.525262 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.525262 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.525562 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.525791 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.525969 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.526200 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.526200 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.526516 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.526668 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.526820 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.526993 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.527142 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.527291 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.527441 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.527591 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.527742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.527906 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.528067 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.528228 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.528392 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.528543 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.528724 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.528899 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.529053 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.529203 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.529364 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.529526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.529691 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.529841 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.530000 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.530201 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.530383 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.530554 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.530719 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.531218 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.531389 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.531552 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.531715 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.531866 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.531866 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.532162 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.532311 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.532445 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.532591 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.532871 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.533037 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.533206 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.533905 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.534114 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.534318 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.534504 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.534665 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.534803 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.534934 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.535066 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.535201 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.535352 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.535511 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.535680 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.535831 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.535984 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.536172 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.536388 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.536551 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.536731 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.536731 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.537025 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.537207 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.537367 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.537499 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.537632 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.537765 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.537898 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.538051 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.538182 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.538326 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.538458 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.538594 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.538737 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.538879 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.539019 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.539159 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.539290 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.539422 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.539568 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.539568 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.539821 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.539960 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.540095 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.540227 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.540434 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.540582 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.540762 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.540920 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.541060 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.541194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.541338 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.541468 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.541602 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.541733 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.541864 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.541997 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.542153 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.542284 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.542428 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.542665 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.542817 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.543019 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.543161 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.543299 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.543461 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.543605 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.543989 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.544138 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.544271 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.544412 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.544543 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.544757 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.544914 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.545056 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.545056 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.545321 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.545460 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.545590 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.545729 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.545880 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.546020 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.546149 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.546300 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.546484 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.546672 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.546817 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.546960 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.547097 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.547231 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.547365 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.547511 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.547654 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.547785 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.547921 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.548061 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.548061 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.548325 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.548325 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.548593 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.548793 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.548924 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.549121 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.549267 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.549402 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.549557 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.549706 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.549838 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.549997 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.550144 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.550283 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.550424 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.550608 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.550743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.550895 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.551025 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.551175 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.551306 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.551449 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.551593 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.551743 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.551876 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.552020 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.552152 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.552286 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.552429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.552578 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.552782 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.552934 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.553075 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.553266 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.553511 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.553662 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.553817 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.554115 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.554246 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.554392 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.554540 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.554680 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.554831 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.554978 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.555128 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.555259 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.555402 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.555533 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.555666 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.555814 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.555956 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.556097 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.556228 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.556228 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.556493 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.556773 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.556976 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.557164 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.557357 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.557550 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.557729 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.557905 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.558092 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.558283 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.558463 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.558595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.558730 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.558870 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.559015 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.559146 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.559278 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.559407 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.559537 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.559679 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.559830 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.559982 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.560120 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.560120 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.560370 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.560502 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.560768 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.560919 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.561052 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.561182 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.561313 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.561453 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.561604 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.561743 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.561874 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.562015 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.562154 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.562295 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.562425 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 06 16:37:36.562564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.562564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.562564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.562564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.562564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.562564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.562564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.562564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.563750 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.563750 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.563750 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.563750 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.563750 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.563750 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.563750 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.563750 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.565016 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.565016 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.565016 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.565016 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.565016 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.565016 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.565016 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.565016 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.565960 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.565960 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.565960 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.566356 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.566356 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.566653 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.566972 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.567293 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.567620 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.567932 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.568269 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.568599 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.568994 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.569353 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.569975 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.570468 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.570793 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.571114 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.571481 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.571804 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.572118 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.572440 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.572791 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.573113 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.573430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.573753 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.574065 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.574394 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.574709 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.575030 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.575742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.577924 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.577924 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.577924 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.577924 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.578389 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.578389 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.578661 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.579237 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.579568 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.579917 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.580332 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.580911 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.580911 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.581475 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.581577 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.581891 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.582202 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.582517 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.582832 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.583217 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.583466 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.583803 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.584070 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.584661 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.584911 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.585289 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_db.sqlalchemy.engines [None req-a7121f73-d3cc-4df8-9ca9-b485eda74e43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128860) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 06 16:37:36.585450 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.585658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.585987 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.586278 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.586611 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.586941 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.587255 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.587694 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.587896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.588208 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.588535 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.588886 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.589198 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.589517 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.589830 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.590146 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.590458 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.590774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.591082 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.591414 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.591731 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.592133 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.592427 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.592660 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.592991 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.593312 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.593623 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.593930 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.594244 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.594551 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.594865 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.595172 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.595484 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.595794 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.596536 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.596933 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.597269 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.597580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.597893 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.598222 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.598539 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.598875 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.599193 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.599512 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.599868 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.600193 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.600803 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.601144 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.601475 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.601821 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.602158 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.602470 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.602786 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.603096 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.603444 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.603743 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.604063 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.604537 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.604952 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.605296 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.605296 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.605736 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.606001 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.606417 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.606643 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.606859 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.607092 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.607411 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.607766 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.608090 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.608418 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.608761 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.609087 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.609401 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.609714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.610027 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.610341 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.610659 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.611009 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.611763 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.612087 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.612528 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.612870 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.613195 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.613531 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.613839 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.614169 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.614491 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.614882 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.615276 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.615506 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.615726 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.616065 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.616401 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.616753 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.617068 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.617379 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.617694 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.618020 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.618399 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.618690 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.618999 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.619307 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.619621 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.619930 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.620238 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.620547 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.620883 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.621199 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.621506 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.621822 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.622155 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.622433 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.622742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.623044 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.623354 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.623662 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.623972 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.624279 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.624586 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.624922 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.625267 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.625606 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.625926 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.626253 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.626567 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.626893 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.627271 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.627602 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.628949 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.628949 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.628949 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.629414 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.629414 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.629726 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.630015 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.630335 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.630655 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.630976 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.631310 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.631640 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.631975 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.632280 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.632603 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.633038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.633359 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.633675 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.634011 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.634326 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.634643 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.634962 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.635365 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.635590 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.635909 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.636243 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.636583 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.636949 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.637286 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.637620 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.637981 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.638301 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.638652 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.638989 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.639313 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.639631 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.639943 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 16:37:36.640193 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 06 16:37:36.655587 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.context [None req-a7121f73-d3cc-4df8-9ca9-b485eda74e43 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1d668fef-de9c-4391-8526-0546ba1208c8(cell1) {{(pid=128860) load_cells /opt/stack/nova/nova/context.py:464}} Apr 06 16:37:36.660280 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7121f73-d3cc-4df8-9ca9-b485eda74e43 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:37:36.661961 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7121f73-d3cc-4df8-9ca9-b485eda74e43 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:37:36.662802 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7121f73-d3cc-4df8-9ca9-b485eda74e43 None None] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:37:36.664895 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7121f73-d3cc-4df8-9ca9-b485eda74e43 None None] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:37:36.666174 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_db.sqlalchemy.engines [None req-e86beea1-e783-4736-bbbf-7e16b01dad83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 06 16:37:36.676478 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_db.sqlalchemy.engines [None req-a7121f73-d3cc-4df8-9ca9-b485eda74e43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128860) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 06 16:37:36.678095 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_db.sqlalchemy.engines [None req-a7121f73-d3cc-4df8-9ca9-b485eda74e43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128860) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 06 16:37:36.745358 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.context [None req-e86beea1-e783-4736-bbbf-7e16b01dad83 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1d668fef-de9c-4391-8526-0546ba1208c8(cell1) {{(pid=128861) load_cells /opt/stack/nova/nova/context.py:464}} Apr 06 16:37:36.749777 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e86beea1-e783-4736-bbbf-7e16b01dad83 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:37:36.751346 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e86beea1-e783-4736-bbbf-7e16b01dad83 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:37:36.752164 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e86beea1-e783-4736-bbbf-7e16b01dad83 None None] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:37:36.754334 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e86beea1-e783-4736-bbbf-7e16b01dad83 None None] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:37:36.768601 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_db.sqlalchemy.engines [None req-e86beea1-e783-4736-bbbf-7e16b01dad83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 06 16:37:36.769899 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_db.sqlalchemy.engines [None req-e86beea1-e783-4736-bbbf-7e16b01dad83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 06 16:37:36.840673 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_db.sqlalchemy.engines [None req-a7121f73-d3cc-4df8-9ca9-b485eda74e43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128860) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 06 16:37:36.935434 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_db.sqlalchemy.engines [None req-e86beea1-e783-4736-bbbf-7e16b01dad83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 06 16:37:37.281763 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: WARNING keystonemiddleware.auth_token [None req-a7121f73-d3cc-4df8-9ca9-b485eda74e43 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 06 16:37:37.289185 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: WARNING keystonemiddleware.auth_token [None req-a7121f73-d3cc-4df8-9ca9-b485eda74e43 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 06 16:37:37.397267 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: WARNING keystonemiddleware.auth_token [None req-e86beea1-e783-4736-bbbf-7e16b01dad83 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 06 16:37:37.404735 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: WARNING keystonemiddleware.auth_token [None req-e86beea1-e783-4736-bbbf-7e16b01dad83 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 06 16:37:37.543031 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: WARNING keystonemiddleware.auth_token [None req-a7121f73-d3cc-4df8-9ca9-b485eda74e43 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 06 16:37:37.548387 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: WARNING keystonemiddleware.auth_token [None req-a7121f73-d3cc-4df8-9ca9-b485eda74e43 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 06 16:37:37.554971 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5619a20089c0 pid: 128860 (default app) Apr 06 16:37:37.632915 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: WARNING keystonemiddleware.auth_token [None req-e86beea1-e783-4736-bbbf-7e16b01dad83 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 06 16:37:37.638322 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: WARNING keystonemiddleware.auth_token [None req-e86beea1-e783-4736-bbbf-7e16b01dad83 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 06 16:37:37.644435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5619a20089c0 pid: 128861 (default app) Apr 06 16:38:22.500396 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e760a31d-d13f-449d-a409-8092c52bd8d2 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-146837814", "imageRef": "c217dd2b-7679-4860-b2e6-01a967f654df", "flavorRef": "452", "networks": [{"uuid": "7e938213-17e4-4d19-8db5-e45eb01958ca"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:38:23.219134 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d3f2658e-d8cd-4b88-bf60-f4bd461d7edf tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] Action: 'create', calling method: .version_select at 0x7fa9cbf7a310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1321799130"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:38:23.721111 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-e760a31d-d13f-449d-a409-8092c52bd8d2 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] validate_networks() for [('7e938213-17e4-4d19-8db5-e45eb01958ca', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 06 16:38:24.587235 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d3f2658e-d8cd-4b88-bf60-f4bd461d7edf tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.816861 Apr 06 16:38:24.588100 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1/1] 10.222.0.64 () {60 vars in 1154 bytes} [Wed Apr 6 16:38:21 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2819 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 06 16:38:24.601446 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-18b5aee1-3880-410e-a6ff-9d33a3018b40 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] Calling method '.version_select at 0x7fa9cbe46310>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:24.727388 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-18b5aee1-3880-410e-a6ff-9d33a3018b40 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/51dabe37-6189-4038-9044-ba2d54532bac" status: 200 len: 345 microversion: 2.1 time: 0.130853 Apr 06 16:38:24.729684 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 2/2] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Apr 6 16:38:24 2022] GET /compute/v2.1/os-volumes/51dabe37-6189-4038-9044-ba2d54532bac => generated 345 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:38:24.743600 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eb96faa4-5b9e-460e-81ff-c1e707bd8daa tempest-VolumesTestJSON-1568028118 tempest-VolumesTestJSON-1568028118-project] Calling method '.version_select at 0x7fa9cbe464c0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:24.877673 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eb96faa4-5b9e-460e-81ff-c1e707bd8daa tempest-VolumesTestJSON-1568028118 tempest-VolumesTestJSON-1568028118-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/ac4024fb-2e19-4909-94ef-9efc1567d14f" status: 200 len: 351 microversion: 2.1 time: 0.145799 Apr 06 16:38:24.878276 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 3/3] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Apr 6 16:38:24 2022] GET /compute/v2.1/os-volumes/ac4024fb-2e19-4909-94ef-9efc1567d14f => generated 351 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:38:25.482774 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e760a31d-d13f-449d-a409-8092c52bd8d2 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 06 16:38:25.483988 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e760a31d-d13f-449d-a409-8092c52bd8d2 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 06 16:38:25.484646 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e760a31d-d13f-449d-a409-8092c52bd8d2 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 06 16:38:25.485285 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e760a31d-d13f-449d-a409-8092c52bd8d2 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 06 16:38:25.485865 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e760a31d-d13f-449d-a409-8092c52bd8d2 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 06 16:38:25.532248 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e760a31d-d13f-449d-a409-8092c52bd8d2 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:25.538487 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e760a31d-d13f-449d-a409-8092c52bd8d2 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:25.542473 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e760a31d-d13f-449d-a409-8092c52bd8d2 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:25.548011 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e760a31d-d13f-449d-a409-8092c52bd8d2 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:25.656204 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-e760a31d-d13f-449d-a409-8092c52bd8d2 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Getting quotas for project 3af9aa6c2b6c4beead00e320236c24f9. Resources: {'instances', 'cores', 'ram'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 16:38:25.669737 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-e760a31d-d13f-449d-a409-8092c52bd8d2 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Getting quotas for user ad7a3230cc7144a0a34f80080cca5d3e and project 3af9aa6c2b6c4beead00e320236c24f9. Resources: {'instances', 'cores', 'ram'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 16:38:25.686567 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e760a31d-d13f-449d-a409-8092c52bd8d2 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 06 16:38:25.691627 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e760a31d-d13f-449d-a409-8092c52bd8d2 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c217dd2b-7679-4860-b2e6-01a967f654df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 06 16:38:25.744240 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dfdba510-93c4-46eb-b672-51be77fcc277 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] Calling method '.version_select at 0x7fa9cbe46af0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:25.834982 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e760a31d-d13f-449d-a409-8092c52bd8d2 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.974828 Apr 06 16:38:25.841396 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1/4] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Apr 6 16:38:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 4988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 06 16:38:25.844942 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dfdba510-93c4-46eb-b672-51be77fcc277 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/51dabe37-6189-4038-9044-ba2d54532bac" status: 200 len: 346 microversion: 2.1 time: 0.106431 Apr 06 16:38:25.846431 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 4/5] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Apr 6 16:38:25 2022] GET /compute/v2.1/os-volumes/51dabe37-6189-4038-9044-ba2d54532bac => generated 346 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:38:25.860018 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0ef17997-856b-482c-84c0-d642e3af7da4 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:25.860650 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0ef17997-856b-482c-84c0-d642e3af7da4 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:25.861894 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9799eacf-af7a-4cf3-93b3-16ab07904442 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] Action: 'create', calling method: .version_select at 0x7fa9cbdda160>, body: {"snapshot": {"volume_id": "51dabe37-6189-4038-9044-ba2d54532bac", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2023312148"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:38:26.107915 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0ef17997-856b-482c-84c0-d642e3af7da4 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:26.142140 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0ef17997-856b-482c-84c0-d642e3af7da4 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1214 microversion: 2.1 time: 0.295965 Apr 06 16:38:26.149375 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2/6] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:25 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1214 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:26.434575 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9799eacf-af7a-4cf3-93b3-16ab07904442 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] 10.222.0.64 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.577507 Apr 06 16:38:26.435795 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 5/7] 10.222.0.64 () {60 vars in 1161 bytes} [Wed Apr 6 16:38:25 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:38:26.447628 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-24575289-fdc6-4344-96cb-426aa73179ec tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] Calling method '.version_select at 0x7fa9cb590ee0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:26.696955 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-24575289-fdc6-4344-96cb-426aa73179ec tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/31dbe938-e433-4a7b-a743-fd45144ed33e" status: 200 len: 287 microversion: 2.1 time: 0.254462 Apr 06 16:38:26.697692 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3/8] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Apr 6 16:38:26 2022] GET /compute/v2.1/os-snapshots/31dbe938-e433-4a7b-a743-fd45144ed33e => generated 287 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:38:26.712471 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6a8b51d1-3f96-4691-98e9-8acab0937b2e tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] Calling method '.version_select at 0x7fa9cbe46dc0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:26.728370 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f4ad1b44-6435-4e9e-a6d9-88b018d6ae79 tempest-VolumesTestJSON-1568028118 tempest-VolumesTestJSON-1568028118-project] Calling method '.version_select at 0x7fa9cad12040>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:26.792595 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6a8b51d1-3f96-4691-98e9-8acab0937b2e tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.087466 Apr 06 16:38:26.793157 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 6/9] 10.222.0.64 () {58 vars in 1139 bytes} [Wed Apr 6 16:38:26 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:38:26.808420 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-20539305-adcc-4f2d-9c8e-5873ba3e93f3 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] Calling method '.version_select at 0x7fa9cbdda940>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:26.857918 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f4ad1b44-6435-4e9e-a6d9-88b018d6ae79 tempest-VolumesTestJSON-1568028118 tempest-VolumesTestJSON-1568028118-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/721c6cdc-87c3-4916-8377-aac57063bbe2" status: 200 len: 350 microversion: 2.1 time: 0.134969 Apr 06 16:38:26.869386 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4/10] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Apr 6 16:38:26 2022] GET /compute/v2.1/os-volumes/721c6cdc-87c3-4916-8377-aac57063bbe2 => generated 350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:38:26.873430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-20539305-adcc-4f2d-9c8e-5873ba3e93f3 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/31dbe938-e433-4a7b-a743-fd45144ed33e" status: 200 len: 287 microversion: 2.1 time: 0.068815 Apr 06 16:38:26.873997 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 7/11] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Apr 6 16:38:26 2022] GET /compute/v2.1/os-snapshots/31dbe938-e433-4a7b-a743-fd45144ed33e => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:38:27.164333 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-26e0a7bc-f688-40b4-9cf2-335c7056423d tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:27.166172 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-26e0a7bc-f688-40b4-9cf2-335c7056423d tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:27.543318 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-26e0a7bc-f688-40b4-9cf2-335c7056423d tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:27.603167 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-26e0a7bc-f688-40b4-9cf2-335c7056423d tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1214 microversion: 2.1 time: 0.439090 Apr 06 16:38:27.607665 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 5/12] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:27 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1214 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:27.890009 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f96be9e8-bfe5-4699-a294-ed8781ebf252 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] Calling method '.version_select at 0x7fa9cbdda310>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:28.035533 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f96be9e8-bfe5-4699-a294-ed8781ebf252 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/31dbe938-e433-4a7b-a743-fd45144ed33e" status: 200 len: 287 microversion: 2.1 time: 0.151420 Apr 06 16:38:28.036158 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 8/13] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Apr 6 16:38:27 2022] GET /compute/v2.1/os-snapshots/31dbe938-e433-4a7b-a743-fd45144ed33e => generated 287 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:38:28.621577 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4b401dbd-9697-45fa-b398-30c69229364c tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:28.622871 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4b401dbd-9697-45fa-b398-30c69229364c tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:28.636949 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b401dbd-9697-45fa-b398-30c69229364c tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:28.645284 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b401dbd-9697-45fa-b398-30c69229364c tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:28.646717 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b401dbd-9697-45fa-b398-30c69229364c tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:28.647334 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b401dbd-9697-45fa-b398-30c69229364c tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:29.047630 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1b6b6d2d-8459-4803-99d6-9a0e536079e3 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] Calling method '.version_select at 0x7fa9cbe46670>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:29.083607 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4b401dbd-9697-45fa-b398-30c69229364c tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:29.102447 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1b6b6d2d-8459-4803-99d6-9a0e536079e3 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/31dbe938-e433-4a7b-a743-fd45144ed33e" status: 200 len: 287 microversion: 2.1 time: 0.058570 Apr 06 16:38:29.103022 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 9/14] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Apr 6 16:38:29 2022] GET /compute/v2.1/os-snapshots/31dbe938-e433-4a7b-a743-fd45144ed33e => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:38:29.127473 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4b401dbd-9697-45fa-b398-30c69229364c tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1218 microversion: 2.1 time: 0.509459 Apr 06 16:38:29.129558 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 6/15] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:28 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1218 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:30.116217 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b3df3db9-80f8-429e-83a5-d1ba29d9184b tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] Calling method '.version_select at 0x7fa9cbe469d0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:30.147497 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dd0ed189-0493-45e0-a6db-d474517ea6ae tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:30.148555 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dd0ed189-0493-45e0-a6db-d474517ea6ae tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:30.166647 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd0ed189-0493-45e0-a6db-d474517ea6ae tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:30.171915 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd0ed189-0493-45e0-a6db-d474517ea6ae tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:30.174626 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd0ed189-0493-45e0-a6db-d474517ea6ae tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:30.176254 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd0ed189-0493-45e0-a6db-d474517ea6ae tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:30.229284 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b3df3db9-80f8-429e-83a5-d1ba29d9184b tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/31dbe938-e433-4a7b-a743-fd45144ed33e" status: 200 len: 288 microversion: 2.1 time: 0.117750 Apr 06 16:38:30.235172 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 10/16] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Apr 6 16:38:30 2022] GET /compute/v2.1/os-snapshots/31dbe938-e433-4a7b-a743-fd45144ed33e => generated 288 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:38:30.241718 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3cde6f89-6964-4e2c-8a12-c92ff1e0f458 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] Calling method '.version_select at 0x7fa9cbdda040>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:30.422426 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3cde6f89-6964-4e2c-8a12-c92ff1e0f458 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] 10.222.0.64 "DELETE /compute/v2.1/os-snapshots/31dbe938-e433-4a7b-a743-fd45144ed33e" status: 202 len: 0 microversion: 2.1 time: 0.186063 Apr 06 16:38:30.423000 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 11/17] 10.222.0.64 () {58 vars in 1253 bytes} [Wed Apr 6 16:38:30 2022] DELETE /compute/v2.1/os-snapshots/31dbe938-e433-4a7b-a743-fd45144ed33e => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 06 16:38:30.435214 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d8cd7135-f540-4f03-83cb-a266842e222a tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] Calling method '.version_select at 0x7fa9cbdda790>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:30.538726 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d8cd7135-f540-4f03-83cb-a266842e222a tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/31dbe938-e433-4a7b-a743-fd45144ed33e" status: 200 len: 287 microversion: 2.1 time: 0.108366 Apr 06 16:38:30.539469 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 12/18] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Apr 6 16:38:30 2022] GET /compute/v2.1/os-snapshots/31dbe938-e433-4a7b-a743-fd45144ed33e => generated 287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:38:30.628271 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-dd0ed189-0493-45e0-a6db-d474517ea6ae tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:30.643599 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dd0ed189-0493-45e0-a6db-d474517ea6ae tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1210 microversion: 2.1 time: 0.501155 Apr 06 16:38:30.650294 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 7/19] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:30 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1210 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:31.091965 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-85b17a2f-d71a-4171-843f-6143213221f3 tempest-VolumesTestJSON-1568028118 tempest-VolumesTestJSON-1568028118-project] Calling method '.version_select at 0x7fa9cbe46ca0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:31.177498 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-85b17a2f-d71a-4171-843f-6143213221f3 tempest-VolumesTestJSON-1568028118 tempest-VolumesTestJSON-1568028118-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/242d2495-15b5-4ad4-9800-3a3c98c697a8" status: 200 len: 350 microversion: 2.1 time: 0.089152 Apr 06 16:38:31.189026 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 13/20] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Apr 6 16:38:31 2022] GET /compute/v2.1/os-volumes/242d2495-15b5-4ad4-9800-3a3c98c697a8 => generated 350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:38:31.189816 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7dc432e2-62a0-407e-8565-7d8cdba4a66a tempest-VolumesTestJSON-1568028118 tempest-VolumesTestJSON-1568028118-project] Calling method '.version_select at 0x7fa9cac92040>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:31.404305 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7dc432e2-62a0-407e-8565-7d8cdba4a66a tempest-VolumesTestJSON-1568028118 tempest-VolumesTestJSON-1568028118-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.218473 Apr 06 16:38:31.408930 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 8/21] 10.222.0.64 () {58 vars in 1133 bytes} [Wed Apr 6 16:38:31 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:31.420048 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-720c4f67-a9dc-4dc3-937b-d22073cf55a7 tempest-VolumesTestJSON-1568028118 tempest-VolumesTestJSON-1568028118-project] Calling method '.version_select at 0x7fa9cbe461f0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:31.542500 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-720c4f67-a9dc-4dc3-937b-d22073cf55a7 tempest-VolumesTestJSON-1568028118 tempest-VolumesTestJSON-1568028118-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.127985 Apr 06 16:38:31.543156 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 14/22] 10.222.0.64 () {58 vars in 1148 bytes} [Wed Apr 6 16:38:31 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:38:31.555673 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-13f9108b-7f62-4dca-ba7d-eb42ed517bfb tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] Calling method '.version_select at 0x7fa9cac845e0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:31.561561 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aeab1b95-4dcb-4342-aa7c-9e707b526b55 tempest-VolumesTestJSON-1568028118 tempest-VolumesTestJSON-1568028118-project] Calling method '.version_select at 0x7fa9cbdda4c0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:31.635258 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-13f9108b-7f62-4dca-ba7d-eb42ed517bfb tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] HTTP exception thrown: Snapshot 31dbe938-e433-4a7b-a743-fd45144ed33e could not be found. Apr 06 16:38:31.636466 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-13f9108b-7f62-4dca-ba7d-eb42ed517bfb tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] Returning 404 to user: Snapshot 31dbe938-e433-4a7b-a743-fd45144ed33e could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 16:38:31.637919 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-13f9108b-7f62-4dca-ba7d-eb42ed517bfb tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/31dbe938-e433-4a7b-a743-fd45144ed33e" status: 404 len: 111 microversion: 2.1 time: 0.086162 Apr 06 16:38:31.639345 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 9/23] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Apr 6 16:38:31 2022] GET /compute/v2.1/os-snapshots/31dbe938-e433-4a7b-a743-fd45144ed33e => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 16:38:31.656392 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-91da8f93-861f-4125-849f-8a06f21babdf tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] Calling method '.version_select at 0x7fa9cac92820>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:31.827559 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-91da8f93-861f-4125-849f-8a06f21babdf tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/51dabe37-6189-4038-9044-ba2d54532bac" status: 202 len: 0 microversion: 2.1 time: 0.183562 Apr 06 16:38:31.828706 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 10/24] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Apr 6 16:38:31 2022] DELETE /compute/v2.1/os-volumes/51dabe37-6189-4038-9044-ba2d54532bac => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 06 16:38:31.837704 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-db014fa2-413e-480e-8e20-ffd3e5ea9fa1 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:31.838802 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-db014fa2-413e-480e-8e20-ffd3e5ea9fa1 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:31.852823 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aeab1b95-4dcb-4342-aa7c-9e707b526b55 tempest-VolumesTestJSON-1568028118 tempest-VolumesTestJSON-1568028118-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.294855 Apr 06 16:38:31.853407 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 15/25] 10.222.0.64 () {58 vars in 1133 bytes} [Wed Apr 6 16:38:31 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:31.859955 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db014fa2-413e-480e-8e20-ffd3e5ea9fa1 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:31.859955 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db014fa2-413e-480e-8e20-ffd3e5ea9fa1 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:31.859955 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db014fa2-413e-480e-8e20-ffd3e5ea9fa1 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:31.860285 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db014fa2-413e-480e-8e20-ffd3e5ea9fa1 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:31.869773 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c5816225-65e3-4b12-be8a-b3f9447ca339 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] Calling method '.version_select at 0x7fa9cbdda430>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:32.005504 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c5816225-65e3-4b12-be8a-b3f9447ca339 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/51dabe37-6189-4038-9044-ba2d54532bac" status: 200 len: 345 microversion: 2.1 time: 0.143790 Apr 06 16:38:32.006617 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 16/26] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Apr 6 16:38:31 2022] GET /compute/v2.1/os-volumes/51dabe37-6189-4038-9044-ba2d54532bac => generated 345 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:38:32.011413 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-081c4b2d-ae6f-4bad-aadd-19eed13bafdd tempest-VolumesTestJSON-1568028118 tempest-VolumesTestJSON-1568028118-project] Calling method '.version_select at 0x7fa9cc400820>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:32.133827 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-db014fa2-413e-480e-8e20-ffd3e5ea9fa1 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:32.151927 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-db014fa2-413e-480e-8e20-ffd3e5ea9fa1 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1272 microversion: 2.1 time: 0.321661 Apr 06 16:38:32.164182 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 11/27] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:31 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1272 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:32.291442 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-081c4b2d-ae6f-4bad-aadd-19eed13bafdd tempest-VolumesTestJSON-1568028118 tempest-VolumesTestJSON-1568028118-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.283513 Apr 06 16:38:32.299022 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 17/28] 10.222.0.64 () {58 vars in 1166 bytes} [Wed Apr 6 16:38:32 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:38:32.309127 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-017f9cdf-8e09-4624-91ca-6d12a4d9dfde tempest-VolumesTestJSON-1568028118 tempest-VolumesTestJSON-1568028118-project] Calling method '.version_select at 0x7fa9cac4d4c0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:32.541937 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-017f9cdf-8e09-4624-91ca-6d12a4d9dfde tempest-VolumesTestJSON-1568028118 tempest-VolumesTestJSON-1568028118-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.241402 Apr 06 16:38:32.547570 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 12/29] 10.222.0.64 () {58 vars in 1169 bytes} [Wed Apr 6 16:38:32 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:38:32.561388 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f502e481-200f-4fa3-8e2e-3ad211fd3c1d tempest-VolumesTestJSON-1568028118 tempest-VolumesTestJSON-1568028118-project] Calling method '.version_select at 0x7fa9cbe46940>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:32.823331 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f502e481-200f-4fa3-8e2e-3ad211fd3c1d tempest-VolumesTestJSON-1568028118 tempest-VolumesTestJSON-1568028118-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.263335 Apr 06 16:38:32.834039 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 18/30] 10.222.0.64 () {58 vars in 1154 bytes} [Wed Apr 6 16:38:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:32.841028 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b9b3273c-0233-4aab-9f66-e7980950fdf6 tempest-VolumesTestJSON-1568028118 tempest-VolumesTestJSON-1568028118-project] Calling method '.version_select at 0x7fa9cabec040>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:33.021529 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2af77d66-ded6-411b-afcc-1140fc230c89 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] Calling method '.version_select at 0x7fa9cbddac10>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:33.125665 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-2af77d66-ded6-411b-afcc-1140fc230c89 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] HTTP exception thrown: Volume 51dabe37-6189-4038-9044-ba2d54532bac could not be found. Apr 06 16:38:33.126540 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2af77d66-ded6-411b-afcc-1140fc230c89 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] Returning 404 to user: Volume 51dabe37-6189-4038-9044-ba2d54532bac could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 16:38:33.128219 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2af77d66-ded6-411b-afcc-1140fc230c89 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/51dabe37-6189-4038-9044-ba2d54532bac" status: 404 len: 109 microversion: 2.1 time: 0.113136 Apr 06 16:38:33.128917 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 19/31] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Apr 6 16:38:33 2022] GET /compute/v2.1/os-volumes/51dabe37-6189-4038-9044-ba2d54532bac => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 06 16:38:33.131044 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b9b3273c-0233-4aab-9f66-e7980950fdf6 tempest-VolumesTestJSON-1568028118 tempest-VolumesTestJSON-1568028118-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.296317 Apr 06 16:38:33.136933 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 13/32] 10.222.0.64 () {58 vars in 1187 bytes} [Wed Apr 6 16:38:32 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:38:33.163877 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-deb211af-5ebc-46b6-a6ff-05011b6ca151 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] Calling method '.version_select at 0x7fa9cac4d790>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:33.165118 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c5faa2f7-8f2e-437d-acdf-7a47d33687f8 tempest-VolumesTestJSON-1568028118 tempest-VolumesTestJSON-1568028118-project] Calling method '.version_select at 0x7fa9cc400160>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:33.233490 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-deb211af-5ebc-46b6-a6ff-05011b6ca151 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] HTTP exception thrown: Volume 51dabe37-6189-4038-9044-ba2d54532bac could not be found. Apr 06 16:38:33.234320 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-deb211af-5ebc-46b6-a6ff-05011b6ca151 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] Returning 404 to user: Volume 51dabe37-6189-4038-9044-ba2d54532bac could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 16:38:33.235412 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-deb211af-5ebc-46b6-a6ff-05011b6ca151 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/51dabe37-6189-4038-9044-ba2d54532bac" status: 404 len: 109 microversion: 2.1 time: 0.075945 Apr 06 16:38:33.236342 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 14/33] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Apr 6 16:38:33 2022] DELETE /compute/v2.1/os-volumes/51dabe37-6189-4038-9044-ba2d54532bac => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 16:38:33.247717 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f5c43a63-f701-4562-a5c8-b7bcda791a54 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:33.248852 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f5c43a63-f701-4562-a5c8-b7bcda791a54 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:33.266144 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5c43a63-f701-4562-a5c8-b7bcda791a54 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:33.267931 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5c43a63-f701-4562-a5c8-b7bcda791a54 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:33.269157 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5c43a63-f701-4562-a5c8-b7bcda791a54 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:33.273407 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5c43a63-f701-4562-a5c8-b7bcda791a54 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:33.505726 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c5faa2f7-8f2e-437d-acdf-7a47d33687f8 tempest-VolumesTestJSON-1568028118 tempest-VolumesTestJSON-1568028118-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.344936 Apr 06 16:38:33.506946 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 20/34] 10.222.0.64 () {58 vars in 1154 bytes} [Wed Apr 6 16:38:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:33.511942 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0507bf9c-c474-4db8-8e3a-f8f1549c0f73 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] Calling method '.version_select at 0x7fa9cbe46f70>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:33.592775 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-0507bf9c-c474-4db8-8e3a-f8f1549c0f73 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] HTTP exception thrown: Volume 51dabe37-6189-4038-9044-ba2d54532bac could not be found. Apr 06 16:38:33.593690 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0507bf9c-c474-4db8-8e3a-f8f1549c0f73 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] Returning 404 to user: Volume 51dabe37-6189-4038-9044-ba2d54532bac could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 16:38:33.594670 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0507bf9c-c474-4db8-8e3a-f8f1549c0f73 tempest-VolumesSnapshotsTestJSON-52502662 tempest-VolumesSnapshotsTestJSON-52502662-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/51dabe37-6189-4038-9044-ba2d54532bac" status: 404 len: 109 microversion: 2.1 time: 0.086538 Apr 06 16:38:33.595964 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 21/35] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Apr 6 16:38:33 2022] GET /compute/v2.1/os-volumes/51dabe37-6189-4038-9044-ba2d54532bac => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 16:38:34.750470 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f5c43a63-f701-4562-a5c8-b7bcda791a54 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:34.794984 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f5c43a63-f701-4562-a5c8-b7bcda791a54 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1272 microversion: 2.1 time: 1.556107 Apr 06 16:38:34.796044 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 15/36] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:33 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1272 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:35.815936 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9fe41468-807c-445f-aed9-d75c3e0b057f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:35.817041 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9fe41468-807c-445f-aed9-d75c3e0b057f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:35.854460 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fe41468-807c-445f-aed9-d75c3e0b057f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:35.856966 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fe41468-807c-445f-aed9-d75c3e0b057f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:35.860003 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fe41468-807c-445f-aed9-d75c3e0b057f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:35.860932 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fe41468-807c-445f-aed9-d75c3e0b057f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:36.701412 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9fe41468-807c-445f-aed9-d75c3e0b057f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:36.763740 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9fe41468-807c-445f-aed9-d75c3e0b057f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1272 microversion: 2.1 time: 0.951562 Apr 06 16:38:36.778788 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 22/37] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:35 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1272 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:37.785191 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4bfaaa3b-f110-462b-a1f9-a5d73135c48f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:37.788854 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4bfaaa3b-f110-462b-a1f9-a5d73135c48f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:37.821463 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bfaaa3b-f110-462b-a1f9-a5d73135c48f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:37.823250 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bfaaa3b-f110-462b-a1f9-a5d73135c48f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:37.825749 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bfaaa3b-f110-462b-a1f9-a5d73135c48f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:37.831039 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bfaaa3b-f110-462b-a1f9-a5d73135c48f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:37.911327 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-49d287dd-5743-47c2-a820-f00ea552755a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Action: 'create', calling method: .version_select at 0x7fa9cac28040>, body: {"keypair": {"name": "tempest-keypair-246421952"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:38:37.974880 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-49d287dd-5743-47c2-a820-f00ea552755a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Getting quotas for project a7b211944dc94094801aa5dd3d20a401. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 16:38:37.991032 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-49d287dd-5743-47c2-a820-f00ea552755a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Getting quotas for user 22d0f09ff8c240a485a775d3c95d626b and project a7b211944dc94094801aa5dd3d20a401. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 16:38:38.843925 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4bfaaa3b-f110-462b-a1f9-a5d73135c48f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:38.858658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4bfaaa3b-f110-462b-a1f9-a5d73135c48f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1314 microversion: 2.1 time: 1.077466 Apr 06 16:38:38.881357 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 23/38] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:37 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1314 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:38:39.242902 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-49d287dd-5743-47c2-a820-f00ea552755a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Getting quotas for project a7b211944dc94094801aa5dd3d20a401. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 16:38:39.254835 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-49d287dd-5743-47c2-a820-f00ea552755a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Getting quotas for user 22d0f09ff8c240a485a775d3c95d626b and project a7b211944dc94094801aa5dd3d20a401. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 16:38:39.303849 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-49d287dd-5743-47c2-a820-f00ea552755a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.627271 Apr 06 16:38:39.319034 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 16/39] 10.222.0.64 () {60 vars in 1157 bytes} [Wed Apr 6 16:38:37 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:39.888199 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6fd4a061-df00-4618-9d29-8fe14fa0004f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:39.890499 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6fd4a061-df00-4618-9d29-8fe14fa0004f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:39.906823 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fd4a061-df00-4618-9d29-8fe14fa0004f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:39.910007 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fd4a061-df00-4618-9d29-8fe14fa0004f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:39.911265 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fd4a061-df00-4618-9d29-8fe14fa0004f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:39.914074 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fd4a061-df00-4618-9d29-8fe14fa0004f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:40.586189 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6fd4a061-df00-4618-9d29-8fe14fa0004f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:40.595962 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6fd4a061-df00-4618-9d29-8fe14fa0004f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1314 microversion: 2.1 time: 0.712248 Apr 06 16:38:40.606390 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 24/40] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:39 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1314 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:41.620583 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-08db8679-dc29-4574-9e1f-a8cd95daf650 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:41.622275 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-08db8679-dc29-4574-9e1f-a8cd95daf650 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:41.661228 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08db8679-dc29-4574-9e1f-a8cd95daf650 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:41.662609 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08db8679-dc29-4574-9e1f-a8cd95daf650 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:41.664000 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08db8679-dc29-4574-9e1f-a8cd95daf650 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:41.664872 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08db8679-dc29-4574-9e1f-a8cd95daf650 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:43.211969 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-08db8679-dc29-4574-9e1f-a8cd95daf650 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:43.230285 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-08db8679-dc29-4574-9e1f-a8cd95daf650 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1314 microversion: 2.1 time: 1.613717 Apr 06 16:38:43.233096 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 17/41] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:41 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1314 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:38:43.671541 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9c070432-2f2c-4e7c-8753-12f6daff775d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Action: 'create', calling method: .version_select at 0x7fa9cbcf6670>, body: {"keypair": {"name": "tempest-keypair-1869411350"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:38:43.831588 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-9c070432-2f2c-4e7c-8753-12f6daff775d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Getting quotas for project 025f673d99964de4820b8ba487f95cad. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 16:38:43.857965 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-9c070432-2f2c-4e7c-8753-12f6daff775d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Getting quotas for user 20b497ce12aa400091fc7cbbc6a2d15b and project 025f673d99964de4820b8ba487f95cad. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 16:38:44.261203 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-049994bc-53ca-4d06-81b4-c0c3f54acb5e tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:44.267565 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-049994bc-53ca-4d06-81b4-c0c3f54acb5e tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:44.324008 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-049994bc-53ca-4d06-81b4-c0c3f54acb5e tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:44.331207 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-049994bc-53ca-4d06-81b4-c0c3f54acb5e tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:44.334672 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-049994bc-53ca-4d06-81b4-c0c3f54acb5e tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:44.340332 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-049994bc-53ca-4d06-81b4-c0c3f54acb5e tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:44.679524 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-9c070432-2f2c-4e7c-8753-12f6daff775d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Getting quotas for project 025f673d99964de4820b8ba487f95cad. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 16:38:44.686285 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-9c070432-2f2c-4e7c-8753-12f6daff775d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Getting quotas for user 20b497ce12aa400091fc7cbbc6a2d15b and project 025f673d99964de4820b8ba487f95cad. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 16:38:44.704505 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9c070432-2f2c-4e7c-8753-12f6daff775d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 2.373701 Apr 06 16:38:44.708571 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 25/42] 10.222.0.64 () {60 vars in 1157 bytes} [Wed Apr 6 16:38:42 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 2378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:45.526430 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-049994bc-53ca-4d06-81b4-c0c3f54acb5e tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:45.550201 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-049994bc-53ca-4d06-81b4-c0c3f54acb5e tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1314 microversion: 2.1 time: 1.296412 Apr 06 16:38:45.554843 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 18/43] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:44 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1314 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:46.569603 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-08bf5b3d-27db-4f10-9b0a-802ab030bd55 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:46.570325 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-08bf5b3d-27db-4f10-9b0a-802ab030bd55 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:46.580391 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08bf5b3d-27db-4f10-9b0a-802ab030bd55 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:46.586756 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08bf5b3d-27db-4f10-9b0a-802ab030bd55 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:46.589135 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08bf5b3d-27db-4f10-9b0a-802ab030bd55 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:46.599689 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08bf5b3d-27db-4f10-9b0a-802ab030bd55 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:46.745546 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4ae45eeb-438c-4d1d-a59a-6d63ebb0a476 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Action: 'create', calling method: .version_select at 0x7fa9cb479160>, body: {"keypair": {"name": "tempest-keypair-595131113"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:38:46.785039 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-4ae45eeb-438c-4d1d-a59a-6d63ebb0a476 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Getting quotas for project d07f53a1a9c4463693fa2c0005504b58. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 16:38:46.792174 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-4ae45eeb-438c-4d1d-a59a-6d63ebb0a476 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Getting quotas for user 2230d519a0bf4024ac9e8be3a4f5aeb2 and project d07f53a1a9c4463693fa2c0005504b58. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 16:38:47.213049 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-4ae45eeb-438c-4d1d-a59a-6d63ebb0a476 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Getting quotas for project d07f53a1a9c4463693fa2c0005504b58. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 16:38:47.230203 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-4ae45eeb-438c-4d1d-a59a-6d63ebb0a476 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Getting quotas for user 2230d519a0bf4024ac9e8be3a4f5aeb2 and project d07f53a1a9c4463693fa2c0005504b58. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 16:38:47.310699 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4ae45eeb-438c-4d1d-a59a-6d63ebb0a476 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.618530 Apr 06 16:38:47.315089 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 26/44] 10.222.0.64 () {62 vars in 1198 bytes} [Wed Apr 6 16:38:45 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1632 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 06 16:38:48.627218 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-08bf5b3d-27db-4f10-9b0a-802ab030bd55 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:48.642551 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-08bf5b3d-27db-4f10-9b0a-802ab030bd55 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1314 microversion: 2.1 time: 2.073343 Apr 06 16:38:48.654075 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 19/45] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:46 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1314 bytes in 2089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:38:49.396919 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dd610e87-d8e5-4366-bb9b-ad841f129dda tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2120574046", "imageRef": "c217dd2b-7679-4860-b2e6-01a967f654df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "161b97e6-a667-4e80-ab79-6d47a727bfd9"}], "security_groups": [{"name": "tempest-securitygroup--820918601"}], "key_name": "tempest-keypair-246421952", "user_data": "}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:38:49.663461 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8a4190d2-1625-4b47-9c18-9cf56f6c276c tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:49.666552 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8a4190d2-1625-4b47-9c18-9cf56f6c276c tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:49.680387 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a4190d2-1625-4b47-9c18-9cf56f6c276c tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:49.681063 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a4190d2-1625-4b47-9c18-9cf56f6c276c tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:49.681972 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a4190d2-1625-4b47-9c18-9cf56f6c276c tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:49.682509 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a4190d2-1625-4b47-9c18-9cf56f6c276c tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:49.794852 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-dd610e87-d8e5-4366-bb9b-ad841f129dda tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] validate_networks() for [('161b97e6-a667-4e80-ab79-6d47a727bfd9', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 06 16:38:50.723231 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8a4190d2-1625-4b47-9c18-9cf56f6c276c tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:50.730754 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8a4190d2-1625-4b47-9c18-9cf56f6c276c tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1314 microversion: 2.1 time: 1.075051 Apr 06 16:38:50.731336 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 20/46] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:49 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1314 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:38:51.351658 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-22661f28-21bb-44c8-b889-2ca6e91cdb4f req-53f65ec3-45f8-45fb-8468-05929cad4f8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac", "tag": "f126b299-b78b-4cea-9949-84de47cdca08"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:38:51.415308 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-22661f28-21bb-44c8-b889-2ca6e91cdb4f req-53f65ec3-45f8-45fb-8468-05929cad4f8e service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:51.415761 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-22661f28-21bb-44c8-b889-2ca6e91cdb4f req-53f65ec3-45f8-45fb-8468-05929cad4f8e service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:51.462077 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-22661f28-21bb-44c8-b889-2ca6e91cdb4f req-53f65ec3-45f8-45fb-8468-05929cad4f8e service nova] Creating event network-changed:f126b299-b78b-4cea-9949-84de47cdca08 for instance 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac on hv-cinder-83684 Apr 06 16:38:51.462625 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-22661f28-21bb-44c8-b889-2ca6e91cdb4f req-53f65ec3-45f8-45fb-8468-05929cad4f8e service nova] Acquired lock "compute-rpcapi-router" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 06 16:38:51.463806 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce87e381-4871-4df7-b857-7768537db85c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:51.464277 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce87e381-4871-4df7-b857-7768537db85c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:51.465099 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce87e381-4871-4df7-b857-7768537db85c None None] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:51.465967 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce87e381-4871-4df7-b857-7768537db85c None None] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:51.486485 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.compute.rpcapi [None req-ce87e381-4871-4df7-b857-7768537db85c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 06 16:38:51.487414 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce87e381-4871-4df7-b857-7768537db85c None None] Releasing lock "compute-rpcapi-router" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 06 16:38:51.517546 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ce87e381-4871-4df7-b857-7768537db85c None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.770974 Apr 06 16:38:51.518174 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 21/47] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:38:51.748243 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dc939bf1-feeb-4f98-803f-3673f9f5562e tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:51.748985 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dc939bf1-feeb-4f98-803f-3673f9f5562e tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:51.764767 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc939bf1-feeb-4f98-803f-3673f9f5562e tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:51.765230 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc939bf1-feeb-4f98-803f-3673f9f5562e tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:51.766020 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc939bf1-feeb-4f98-803f-3673f9f5562e tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:51.766453 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc939bf1-feeb-4f98-803f-3673f9f5562e tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:52.365942 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-dc939bf1-feeb-4f98-803f-3673f9f5562e tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:52.381657 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dc939bf1-feeb-4f98-803f-3673f9f5562e tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1314 microversion: 2.1 time: 0.632985 Apr 06 16:38:52.402660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 22/48] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:51 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1314 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:52.416584 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-538bfc91-ec8e-46bf-bab0-3438b668a18b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-649360792", "imageRef": "c217dd2b-7679-4860-b2e6-01a967f654df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58c32a0b-0da9-4f8e-b8ec-c234aabcb43d"}], "security_groups": [{"name": "tempest-securitygroup--1614488553"}], "key_name": "tempest-keypair-1869411350", "user_data": "}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:38:52.666316 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-dd610e87-d8e5-4366-bb9b-ad841f129dda tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 06 16:38:52.667394 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-dd610e87-d8e5-4366-bb9b-ad841f129dda tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 06 16:38:52.668040 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-dd610e87-d8e5-4366-bb9b-ad841f129dda tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 06 16:38:52.668666 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-dd610e87-d8e5-4366-bb9b-ad841f129dda tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 06 16:38:52.669259 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-dd610e87-d8e5-4366-bb9b-ad841f129dda tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 06 16:38:52.693511 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd610e87-d8e5-4366-bb9b-ad841f129dda tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:52.694509 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd610e87-d8e5-4366-bb9b-ad841f129dda tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:52.698497 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd610e87-d8e5-4366-bb9b-ad841f129dda tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:52.700448 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd610e87-d8e5-4366-bb9b-ad841f129dda tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:52.753409 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-dd610e87-d8e5-4366-bb9b-ad841f129dda tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Getting quotas for project a7b211944dc94094801aa5dd3d20a401. Resources: {'instances', 'cores', 'ram'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 16:38:52.762948 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-dd610e87-d8e5-4366-bb9b-ad841f129dda tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Getting quotas for user 22d0f09ff8c240a485a775d3c95d626b and project a7b211944dc94094801aa5dd3d20a401. Resources: {'instances', 'cores', 'ram'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 16:38:52.785329 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dd610e87-d8e5-4366-bb9b-ad841f129dda tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 06 16:38:52.789598 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dd610e87-d8e5-4366-bb9b-ad841f129dda tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c217dd2b-7679-4860-b2e6-01a967f654df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 06 16:38:52.909016 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dd610e87-d8e5-4366-bb9b-ad841f129dda tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.521772 Apr 06 16:38:52.913035 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 27/49] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Apr 6 16:38:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 3526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 06 16:38:52.930836 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bbc0c40d-6a14-4df6-9af4-fa28d1480454 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:52.935786 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bbc0c40d-6a14-4df6-9af4-fa28d1480454 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:53.001118 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-538bfc91-ec8e-46bf-bab0-3438b668a18b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] validate_networks() for [('58c32a0b-0da9-4f8e-b8ec-c234aabcb43d', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 06 16:38:53.059789 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-bbc0c40d-6a14-4df6-9af4-fa28d1480454 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:53.073213 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bbc0c40d-6a14-4df6-9af4-fa28d1480454 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1241 microversion: 2.1 time: 0.153412 Apr 06 16:38:53.073716 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 28/50] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:52 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1241 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:53.394921 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ac82a7ed-aef6-4aeb-8875-f753398b145c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-199713371", "imageRef": "c217dd2b-7679-4860-b2e6-01a967f654df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ba7aff5-22d6-4ba8-b4f9-b36e4d32350f"}], "security_groups": [{"name": "tempest-securitygroup--1546661998"}], "key_name": "tempest-keypair-595131113", "user_data": "}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:38:53.603242 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-ac82a7ed-aef6-4aeb-8875-f753398b145c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] validate_networks() for [('2ba7aff5-22d6-4ba8-b4f9-b36e4d32350f', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 06 16:38:54.106830 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-538bfc91-ec8e-46bf-bab0-3438b668a18b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 06 16:38:54.107369 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-538bfc91-ec8e-46bf-bab0-3438b668a18b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 06 16:38:54.108222 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-538bfc91-ec8e-46bf-bab0-3438b668a18b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 06 16:38:54.108658 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-538bfc91-ec8e-46bf-bab0-3438b668a18b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 06 16:38:54.110212 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-538bfc91-ec8e-46bf-bab0-3438b668a18b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 06 16:38:54.135313 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-538bfc91-ec8e-46bf-bab0-3438b668a18b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:54.141872 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-538bfc91-ec8e-46bf-bab0-3438b668a18b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:54.145788 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-538bfc91-ec8e-46bf-bab0-3438b668a18b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:54.146448 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-538bfc91-ec8e-46bf-bab0-3438b668a18b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:54.191625 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-538bfc91-ec8e-46bf-bab0-3438b668a18b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Getting quotas for project 025f673d99964de4820b8ba487f95cad. Resources: {'instances', 'cores', 'ram'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 16:38:54.201051 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-538bfc91-ec8e-46bf-bab0-3438b668a18b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Getting quotas for user 20b497ce12aa400091fc7cbbc6a2d15b and project 025f673d99964de4820b8ba487f95cad. Resources: {'instances', 'cores', 'ram'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 16:38:54.243753 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-538bfc91-ec8e-46bf-bab0-3438b668a18b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 06 16:38:54.247402 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-538bfc91-ec8e-46bf-bab0-3438b668a18b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c217dd2b-7679-4860-b2e6-01a967f654df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 06 16:38:54.326379 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-538bfc91-ec8e-46bf-bab0-3438b668a18b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.920311 Apr 06 16:38:54.329397 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 23/51] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Apr 6 16:38:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 1926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 06 16:38:54.339098 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-ac82a7ed-aef6-4aeb-8875-f753398b145c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 06 16:38:54.339594 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-ac82a7ed-aef6-4aeb-8875-f753398b145c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 06 16:38:54.340071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-ac82a7ed-aef6-4aeb-8875-f753398b145c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 06 16:38:54.340891 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-ac82a7ed-aef6-4aeb-8875-f753398b145c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 06 16:38:54.341511 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-ac82a7ed-aef6-4aeb-8875-f753398b145c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 06 16:38:54.342176 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-db9fb2b1-9525-4092-92b7-def4171f7338 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:54.342782 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-db9fb2b1-9525-4092-92b7-def4171f7338 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:54.352839 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db9fb2b1-9525-4092-92b7-def4171f7338 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:54.353280 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db9fb2b1-9525-4092-92b7-def4171f7338 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:54.354058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db9fb2b1-9525-4092-92b7-def4171f7338 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:54.355350 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db9fb2b1-9525-4092-92b7-def4171f7338 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:54.387333 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac82a7ed-aef6-4aeb-8875-f753398b145c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:54.388071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac82a7ed-aef6-4aeb-8875-f753398b145c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:54.405867 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac82a7ed-aef6-4aeb-8875-f753398b145c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:54.406502 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ac82a7ed-aef6-4aeb-8875-f753398b145c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:54.479625 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-ac82a7ed-aef6-4aeb-8875-f753398b145c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Getting quotas for project d07f53a1a9c4463693fa2c0005504b58. Resources: {'instances', 'cores', 'ram'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 16:38:54.492246 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-ac82a7ed-aef6-4aeb-8875-f753398b145c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Getting quotas for user 2230d519a0bf4024ac9e8be3a4f5aeb2 and project d07f53a1a9c4463693fa2c0005504b58. Resources: {'instances', 'cores', 'ram'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 16:38:54.538071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ac82a7ed-aef6-4aeb-8875-f753398b145c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 06 16:38:54.555551 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ac82a7ed-aef6-4aeb-8875-f753398b145c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c217dd2b-7679-4860-b2e6-01a967f654df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 06 16:38:54.631475 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-db9fb2b1-9525-4092-92b7-def4171f7338 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:54.647060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-db9fb2b1-9525-4092-92b7-def4171f7338 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1314 microversion: 2.1 time: 0.312837 Apr 06 16:38:54.648173 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 24/52] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:54 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:54.660036 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-92b3c3b5-ce07-46dd-a0de-4bd7e4dafa5a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:54.660810 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-92b3c3b5-ce07-46dd-a0de-4bd7e4dafa5a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:54.668466 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ac82a7ed-aef6-4aeb-8875-f753398b145c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.279754 Apr 06 16:38:54.670004 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 29/53] 10.222.0.64 () {62 vars in 1187 bytes} [Wed Apr 6 16:38:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 1282 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Apr 06 16:38:54.670140 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92b3c3b5-ce07-46dd-a0de-4bd7e4dafa5a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:54.670733 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92b3c3b5-ce07-46dd-a0de-4bd7e4dafa5a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:54.671992 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92b3c3b5-ce07-46dd-a0de-4bd7e4dafa5a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:54.672565 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92b3c3b5-ce07-46dd-a0de-4bd7e4dafa5a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:54.679519 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6002bbd7-9794-4e14-9dc7-e3f84a875798 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:54.680591 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6002bbd7-9794-4e14-9dc7-e3f84a875798 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:54.762394 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6002bbd7-9794-4e14-9dc7-e3f84a875798 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:54.772841 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6002bbd7-9794-4e14-9dc7-e3f84a875798 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1237 microversion: 2.1 time: 0.099574 Apr 06 16:38:54.774775 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 30/54] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:54 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1237 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:54.782066 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1882aa57-c71c-4343-a21f-aa7bbe160db3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:54.782923 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1882aa57-c71c-4343-a21f-aa7bbe160db3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:54.808578 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-92b3c3b5-ce07-46dd-a0de-4bd7e4dafa5a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:54.828738 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-92b3c3b5-ce07-46dd-a0de-4bd7e4dafa5a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1237 microversion: 2.1 time: 0.175492 Apr 06 16:38:54.829364 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 25/55] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:54 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1237 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:54.887189 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1882aa57-c71c-4343-a21f-aa7bbe160db3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:54.896546 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1882aa57-c71c-4343-a21f-aa7bbe160db3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:54.898396 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1882aa57-c71c-4343-a21f-aa7bbe160db3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:54.899543 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1882aa57-c71c-4343-a21f-aa7bbe160db3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1280 microversion: 2.20 time: 0.122664 Apr 06 16:38:54.909170 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 31/56] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:38:54 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1280 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:38:55.665903 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a8aa53d9-f23a-4d0e-b967-ac02a0245425 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:55.666483 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a8aa53d9-f23a-4d0e-b967-ac02a0245425 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:55.682750 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8aa53d9-f23a-4d0e-b967-ac02a0245425 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:55.683340 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8aa53d9-f23a-4d0e-b967-ac02a0245425 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:55.684204 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8aa53d9-f23a-4d0e-b967-ac02a0245425 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:55.684810 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8aa53d9-f23a-4d0e-b967-ac02a0245425 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:55.806219 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a72d9506-b49c-42dc-a63c-f7d47c4e3115 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:55.806830 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a72d9506-b49c-42dc-a63c-f7d47c4e3115 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:55.813955 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a72d9506-b49c-42dc-a63c-f7d47c4e3115 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:55.814822 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a72d9506-b49c-42dc-a63c-f7d47c4e3115 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:55.815805 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a72d9506-b49c-42dc-a63c-f7d47c4e3115 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:55.816445 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a72d9506-b49c-42dc-a63c-f7d47c4e3115 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:55.905194 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a72d9506-b49c-42dc-a63c-f7d47c4e3115 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:55.914943 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a72d9506-b49c-42dc-a63c-f7d47c4e3115 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1289 microversion: 2.1 time: 0.112859 Apr 06 16:38:55.915983 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 32/57] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:55 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1289 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:55.921100 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-33715c7f-d735-4a93-b660-1d7eb9db1c02 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:55.921989 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-33715c7f-d735-4a93-b660-1d7eb9db1c02 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:55.929314 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33715c7f-d735-4a93-b660-1d7eb9db1c02 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:55.930219 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33715c7f-d735-4a93-b660-1d7eb9db1c02 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:55.931190 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33715c7f-d735-4a93-b660-1d7eb9db1c02 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:55.931663 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33715c7f-d735-4a93-b660-1d7eb9db1c02 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:56.001957 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a8aa53d9-f23a-4d0e-b967-ac02a0245425 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:56.015304 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-33715c7f-d735-4a93-b660-1d7eb9db1c02 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:56.025848 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-33715c7f-d735-4a93-b660-1d7eb9db1c02 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1299 microversion: 2.1 time: 0.108507 Apr 06 16:38:56.027536 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 33/58] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:55 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:56.032202 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a8aa53d9-f23a-4d0e-b967-ac02a0245425 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1314 microversion: 2.1 time: 0.370735 Apr 06 16:38:56.032971 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 26/59] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:55 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:56.047921 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-53044d89-70a2-4e3c-aba8-80775a3e9f82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:56.049957 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-53044d89-70a2-4e3c-aba8-80775a3e9f82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:56.057676 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53044d89-70a2-4e3c-aba8-80775a3e9f82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:56.058313 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53044d89-70a2-4e3c-aba8-80775a3e9f82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:56.059691 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53044d89-70a2-4e3c-aba8-80775a3e9f82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:56.060733 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53044d89-70a2-4e3c-aba8-80775a3e9f82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:56.290533 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-53044d89-70a2-4e3c-aba8-80775a3e9f82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:56.299492 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-53044d89-70a2-4e3c-aba8-80775a3e9f82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:56.301081 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-53044d89-70a2-4e3c-aba8-80775a3e9f82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:56.302551 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-53044d89-70a2-4e3c-aba8-80775a3e9f82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1276 microversion: 2.20 time: 0.273589 Apr 06 16:38:56.303710 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 34/60] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:38:56 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1276 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:38:56.935389 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-546e30f2-17f0-4ea5-8bc1-849037623bb2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:56.936117 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-546e30f2-17f0-4ea5-8bc1-849037623bb2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:56.942186 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-546e30f2-17f0-4ea5-8bc1-849037623bb2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:56.942807 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-546e30f2-17f0-4ea5-8bc1-849037623bb2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:56.943737 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-546e30f2-17f0-4ea5-8bc1-849037623bb2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:56.944273 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-546e30f2-17f0-4ea5-8bc1-849037623bb2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:57.023666 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-546e30f2-17f0-4ea5-8bc1-849037623bb2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:57.031647 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-546e30f2-17f0-4ea5-8bc1-849037623bb2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1289 microversion: 2.1 time: 0.100037 Apr 06 16:38:57.032395 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 27/61] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:56 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1289 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:57.043694 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6496be1e-7317-40cd-8a41-e77616fc4fff tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:57.044272 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6496be1e-7317-40cd-8a41-e77616fc4fff tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:57.050902 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6496be1e-7317-40cd-8a41-e77616fc4fff tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:57.051347 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6496be1e-7317-40cd-8a41-e77616fc4fff tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:57.052337 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6496be1e-7317-40cd-8a41-e77616fc4fff tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:57.053174 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6496be1e-7317-40cd-8a41-e77616fc4fff tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:57.055685 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-63d3c5a7-a88b-43e3-8d76-2aeffe763556 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:57.056645 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-63d3c5a7-a88b-43e3-8d76-2aeffe763556 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:57.063632 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63d3c5a7-a88b-43e3-8d76-2aeffe763556 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:57.064243 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63d3c5a7-a88b-43e3-8d76-2aeffe763556 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:57.065086 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63d3c5a7-a88b-43e3-8d76-2aeffe763556 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:57.065587 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63d3c5a7-a88b-43e3-8d76-2aeffe763556 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:57.134896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6496be1e-7317-40cd-8a41-e77616fc4fff tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:57.144052 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6496be1e-7317-40cd-8a41-e77616fc4fff tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1299 microversion: 2.1 time: 0.104010 Apr 06 16:38:57.147559 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 35/62] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:57 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:57.248022 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-63d3c5a7-a88b-43e3-8d76-2aeffe763556 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:57.257419 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-63d3c5a7-a88b-43e3-8d76-2aeffe763556 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1314 microversion: 2.1 time: 0.206559 Apr 06 16:38:57.267213 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 28/63] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:57 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:57.328576 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8b10072f-12ca-4345-a227-a01ef7d34c8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:57.333804 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8b10072f-12ca-4345-a227-a01ef7d34c8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:57.344308 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b10072f-12ca-4345-a227-a01ef7d34c8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:57.344975 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b10072f-12ca-4345-a227-a01ef7d34c8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:57.346037 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b10072f-12ca-4345-a227-a01ef7d34c8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:57.346470 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b10072f-12ca-4345-a227-a01ef7d34c8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:57.420151 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8b10072f-12ca-4345-a227-a01ef7d34c8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:57.430020 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8b10072f-12ca-4345-a227-a01ef7d34c8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:57.431793 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8b10072f-12ca-4345-a227-a01ef7d34c8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:57.435235 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8b10072f-12ca-4345-a227-a01ef7d34c8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1276 microversion: 2.20 time: 0.109415 Apr 06 16:38:57.435888 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 36/64] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:38:57 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1276 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:38:58.049209 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-022eba48-7fcf-40e9-9dcc-be82c5a8a9df tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:58.049821 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-022eba48-7fcf-40e9-9dcc-be82c5a8a9df tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:58.056854 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-022eba48-7fcf-40e9-9dcc-be82c5a8a9df tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:58.057471 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-022eba48-7fcf-40e9-9dcc-be82c5a8a9df tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:58.058272 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-022eba48-7fcf-40e9-9dcc-be82c5a8a9df tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:58.058708 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-022eba48-7fcf-40e9-9dcc-be82c5a8a9df tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:58.148340 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-022eba48-7fcf-40e9-9dcc-be82c5a8a9df tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:58.162467 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f21d5d61-6233-46e1-bb37-ec25e1dcd2b1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:58.165148 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f21d5d61-6233-46e1-bb37-ec25e1dcd2b1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:58.171409 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-022eba48-7fcf-40e9-9dcc-be82c5a8a9df tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1289 microversion: 2.1 time: 0.125891 Apr 06 16:38:58.172387 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 29/65] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:58 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1289 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:58.178641 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f21d5d61-6233-46e1-bb37-ec25e1dcd2b1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:58.179676 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f21d5d61-6233-46e1-bb37-ec25e1dcd2b1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:58.180755 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f21d5d61-6233-46e1-bb37-ec25e1dcd2b1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:58.181376 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f21d5d61-6233-46e1-bb37-ec25e1dcd2b1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:58.261418 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f21d5d61-6233-46e1-bb37-ec25e1dcd2b1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:58.271122 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f21d5d61-6233-46e1-bb37-ec25e1dcd2b1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1299 microversion: 2.1 time: 0.112547 Apr 06 16:38:58.271981 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 37/66] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:58 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:38:58.278327 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-aea9ea5f-eeb0-452a-9177-4f05dd7ace31 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:58.279480 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-aea9ea5f-eeb0-452a-9177-4f05dd7ace31 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:58.287086 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aea9ea5f-eeb0-452a-9177-4f05dd7ace31 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:58.288194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aea9ea5f-eeb0-452a-9177-4f05dd7ace31 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:58.289447 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aea9ea5f-eeb0-452a-9177-4f05dd7ace31 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:58.290129 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aea9ea5f-eeb0-452a-9177-4f05dd7ace31 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:58.455962 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d34fc5da-d3d0-45fa-a2a1-646c6e9a6836 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:58.456938 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d34fc5da-d3d0-45fa-a2a1-646c6e9a6836 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:58.474091 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d34fc5da-d3d0-45fa-a2a1-646c6e9a6836 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:58.476306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d34fc5da-d3d0-45fa-a2a1-646c6e9a6836 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:58.482903 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d34fc5da-d3d0-45fa-a2a1-646c6e9a6836 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:58.486618 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d34fc5da-d3d0-45fa-a2a1-646c6e9a6836 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:58.543801 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-aea9ea5f-eeb0-452a-9177-4f05dd7ace31 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:58.552608 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-aea9ea5f-eeb0-452a-9177-4f05dd7ace31 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1314 microversion: 2.1 time: 0.278240 Apr 06 16:38:58.554982 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 30/67] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:58 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:58.609775 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d34fc5da-d3d0-45fa-a2a1-646c6e9a6836 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:58.620107 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d34fc5da-d3d0-45fa-a2a1-646c6e9a6836 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:58.621976 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d34fc5da-d3d0-45fa-a2a1-646c6e9a6836 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:58.623960 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d34fc5da-d3d0-45fa-a2a1-646c6e9a6836 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1332 microversion: 2.20 time: 0.173487 Apr 06 16:38:58.625236 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 38/68] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:38:58 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1332 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:38:59.199775 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-702fb39a-35e3-4514-8a61-6c29d4f4b571 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:59.204495 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-702fb39a-35e3-4514-8a61-6c29d4f4b571 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:59.215245 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-702fb39a-35e3-4514-8a61-6c29d4f4b571 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:59.215698 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-702fb39a-35e3-4514-8a61-6c29d4f4b571 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:59.216492 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-702fb39a-35e3-4514-8a61-6c29d4f4b571 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:59.219484 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-702fb39a-35e3-4514-8a61-6c29d4f4b571 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:59.291066 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-62e5ef86-bd15-4ab6-8d81-6b49bfad6d9c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:59.291757 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-62e5ef86-bd15-4ab6-8d81-6b49bfad6d9c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:59.306684 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62e5ef86-bd15-4ab6-8d81-6b49bfad6d9c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:59.307322 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62e5ef86-bd15-4ab6-8d81-6b49bfad6d9c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:59.310153 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62e5ef86-bd15-4ab6-8d81-6b49bfad6d9c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:59.310686 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62e5ef86-bd15-4ab6-8d81-6b49bfad6d9c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:59.316413 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-702fb39a-35e3-4514-8a61-6c29d4f4b571 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:59.329417 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-702fb39a-35e3-4514-8a61-6c29d4f4b571 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1297 microversion: 2.1 time: 0.142478 Apr 06 16:38:59.338744 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 31/69] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:59 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1297 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:59.511300 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-62e5ef86-bd15-4ab6-8d81-6b49bfad6d9c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:59.520102 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-62e5ef86-bd15-4ab6-8d81-6b49bfad6d9c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1366 microversion: 2.1 time: 0.235241 Apr 06 16:38:59.521638 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 39/70] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:59 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:38:59.574087 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6b65a2b5-e949-4e99-a8f4-4e510947fe26 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:59.574718 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6b65a2b5-e949-4e99-a8f4-4e510947fe26 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:59.582418 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b65a2b5-e949-4e99-a8f4-4e510947fe26 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:59.583499 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b65a2b5-e949-4e99-a8f4-4e510947fe26 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:59.584498 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b65a2b5-e949-4e99-a8f4-4e510947fe26 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:59.584938 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b65a2b5-e949-4e99-a8f4-4e510947fe26 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:59.653441 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fec9ddf9-88f8-4477-9f3c-220fc1319b78 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:38:59.654295 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fec9ddf9-88f8-4477-9f3c-220fc1319b78 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:38:59.661156 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fec9ddf9-88f8-4477-9f3c-220fc1319b78 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:59.661910 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fec9ddf9-88f8-4477-9f3c-220fc1319b78 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:59.662662 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fec9ddf9-88f8-4477-9f3c-220fc1319b78 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:38:59.663246 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fec9ddf9-88f8-4477-9f3c-220fc1319b78 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:38:59.735467 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fec9ddf9-88f8-4477-9f3c-220fc1319b78 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:59.747321 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fec9ddf9-88f8-4477-9f3c-220fc1319b78 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:59.749071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fec9ddf9-88f8-4477-9f3c-220fc1319b78 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:59.750257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fec9ddf9-88f8-4477-9f3c-220fc1319b78 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1332 microversion: 2.20 time: 0.101748 Apr 06 16:38:59.750835 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 40/71] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:38:59 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:38:59.762491 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6b65a2b5-e949-4e99-a8f4-4e510947fe26 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:38:59.773779 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6b65a2b5-e949-4e99-a8f4-4e510947fe26 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1314 microversion: 2.1 time: 0.204272 Apr 06 16:38:59.774476 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 32/72] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:38:59 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:00.350785 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-90a95edd-db4f-4f97-90f5-75c5dc17e5bb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:00.351442 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-90a95edd-db4f-4f97-90f5-75c5dc17e5bb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:00.358206 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90a95edd-db4f-4f97-90f5-75c5dc17e5bb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:00.358763 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90a95edd-db4f-4f97-90f5-75c5dc17e5bb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:00.359624 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90a95edd-db4f-4f97-90f5-75c5dc17e5bb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:00.360196 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90a95edd-db4f-4f97-90f5-75c5dc17e5bb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:00.460439 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-90a95edd-db4f-4f97-90f5-75c5dc17e5bb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:00.474166 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-90a95edd-db4f-4f97-90f5-75c5dc17e5bb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1297 microversion: 2.1 time: 0.127929 Apr 06 16:39:00.476090 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 41/73] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:00 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1297 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:00.540644 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e9488a2f-43e2-4da7-826d-08df7314511e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:00.541673 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e9488a2f-43e2-4da7-826d-08df7314511e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:00.549278 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9488a2f-43e2-4da7-826d-08df7314511e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:00.549829 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9488a2f-43e2-4da7-826d-08df7314511e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:00.550745 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9488a2f-43e2-4da7-826d-08df7314511e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:00.551219 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9488a2f-43e2-4da7-826d-08df7314511e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:00.740807 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e9488a2f-43e2-4da7-826d-08df7314511e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:00.749187 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e9488a2f-43e2-4da7-826d-08df7314511e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1366 microversion: 2.1 time: 0.213947 Apr 06 16:39:00.749898 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 33/74] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:00 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:00.777752 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-45c241b8-b877-4872-b425-d3c6ef690559 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:00.778363 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-45c241b8-b877-4872-b425-d3c6ef690559 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:00.785061 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45c241b8-b877-4872-b425-d3c6ef690559 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:00.785473 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45c241b8-b877-4872-b425-d3c6ef690559 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:00.786296 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45c241b8-b877-4872-b425-d3c6ef690559 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:00.786869 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45c241b8-b877-4872-b425-d3c6ef690559 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:00.792673 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fab8ede2-c50e-4f92-884c-f388670edeab tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:00.793345 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fab8ede2-c50e-4f92-884c-f388670edeab tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:00.799319 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fab8ede2-c50e-4f92-884c-f388670edeab tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:00.799766 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fab8ede2-c50e-4f92-884c-f388670edeab tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:00.800550 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fab8ede2-c50e-4f92-884c-f388670edeab tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:00.801013 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fab8ede2-c50e-4f92-884c-f388670edeab tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:00.853199 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-45c241b8-b877-4872-b425-d3c6ef690559 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:00.861682 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-45c241b8-b877-4872-b425-d3c6ef690559 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:00.863345 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-45c241b8-b877-4872-b425-d3c6ef690559 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:00.864572 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-45c241b8-b877-4872-b425-d3c6ef690559 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1332 microversion: 2.20 time: 0.092421 Apr 06 16:39:00.865580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 42/75] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:39:00 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1332 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:39:00.942072 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fab8ede2-c50e-4f92-884c-f388670edeab tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:00.950182 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fab8ede2-c50e-4f92-884c-f388670edeab tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1314 microversion: 2.1 time: 0.161461 Apr 06 16:39:00.950743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 34/76] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:00 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:01.498386 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9d5a2acc-5e48-434f-bdf5-0088286cc4d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:01.499240 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9d5a2acc-5e48-434f-bdf5-0088286cc4d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:01.508082 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d5a2acc-5e48-434f-bdf5-0088286cc4d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:01.508645 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d5a2acc-5e48-434f-bdf5-0088286cc4d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:01.509570 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d5a2acc-5e48-434f-bdf5-0088286cc4d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:01.510247 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d5a2acc-5e48-434f-bdf5-0088286cc4d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:01.619699 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9d5a2acc-5e48-434f-bdf5-0088286cc4d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:01.637212 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9d5a2acc-5e48-434f-bdf5-0088286cc4d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1295 microversion: 2.1 time: 0.143137 Apr 06 16:39:01.638518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 43/77] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:01 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1295 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:01.768831 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2b40c1e9-ffac-4cfc-ab57-6e92a3ace097 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:01.769452 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2b40c1e9-ffac-4cfc-ab57-6e92a3ace097 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:01.784020 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b40c1e9-ffac-4cfc-ab57-6e92a3ace097 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:01.784744 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b40c1e9-ffac-4cfc-ab57-6e92a3ace097 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:01.786073 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b40c1e9-ffac-4cfc-ab57-6e92a3ace097 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:01.787051 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b40c1e9-ffac-4cfc-ab57-6e92a3ace097 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:01.883423 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e49110b1-9e13-4e3f-81a3-fc966c892214 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:01.884028 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e49110b1-9e13-4e3f-81a3-fc966c892214 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:01.893316 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e49110b1-9e13-4e3f-81a3-fc966c892214 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:01.893754 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e49110b1-9e13-4e3f-81a3-fc966c892214 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:01.894535 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e49110b1-9e13-4e3f-81a3-fc966c892214 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:01.897222 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e49110b1-9e13-4e3f-81a3-fc966c892214 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:02.042998 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e49110b1-9e13-4e3f-81a3-fc966c892214 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:02.055489 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e49110b1-9e13-4e3f-81a3-fc966c892214 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:02.057671 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e49110b1-9e13-4e3f-81a3-fc966c892214 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:02.059517 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e49110b1-9e13-4e3f-81a3-fc966c892214 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1338 microversion: 2.20 time: 0.179602 Apr 06 16:39:02.066994 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 44/78] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:39:01 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1338 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:39:02.076408 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8bce5037-982e-48ce-a591-3e0e63e0e16f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:02.077149 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8bce5037-982e-48ce-a591-3e0e63e0e16f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:02.095306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8bce5037-982e-48ce-a591-3e0e63e0e16f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:02.095657 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8bce5037-982e-48ce-a591-3e0e63e0e16f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:02.096676 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8bce5037-982e-48ce-a591-3e0e63e0e16f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:02.097616 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8bce5037-982e-48ce-a591-3e0e63e0e16f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:02.209021 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2b40c1e9-ffac-4cfc-ab57-6e92a3ace097 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:02.234368 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2b40c1e9-ffac-4cfc-ab57-6e92a3ace097 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1366 microversion: 2.1 time: 0.470977 Apr 06 16:39:02.247458 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 35/79] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:01 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1366 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:39:02.659183 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4fc7a2d0-6038-4a33-9e66-50f91148e476 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:02.661954 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4fc7a2d0-6038-4a33-9e66-50f91148e476 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:02.680190 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fc7a2d0-6038-4a33-9e66-50f91148e476 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:02.682012 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fc7a2d0-6038-4a33-9e66-50f91148e476 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:02.683314 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fc7a2d0-6038-4a33-9e66-50f91148e476 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:02.684201 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fc7a2d0-6038-4a33-9e66-50f91148e476 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:02.694444 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8bce5037-982e-48ce-a591-3e0e63e0e16f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:02.709440 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8bce5037-982e-48ce-a591-3e0e63e0e16f tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1314 microversion: 2.1 time: 0.638222 Apr 06 16:39:02.711502 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 45/80] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:02 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:02.830236 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4fc7a2d0-6038-4a33-9e66-50f91148e476 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:02.842377 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4fc7a2d0-6038-4a33-9e66-50f91148e476 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1295 microversion: 2.1 time: 0.190625 Apr 06 16:39:02.848969 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 36/81] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:02 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1295 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:02.926915 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-9cfcb660-3f6e-4f41-993c-d3661bf48064 req-7f4aac41-98b0-45f8-a9b7-1dc0f2e02de7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b9f9e64-72fd-4e62-bde6-4e44f737c02c", "tag": "3d9b80f5-284c-42ae-8f89-8ab97694fca5"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:39:02.997176 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9cfcb660-3f6e-4f41-993c-d3661bf48064 req-7f4aac41-98b0-45f8-a9b7-1dc0f2e02de7 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:02.997961 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9cfcb660-3f6e-4f41-993c-d3661bf48064 req-7f4aac41-98b0-45f8-a9b7-1dc0f2e02de7 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:03.054533 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-9cfcb660-3f6e-4f41-993c-d3661bf48064 req-7f4aac41-98b0-45f8-a9b7-1dc0f2e02de7 service nova] Creating event network-changed:3d9b80f5-284c-42ae-8f89-8ab97694fca5 for instance 6b9f9e64-72fd-4e62-bde6-4e44f737c02c on hv-cinder-83684 Apr 06 16:39:03.058211 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9cfcb660-3f6e-4f41-993c-d3661bf48064 req-7f4aac41-98b0-45f8-a9b7-1dc0f2e02de7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 06 16:39:03.061014 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d8deac8-a8e8-4cc9-8cfd-1f79109b4b6f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:03.064942 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d8deac8-a8e8-4cc9-8cfd-1f79109b4b6f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:03.066540 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d8deac8-a8e8-4cc9-8cfd-1f79109b4b6f None None] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:03.067594 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d8deac8-a8e8-4cc9-8cfd-1f79109b4b6f None None] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:03.079760 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-53f16cd6-c64d-47b7-b07d-4079342572ab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:03.080023 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-53f16cd6-c64d-47b7-b07d-4079342572ab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:03.094374 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.compute.rpcapi [None req-2d8deac8-a8e8-4cc9-8cfd-1f79109b4b6f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 06 16:39:03.097073 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53f16cd6-c64d-47b7-b07d-4079342572ab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:03.097584 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53f16cd6-c64d-47b7-b07d-4079342572ab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:03.100239 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d8deac8-a8e8-4cc9-8cfd-1f79109b4b6f None None] Releasing lock "compute-rpcapi-router" {{(pid=128861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 06 16:39:03.104235 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53f16cd6-c64d-47b7-b07d-4079342572ab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:03.104742 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53f16cd6-c64d-47b7-b07d-4079342572ab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:03.135373 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2d8deac8-a8e8-4cc9-8cfd-1f79109b4b6f None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.220576 Apr 06 16:39:03.136727 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 46/82] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:39:03.279431 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b3788990-c0ed-4905-9eed-a02ec0a50a9f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:03.282461 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b3788990-c0ed-4905-9eed-a02ec0a50a9f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:03.300501 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3788990-c0ed-4905-9eed-a02ec0a50a9f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:03.301746 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3788990-c0ed-4905-9eed-a02ec0a50a9f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:03.303767 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3788990-c0ed-4905-9eed-a02ec0a50a9f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:03.304983 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3788990-c0ed-4905-9eed-a02ec0a50a9f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:03.327483 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-53f16cd6-c64d-47b7-b07d-4079342572ab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:03.352652 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-53f16cd6-c64d-47b7-b07d-4079342572ab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:03.355552 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-53f16cd6-c64d-47b7-b07d-4079342572ab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:03.360069 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-53f16cd6-c64d-47b7-b07d-4079342572ab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1338 microversion: 2.20 time: 0.283819 Apr 06 16:39:03.361603 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 37/83] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:39:03 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1338 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:39:03.730039 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1eed2781-f070-44d7-8da8-1a4f12bb7701 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:03.730935 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1eed2781-f070-44d7-8da8-1a4f12bb7701 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:03.744623 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1eed2781-f070-44d7-8da8-1a4f12bb7701 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:03.748883 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1eed2781-f070-44d7-8da8-1a4f12bb7701 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:03.755454 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1eed2781-f070-44d7-8da8-1a4f12bb7701 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:03.759116 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1eed2781-f070-44d7-8da8-1a4f12bb7701 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:04.139153 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b3788990-c0ed-4905-9eed-a02ec0a50a9f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:04.163458 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b3788990-c0ed-4905-9eed-a02ec0a50a9f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1366 microversion: 2.1 time: 0.908857 Apr 06 16:39:04.165662 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 47/84] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:03 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1366 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:39:04.208466 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0e83a34f-6e88-4a00-b4a2-381ebbfc0316 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:04.213999 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0e83a34f-6e88-4a00-b4a2-381ebbfc0316 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:04.241980 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e83a34f-6e88-4a00-b4a2-381ebbfc0316 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:04.244607 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e83a34f-6e88-4a00-b4a2-381ebbfc0316 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:04.247219 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e83a34f-6e88-4a00-b4a2-381ebbfc0316 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:04.252266 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e83a34f-6e88-4a00-b4a2-381ebbfc0316 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:04.557414 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1eed2781-f070-44d7-8da8-1a4f12bb7701 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:04.569679 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1eed2781-f070-44d7-8da8-1a4f12bb7701 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1314 microversion: 2.1 time: 0.845529 Apr 06 16:39:04.579482 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 38/85] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:03 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1314 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:39:04.653428 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0e83a34f-6e88-4a00-b4a2-381ebbfc0316 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:04.666745 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0e83a34f-6e88-4a00-b4a2-381ebbfc0316 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1363 microversion: 2.1 time: 0.497850 Apr 06 16:39:04.670389 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 48/86] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:04 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1363 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:04.698145 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e2d1b5a7-eca0-4c1c-9971-570a7a724a44 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:04.698896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e2d1b5a7-eca0-4c1c-9971-570a7a724a44 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:04.709062 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2d1b5a7-eca0-4c1c-9971-570a7a724a44 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:04.710143 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2d1b5a7-eca0-4c1c-9971-570a7a724a44 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:04.711940 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2d1b5a7-eca0-4c1c-9971-570a7a724a44 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:04.712837 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2d1b5a7-eca0-4c1c-9971-570a7a724a44 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:04.946904 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-8abaadd4-7136-48b1-8ef3-755ec70fe20b req-53eb0d18-3d47-42c6-acc1-41ee83a61a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac", "name": "network-vif-plugged", "status": "completed", "tag": "f126b299-b78b-4cea-9949-84de47cdca08"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:39:04.955885 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8abaadd4-7136-48b1-8ef3-755ec70fe20b req-53eb0d18-3d47-42c6-acc1-41ee83a61a61 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:04.956448 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8abaadd4-7136-48b1-8ef3-755ec70fe20b req-53eb0d18-3d47-42c6-acc1-41ee83a61a61 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:04.969292 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-8abaadd4-7136-48b1-8ef3-755ec70fe20b req-53eb0d18-3d47-42c6-acc1-41ee83a61a61 service nova] Creating event network-vif-plugged:f126b299-b78b-4cea-9949-84de47cdca08 for instance 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac on hv-cinder-83684 Apr 06 16:39:04.976049 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-8abaadd4-7136-48b1-8ef3-755ec70fe20b req-53eb0d18-3d47-42c6-acc1-41ee83a61a61 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.394843 Apr 06 16:39:04.979760 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 39/87] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:39:05.182643 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c687df33-891d-47eb-b33d-7c2ac1498f52 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:05.183736 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c687df33-891d-47eb-b33d-7c2ac1498f52 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:05.190647 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c687df33-891d-47eb-b33d-7c2ac1498f52 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:05.191402 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c687df33-891d-47eb-b33d-7c2ac1498f52 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:05.192559 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c687df33-891d-47eb-b33d-7c2ac1498f52 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:05.193599 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c687df33-891d-47eb-b33d-7c2ac1498f52 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:05.251404 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e2d1b5a7-eca0-4c1c-9971-570a7a724a44 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:05.265336 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e2d1b5a7-eca0-4c1c-9971-570a7a724a44 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:05.267269 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e2d1b5a7-eca0-4c1c-9971-570a7a724a44 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:05.268742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e2d1b5a7-eca0-4c1c-9971-570a7a724a44 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1406 microversion: 2.20 time: 0.579931 Apr 06 16:39:05.269528 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 49/88] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:39:04 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1406 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:39:05.498334 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-f6aa502b-a4dd-4e30-bfc0-704896d14120 req-cf3f7e89-1f81-4e66-9ffe-93870c8a4fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bab853ba-a3d5-4828-baf6-1088f936bc96", "tag": "85e18e37-1e89-48a0-8d94-cf2d33254117"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:39:05.536382 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f6aa502b-a4dd-4e30-bfc0-704896d14120 req-cf3f7e89-1f81-4e66-9ffe-93870c8a4fb1 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:05.537211 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f6aa502b-a4dd-4e30-bfc0-704896d14120 req-cf3f7e89-1f81-4e66-9ffe-93870c8a4fb1 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:05.573362 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-f6aa502b-a4dd-4e30-bfc0-704896d14120 req-cf3f7e89-1f81-4e66-9ffe-93870c8a4fb1 service nova] Creating event network-changed:85e18e37-1e89-48a0-8d94-cf2d33254117 for instance bab853ba-a3d5-4828-baf6-1088f936bc96 on hv-cinder-83684 Apr 06 16:39:05.581458 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-f6aa502b-a4dd-4e30-bfc0-704896d14120 req-cf3f7e89-1f81-4e66-9ffe-93870c8a4fb1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113297 Apr 06 16:39:05.582597 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 50/89] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:39:05.595406 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-389e9464-d4f7-48f1-aeab-e47e045b72bc tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:05.596422 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-389e9464-d4f7-48f1-aeab-e47e045b72bc tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:05.604756 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-389e9464-d4f7-48f1-aeab-e47e045b72bc tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:05.605672 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-389e9464-d4f7-48f1-aeab-e47e045b72bc tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:05.606639 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-389e9464-d4f7-48f1-aeab-e47e045b72bc tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:05.607543 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-389e9464-d4f7-48f1-aeab-e47e045b72bc tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:06.188589 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c687df33-891d-47eb-b33d-7c2ac1498f52 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:06.200539 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c687df33-891d-47eb-b33d-7c2ac1498f52 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1366 microversion: 2.1 time: 1.022382 Apr 06 16:39:06.212228 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 40/90] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:05 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1366 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:06.244340 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0e3ffd25-4b87-4b97-ac6f-4676cc6b5d91 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:06.248255 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0e3ffd25-4b87-4b97-ac6f-4676cc6b5d91 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:06.270049 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e3ffd25-4b87-4b97-ac6f-4676cc6b5d91 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:06.271010 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e3ffd25-4b87-4b97-ac6f-4676cc6b5d91 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:06.272504 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e3ffd25-4b87-4b97-ac6f-4676cc6b5d91 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:06.274018 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e3ffd25-4b87-4b97-ac6f-4676cc6b5d91 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:06.305064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-389e9464-d4f7-48f1-aeab-e47e045b72bc tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:06.329621 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-389e9464-d4f7-48f1-aeab-e47e045b72bc tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1314 microversion: 2.1 time: 0.744653 Apr 06 16:39:06.330791 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 51/91] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:05 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1314 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:06.339246 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-127f1a8a-0c1a-43d0-938b-c85b3c5d9094 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:06.347241 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-127f1a8a-0c1a-43d0-938b-c85b3c5d9094 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:06.367791 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-127f1a8a-0c1a-43d0-938b-c85b3c5d9094 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:06.369435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-127f1a8a-0c1a-43d0-938b-c85b3c5d9094 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:06.372261 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-127f1a8a-0c1a-43d0-938b-c85b3c5d9094 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:06.372961 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-127f1a8a-0c1a-43d0-938b-c85b3c5d9094 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:06.865972 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0e3ffd25-4b87-4b97-ac6f-4676cc6b5d91 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:06.893240 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0e3ffd25-4b87-4b97-ac6f-4676cc6b5d91 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1363 microversion: 2.1 time: 0.676136 Apr 06 16:39:06.900625 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 41/92] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:06 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1363 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:07.140983 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-127f1a8a-0c1a-43d0-938b-c85b3c5d9094 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:07.150810 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-127f1a8a-0c1a-43d0-938b-c85b3c5d9094 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:07.154849 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-127f1a8a-0c1a-43d0-938b-c85b3c5d9094 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:07.157918 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-127f1a8a-0c1a-43d0-938b-c85b3c5d9094 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1406 microversion: 2.20 time: 0.825687 Apr 06 16:39:07.162764 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 52/93] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:39:06 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1406 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:39:07.220219 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1884838b-4edb-4237-9ac3-bad12e01c436 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:07.221637 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1884838b-4edb-4237-9ac3-bad12e01c436 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:07.232626 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1884838b-4edb-4237-9ac3-bad12e01c436 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:07.233099 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1884838b-4edb-4237-9ac3-bad12e01c436 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:07.236937 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1884838b-4edb-4237-9ac3-bad12e01c436 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:07.237380 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1884838b-4edb-4237-9ac3-bad12e01c436 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:07.351853 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f273eac7-e2f1-4b57-ad6c-584212a6c612 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:07.352464 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f273eac7-e2f1-4b57-ad6c-584212a6c612 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:07.383405 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f273eac7-e2f1-4b57-ad6c-584212a6c612 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:07.383405 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f273eac7-e2f1-4b57-ad6c-584212a6c612 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:07.383405 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f273eac7-e2f1-4b57-ad6c-584212a6c612 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:07.383405 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f273eac7-e2f1-4b57-ad6c-584212a6c612 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:07.672338 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1884838b-4edb-4237-9ac3-bad12e01c436 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:07.689762 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1884838b-4edb-4237-9ac3-bad12e01c436 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1366 microversion: 2.1 time: 0.473890 Apr 06 16:39:07.691125 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 42/94] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:07 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1366 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:07.789352 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-b60b3630-cd9a-43d6-aec9-45d89b34a668 req-e92bcbd0-d379-40a8-a3aa-403c17cd4e42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "330d17b1-0d7d-4519-8dc3-3210eb25aa3c", "tag": "e267cfb2-7045-4a09-851f-05d45654d0a1"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:39:07.807305 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b60b3630-cd9a-43d6-aec9-45d89b34a668 req-e92bcbd0-d379-40a8-a3aa-403c17cd4e42 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:07.807754 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b60b3630-cd9a-43d6-aec9-45d89b34a668 req-e92bcbd0-d379-40a8-a3aa-403c17cd4e42 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:07.828746 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-b60b3630-cd9a-43d6-aec9-45d89b34a668 req-e92bcbd0-d379-40a8-a3aa-403c17cd4e42 service nova] Creating event network-changed:e267cfb2-7045-4a09-851f-05d45654d0a1 for instance 330d17b1-0d7d-4519-8dc3-3210eb25aa3c on hv-cinder-83684 Apr 06 16:39:07.849289 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-b60b3630-cd9a-43d6-aec9-45d89b34a668 req-e92bcbd0-d379-40a8-a3aa-403c17cd4e42 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153774 Apr 06 16:39:07.853849 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 43/95] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:39:07.919911 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ff3e900d-d496-4b2a-a4cc-52942b16379d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:07.920622 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ff3e900d-d496-4b2a-a4cc-52942b16379d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:07.932632 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff3e900d-d496-4b2a-a4cc-52942b16379d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:07.933110 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff3e900d-d496-4b2a-a4cc-52942b16379d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:07.934007 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff3e900d-d496-4b2a-a4cc-52942b16379d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:07.934440 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff3e900d-d496-4b2a-a4cc-52942b16379d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:07.970867 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f273eac7-e2f1-4b57-ad6c-584212a6c612 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:07.982579 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f273eac7-e2f1-4b57-ad6c-584212a6c612 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1314 microversion: 2.1 time: 0.638931 Apr 06 16:39:07.990018 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 53/96] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:07 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1314 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:39:08.191058 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a41cccf0-6d75-48f4-98c7-07b7cfd12499 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:08.192982 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a41cccf0-6d75-48f4-98c7-07b7cfd12499 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:08.204749 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a41cccf0-6d75-48f4-98c7-07b7cfd12499 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:08.216214 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a41cccf0-6d75-48f4-98c7-07b7cfd12499 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:08.217113 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a41cccf0-6d75-48f4-98c7-07b7cfd12499 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:08.217553 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a41cccf0-6d75-48f4-98c7-07b7cfd12499 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:08.345079 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ff3e900d-d496-4b2a-a4cc-52942b16379d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:08.372551 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ff3e900d-d496-4b2a-a4cc-52942b16379d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1363 microversion: 2.1 time: 0.457026 Apr 06 16:39:08.378925 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 44/97] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:07 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1363 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:08.535501 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a41cccf0-6d75-48f4-98c7-07b7cfd12499 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:08.544885 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a41cccf0-6d75-48f4-98c7-07b7cfd12499 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:08.546368 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a41cccf0-6d75-48f4-98c7-07b7cfd12499 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:08.547677 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a41cccf0-6d75-48f4-98c7-07b7cfd12499 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1406 microversion: 2.20 time: 0.369869 Apr 06 16:39:08.548262 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 54/98] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:39:08 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1406 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:39:08.715593 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-55945a7e-8960-42aa-956e-f0036091a429 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:08.717152 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-55945a7e-8960-42aa-956e-f0036091a429 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:08.734858 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55945a7e-8960-42aa-956e-f0036091a429 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:08.735575 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55945a7e-8960-42aa-956e-f0036091a429 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:08.736835 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55945a7e-8960-42aa-956e-f0036091a429 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:08.737527 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55945a7e-8960-42aa-956e-f0036091a429 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:09.017097 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-278fbc9b-0d06-4629-93c1-afe959467e36 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:09.017648 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-278fbc9b-0d06-4629-93c1-afe959467e36 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:09.035505 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-278fbc9b-0d06-4629-93c1-afe959467e36 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:09.035951 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-278fbc9b-0d06-4629-93c1-afe959467e36 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:09.037430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-278fbc9b-0d06-4629-93c1-afe959467e36 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:09.037879 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-278fbc9b-0d06-4629-93c1-afe959467e36 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:09.136036 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-55945a7e-8960-42aa-956e-f0036091a429 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:09.144410 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-55945a7e-8960-42aa-956e-f0036091a429 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1366 microversion: 2.1 time: 0.435758 Apr 06 16:39:09.145542 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 45/99] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:08 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1366 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:09.321544 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-278fbc9b-0d06-4629-93c1-afe959467e36 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:09.334466 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-278fbc9b-0d06-4629-93c1-afe959467e36 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1500 microversion: 2.1 time: 0.329711 Apr 06 16:39:09.335115 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 55/100] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:09 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1500 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:39:09.407592 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-37f8aa53-1561-4ba9-a866-c715c4df4f45 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:09.408196 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-37f8aa53-1561-4ba9-a866-c715c4df4f45 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:09.415233 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37f8aa53-1561-4ba9-a866-c715c4df4f45 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:09.420039 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37f8aa53-1561-4ba9-a866-c715c4df4f45 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:09.421397 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37f8aa53-1561-4ba9-a866-c715c4df4f45 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:09.427874 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37f8aa53-1561-4ba9-a866-c715c4df4f45 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:09.439422 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-3a7cdeb6-310b-44f8-a3cf-fa0eecd1036b req-f5c3d886-cf8d-47b6-a9a2-4ec15ae09742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b9f9e64-72fd-4e62-bde6-4e44f737c02c", "name": "network-vif-plugged", "status": "completed", "tag": "3d9b80f5-284c-42ae-8f89-8ab97694fca5"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:39:09.464938 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3a7cdeb6-310b-44f8-a3cf-fa0eecd1036b req-f5c3d886-cf8d-47b6-a9a2-4ec15ae09742 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:09.465145 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3a7cdeb6-310b-44f8-a3cf-fa0eecd1036b req-f5c3d886-cf8d-47b6-a9a2-4ec15ae09742 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:09.489122 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-3a7cdeb6-310b-44f8-a3cf-fa0eecd1036b req-f5c3d886-cf8d-47b6-a9a2-4ec15ae09742 service nova] Creating event network-vif-plugged:3d9b80f5-284c-42ae-8f89-8ab97694fca5 for instance 6b9f9e64-72fd-4e62-bde6-4e44f737c02c on hv-cinder-83684 Apr 06 16:39:09.505653 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-3a7cdeb6-310b-44f8-a3cf-fa0eecd1036b req-f5c3d886-cf8d-47b6-a9a2-4ec15ae09742 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069763 Apr 06 16:39:09.520038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 56/101] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:39:09.572738 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f7224c15-f0be-4921-bd15-652c0a1a0145 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:09.573446 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f7224c15-f0be-4921-bd15-652c0a1a0145 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:09.590953 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7224c15-f0be-4921-bd15-652c0a1a0145 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:09.591293 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7224c15-f0be-4921-bd15-652c0a1a0145 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:09.601601 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7224c15-f0be-4921-bd15-652c0a1a0145 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:09.602103 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7224c15-f0be-4921-bd15-652c0a1a0145 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:10.137053 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f7224c15-f0be-4921-bd15-652c0a1a0145 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:10.145553 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f7224c15-f0be-4921-bd15-652c0a1a0145 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:10.154420 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f7224c15-f0be-4921-bd15-652c0a1a0145 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:10.160299 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f7224c15-f0be-4921-bd15-652c0a1a0145 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1406 microversion: 2.20 time: 0.592276 Apr 06 16:39:10.163952 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 57/102] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:39:09 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1406 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:39:10.178664 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-deecea84-8fd9-47eb-89f4-4ab35938ce88 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:10.182235 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-deecea84-8fd9-47eb-89f4-4ab35938ce88 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:10.194582 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-deecea84-8fd9-47eb-89f4-4ab35938ce88 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:10.195316 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-deecea84-8fd9-47eb-89f4-4ab35938ce88 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:10.197068 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-deecea84-8fd9-47eb-89f4-4ab35938ce88 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:10.198649 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-deecea84-8fd9-47eb-89f4-4ab35938ce88 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:10.516754 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-37f8aa53-1561-4ba9-a866-c715c4df4f45 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:10.532183 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-37f8aa53-1561-4ba9-a866-c715c4df4f45 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1363 microversion: 2.1 time: 1.127348 Apr 06 16:39:10.534062 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 46/103] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:09 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1363 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:10.560624 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-deecea84-8fd9-47eb-89f4-4ab35938ce88 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:10.571114 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-deecea84-8fd9-47eb-89f4-4ab35938ce88 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1366 microversion: 2.1 time: 0.401686 Apr 06 16:39:10.572450 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 58/104] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:10 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1366 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:11.148953 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-91bc421f-f272-4481-999a-cdf99ab6f2ed tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6636113-14f0-4b3b-915e-31cdb56bb9fa"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:39:11.150058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-91bc421f-f272-4481-999a-cdf99ab6f2ed tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:11.166525 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91bc421f-f272-4481-999a-cdf99ab6f2ed tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:11.166964 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91bc421f-f272-4481-999a-cdf99ab6f2ed tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:11.167807 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91bc421f-f272-4481-999a-cdf99ab6f2ed tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:11.168149 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91bc421f-f272-4481-999a-cdf99ab6f2ed tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:11.188810 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f186b5d4-da40-4f83-a6b0-acef271852a1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:11.190180 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f186b5d4-da40-4f83-a6b0-acef271852a1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:11.198598 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f186b5d4-da40-4f83-a6b0-acef271852a1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:11.198915 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f186b5d4-da40-4f83-a6b0-acef271852a1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:11.200051 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f186b5d4-da40-4f83-a6b0-acef271852a1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:11.202005 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f186b5d4-da40-4f83-a6b0-acef271852a1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:11.550075 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f186b5d4-da40-4f83-a6b0-acef271852a1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:11.564008 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f186b5d4-da40-4f83-a6b0-acef271852a1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:11.565735 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f186b5d4-da40-4f83-a6b0-acef271852a1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:11.567916 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f186b5d4-da40-4f83-a6b0-acef271852a1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1406 microversion: 2.20 time: 0.383791 Apr 06 16:39:11.573943 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 59/105] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:39:11 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1406 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:39:11.595975 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b106add9-e379-4e55-9169-eaae280a6952 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:11.596587 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b106add9-e379-4e55-9169-eaae280a6952 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:11.603725 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b106add9-e379-4e55-9169-eaae280a6952 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:11.604452 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b106add9-e379-4e55-9169-eaae280a6952 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:11.605544 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b106add9-e379-4e55-9169-eaae280a6952 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:11.611023 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b106add9-e379-4e55-9169-eaae280a6952 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:11.793680 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b106add9-e379-4e55-9169-eaae280a6952 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:11.803333 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b106add9-e379-4e55-9169-eaae280a6952 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1363 microversion: 2.1 time: 0.228178 Apr 06 16:39:11.813123 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 60/106] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:11 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:11.818781 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-08f315e2-9446-4d10-b728-09516be6af6d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:11.819539 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-08f315e2-9446-4d10-b728-09516be6af6d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:11.826474 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08f315e2-9446-4d10-b728-09516be6af6d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:11.827127 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08f315e2-9446-4d10-b728-09516be6af6d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:11.828084 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08f315e2-9446-4d10-b728-09516be6af6d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:11.828677 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08f315e2-9446-4d10-b728-09516be6af6d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:12.238311 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-08f315e2-9446-4d10-b728-09516be6af6d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:12.249296 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-08f315e2-9446-4d10-b728-09516be6af6d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1366 microversion: 2.1 time: 0.432451 Apr 06 16:39:12.257910 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 61/107] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:11 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1366 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:12.442380 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-91bc421f-f272-4481-999a-cdf99ab6f2ed tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "POST /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.297691 Apr 06 16:39:12.443157 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 47/108] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Apr 6 16:39:11 2022] POST /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac/os-volume_attachments => generated 194 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:39:12.590071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9eb39cd8-bb6a-4e58-a9ac-40472d443c2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:12.591057 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9eb39cd8-bb6a-4e58-a9ac-40472d443c2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:12.598754 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9eb39cd8-bb6a-4e58-a9ac-40472d443c2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:12.598754 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9eb39cd8-bb6a-4e58-a9ac-40472d443c2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:12.599979 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9eb39cd8-bb6a-4e58-a9ac-40472d443c2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:12.600517 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9eb39cd8-bb6a-4e58-a9ac-40472d443c2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:12.818968 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9eb39cd8-bb6a-4e58-a9ac-40472d443c2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:12.823402 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c9697b66-a93e-421b-9e2a-8ba813fb07bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:12.823572 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c9697b66-a93e-421b-9e2a-8ba813fb07bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:12.831191 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9697b66-a93e-421b-9e2a-8ba813fb07bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:12.831847 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9697b66-a93e-421b-9e2a-8ba813fb07bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:12.834061 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9697b66-a93e-421b-9e2a-8ba813fb07bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:12.834061 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9697b66-a93e-421b-9e2a-8ba813fb07bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:12.834253 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9eb39cd8-bb6a-4e58-a9ac-40472d443c2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:12.838015 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9eb39cd8-bb6a-4e58-a9ac-40472d443c2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:12.840247 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9eb39cd8-bb6a-4e58-a9ac-40472d443c2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1406 microversion: 2.20 time: 0.256015 Apr 06 16:39:12.857380 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 62/109] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:39:12 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1406 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:39:12.996314 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c9697b66-a93e-421b-9e2a-8ba813fb07bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:13.003779 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c9697b66-a93e-421b-9e2a-8ba813fb07bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1363 microversion: 2.1 time: 0.187106 Apr 06 16:39:13.004350 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 48/110] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:12 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:39:13.263501 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-81901648-aef9-449a-b61c-072dc20782b5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:13.264109 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-81901648-aef9-449a-b61c-072dc20782b5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:13.272645 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81901648-aef9-449a-b61c-072dc20782b5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:13.273524 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81901648-aef9-449a-b61c-072dc20782b5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:13.274366 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81901648-aef9-449a-b61c-072dc20782b5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:13.275626 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81901648-aef9-449a-b61c-072dc20782b5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:13.430631 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-cb80984b-e2d5-4530-a385-c6200a14f8c0 req-b5d2ecbe-33a2-4e72-b99e-92a4cc39aa14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bab853ba-a3d5-4828-baf6-1088f936bc96", "name": "network-vif-plugged", "status": "completed", "tag": "85e18e37-1e89-48a0-8d94-cf2d33254117"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:39:13.440362 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-cb80984b-e2d5-4530-a385-c6200a14f8c0 req-b5d2ecbe-33a2-4e72-b99e-92a4cc39aa14 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:13.441287 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-cb80984b-e2d5-4530-a385-c6200a14f8c0 req-b5d2ecbe-33a2-4e72-b99e-92a4cc39aa14 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:13.459089 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-81901648-aef9-449a-b61c-072dc20782b5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:13.466965 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-81901648-aef9-449a-b61c-072dc20782b5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1556 microversion: 2.1 time: 0.207367 Apr 06 16:39:13.468556 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-cb80984b-e2d5-4530-a385-c6200a14f8c0 req-b5d2ecbe-33a2-4e72-b99e-92a4cc39aa14 service nova] Creating event network-vif-plugged:85e18e37-1e89-48a0-8d94-cf2d33254117 for instance bab853ba-a3d5-4828-baf6-1088f936bc96 on hv-cinder-83684 Apr 06 16:39:13.469729 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 63/111] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:13 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1556 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:13.475653 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-cb80984b-e2d5-4530-a385-c6200a14f8c0 req-b5d2ecbe-33a2-4e72-b99e-92a4cc39aa14 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049377 Apr 06 16:39:13.476645 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 49/112] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:39:13.493234 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4a66a7af-9173-4eeb-986d-315587beae53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:13.494031 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4a66a7af-9173-4eeb-986d-315587beae53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:13.499992 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a66a7af-9173-4eeb-986d-315587beae53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:13.500504 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a66a7af-9173-4eeb-986d-315587beae53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:13.501510 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a66a7af-9173-4eeb-986d-315587beae53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:13.502141 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a66a7af-9173-4eeb-986d-315587beae53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:13.649661 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4a66a7af-9173-4eeb-986d-315587beae53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.164286 Apr 06 16:39:13.650597 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 64/113] 10.222.0.64 () {58 vars in 1274 bytes} [Wed Apr 6 16:39:13 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-interface => generated 284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:39:13.868575 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fda1d55e-f232-448a-a6ad-9a291de1d341 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:13.869687 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fda1d55e-f232-448a-a6ad-9a291de1d341 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:13.879654 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fda1d55e-f232-448a-a6ad-9a291de1d341 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:13.881038 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fda1d55e-f232-448a-a6ad-9a291de1d341 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:13.885174 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fda1d55e-f232-448a-a6ad-9a291de1d341 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:13.885629 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fda1d55e-f232-448a-a6ad-9a291de1d341 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:14.023131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c1921945-0e65-4f17-8282-c9e4ea493fdd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:14.024279 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c1921945-0e65-4f17-8282-c9e4ea493fdd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:14.037592 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1921945-0e65-4f17-8282-c9e4ea493fdd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:14.038663 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1921945-0e65-4f17-8282-c9e4ea493fdd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:14.040279 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1921945-0e65-4f17-8282-c9e4ea493fdd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:14.041917 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1921945-0e65-4f17-8282-c9e4ea493fdd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:14.248565 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c1921945-0e65-4f17-8282-c9e4ea493fdd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:14.256981 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c1921945-0e65-4f17-8282-c9e4ea493fdd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1363 microversion: 2.1 time: 0.239901 Apr 06 16:39:14.257866 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 65/114] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:14 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:39:14.315504 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fda1d55e-f232-448a-a6ad-9a291de1d341 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:14.327807 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fda1d55e-f232-448a-a6ad-9a291de1d341 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:14.330169 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fda1d55e-f232-448a-a6ad-9a291de1d341 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:14.331894 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fda1d55e-f232-448a-a6ad-9a291de1d341 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1406 microversion: 2.20 time: 0.468525 Apr 06 16:39:14.340162 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 50/115] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:39:13 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1406 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:39:15.275347 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b2979d0f-e65a-4ef6-b02d-1344cbfa6666 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:15.275969 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b2979d0f-e65a-4ef6-b02d-1344cbfa6666 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:15.290839 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2979d0f-e65a-4ef6-b02d-1344cbfa6666 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:15.290839 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2979d0f-e65a-4ef6-b02d-1344cbfa6666 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:15.291324 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2979d0f-e65a-4ef6-b02d-1344cbfa6666 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:15.292070 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2979d0f-e65a-4ef6-b02d-1344cbfa6666 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:15.352485 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0dd6d5e9-6aaf-4a6b-a0ad-849b76abce9c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:15.361058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0dd6d5e9-6aaf-4a6b-a0ad-849b76abce9c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:15.376609 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dd6d5e9-6aaf-4a6b-a0ad-849b76abce9c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:15.381503 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dd6d5e9-6aaf-4a6b-a0ad-849b76abce9c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:15.382700 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dd6d5e9-6aaf-4a6b-a0ad-849b76abce9c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:15.395518 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dd6d5e9-6aaf-4a6b-a0ad-849b76abce9c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:15.533324 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b2979d0f-e65a-4ef6-b02d-1344cbfa6666 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:15.541692 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b2979d0f-e65a-4ef6-b02d-1344cbfa6666 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1363 microversion: 2.1 time: 0.270943 Apr 06 16:39:15.551743 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 66/116] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:15 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:15.584308 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-517e8f54-5567-42d2-bc31-c03f33da27d4 req-2c2e4e29-5a32-4e3b-9b80-512f47444e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b9f9e64-72fd-4e62-bde6-4e44f737c02c", "tag": "3d9b80f5-284c-42ae-8f89-8ab97694fca5"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:39:15.593217 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-517e8f54-5567-42d2-bc31-c03f33da27d4 req-2c2e4e29-5a32-4e3b-9b80-512f47444e5b service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:15.593652 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-517e8f54-5567-42d2-bc31-c03f33da27d4 req-2c2e4e29-5a32-4e3b-9b80-512f47444e5b service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:15.606871 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-517e8f54-5567-42d2-bc31-c03f33da27d4 req-2c2e4e29-5a32-4e3b-9b80-512f47444e5b service nova] Creating event network-changed:3d9b80f5-284c-42ae-8f89-8ab97694fca5 for instance 6b9f9e64-72fd-4e62-bde6-4e44f737c02c on hv-cinder-83684 Apr 06 16:39:15.612632 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-517e8f54-5567-42d2-bc31-c03f33da27d4 req-2c2e4e29-5a32-4e3b-9b80-512f47444e5b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032726 Apr 06 16:39:15.613836 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 67/117] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:39:15.698421 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0dd6d5e9-6aaf-4a6b-a0ad-849b76abce9c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:15.710169 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0dd6d5e9-6aaf-4a6b-a0ad-849b76abce9c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:15.711741 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0dd6d5e9-6aaf-4a6b-a0ad-849b76abce9c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:15.713321 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0dd6d5e9-6aaf-4a6b-a0ad-849b76abce9c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1406 microversion: 2.20 time: 0.364664 Apr 06 16:39:15.714289 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 51/118] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:39:15 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1406 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:39:16.562644 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a7bd4085-d81f-4748-9e31-0c0b9450d5a7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:16.563564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a7bd4085-d81f-4748-9e31-0c0b9450d5a7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:16.572100 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7bd4085-d81f-4748-9e31-0c0b9450d5a7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:16.572503 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7bd4085-d81f-4748-9e31-0c0b9450d5a7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:16.573430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7bd4085-d81f-4748-9e31-0c0b9450d5a7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:16.573932 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a7bd4085-d81f-4748-9e31-0c0b9450d5a7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:16.728312 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a7bd4085-d81f-4748-9e31-0c0b9450d5a7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:16.732917 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ab087469-fad2-4d98-8f23-1fc28414965b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:16.733735 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ab087469-fad2-4d98-8f23-1fc28414965b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:16.737784 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a7bd4085-d81f-4748-9e31-0c0b9450d5a7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1363 microversion: 2.1 time: 0.179382 Apr 06 16:39:16.738438 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 68/119] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:16 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:16.741602 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab087469-fad2-4d98-8f23-1fc28414965b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:16.742058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab087469-fad2-4d98-8f23-1fc28414965b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:16.742836 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab087469-fad2-4d98-8f23-1fc28414965b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:16.743272 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab087469-fad2-4d98-8f23-1fc28414965b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:16.874750 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ab087469-fad2-4d98-8f23-1fc28414965b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:16.882997 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ab087469-fad2-4d98-8f23-1fc28414965b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:16.884476 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ab087469-fad2-4d98-8f23-1fc28414965b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:16.885591 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ab087469-fad2-4d98-8f23-1fc28414965b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1406 microversion: 2.20 time: 0.158066 Apr 06 16:39:16.886188 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 52/120] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:39:16 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:39:17.452839 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-ed4ac322-f7b0-48c3-af6d-941187f036c5 req-72b5a637-a8f0-436b-9e94-86ddc3d16c49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330d17b1-0d7d-4519-8dc3-3210eb25aa3c", "name": "network-vif-plugged", "status": "completed", "tag": "e267cfb2-7045-4a09-851f-05d45654d0a1"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:39:17.463004 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ed4ac322-f7b0-48c3-af6d-941187f036c5 req-72b5a637-a8f0-436b-9e94-86ddc3d16c49 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:17.463439 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ed4ac322-f7b0-48c3-af6d-941187f036c5 req-72b5a637-a8f0-436b-9e94-86ddc3d16c49 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:17.475024 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-ed4ac322-f7b0-48c3-af6d-941187f036c5 req-72b5a637-a8f0-436b-9e94-86ddc3d16c49 service nova] Creating event network-vif-plugged:e267cfb2-7045-4a09-851f-05d45654d0a1 for instance 330d17b1-0d7d-4519-8dc3-3210eb25aa3c on hv-cinder-83684 Apr 06 16:39:17.479847 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-ed4ac322-f7b0-48c3-af6d-941187f036c5 req-72b5a637-a8f0-436b-9e94-86ddc3d16c49 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030910 Apr 06 16:39:17.480473 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 69/121] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:39:17.757477 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c8c98965-91ef-4e4d-a8b2-975ac4269089 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:17.758625 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c8c98965-91ef-4e4d-a8b2-975ac4269089 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:17.774818 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8c98965-91ef-4e4d-a8b2-975ac4269089 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:17.777580 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8c98965-91ef-4e4d-a8b2-975ac4269089 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:17.780275 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8c98965-91ef-4e4d-a8b2-975ac4269089 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:17.781650 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8c98965-91ef-4e4d-a8b2-975ac4269089 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:17.905805 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-954eae8b-d0e9-4214-b646-351fe4c69232 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:17.906564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-954eae8b-d0e9-4214-b646-351fe4c69232 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:17.914994 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-954eae8b-d0e9-4214-b646-351fe4c69232 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:17.915321 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-954eae8b-d0e9-4214-b646-351fe4c69232 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:17.916781 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-954eae8b-d0e9-4214-b646-351fe4c69232 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:17.917233 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-954eae8b-d0e9-4214-b646-351fe4c69232 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:17.947418 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c8c98965-91ef-4e4d-a8b2-975ac4269089 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:17.954973 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c8c98965-91ef-4e4d-a8b2-975ac4269089 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1363 microversion: 2.1 time: 0.203592 Apr 06 16:39:17.955831 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 53/122] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:17 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:18.068104 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-954eae8b-d0e9-4214-b646-351fe4c69232 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:18.076226 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-954eae8b-d0e9-4214-b646-351fe4c69232 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:18.077751 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-954eae8b-d0e9-4214-b646-351fe4c69232 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:18.078859 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-954eae8b-d0e9-4214-b646-351fe4c69232 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1406 microversion: 2.20 time: 0.177863 Apr 06 16:39:18.079426 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 70/123] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:39:17 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:39:18.973422 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b8034d00-845f-4cac-ad3b-0a2fd22c62de tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:18.974362 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b8034d00-845f-4cac-ad3b-0a2fd22c62de tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:18.982135 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8034d00-845f-4cac-ad3b-0a2fd22c62de tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:18.982832 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8034d00-845f-4cac-ad3b-0a2fd22c62de tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:18.983777 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8034d00-845f-4cac-ad3b-0a2fd22c62de tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:18.984270 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8034d00-845f-4cac-ad3b-0a2fd22c62de tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:19.098327 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-acde1d87-cfcd-4711-8894-bd8863e74f7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:19.099766 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-acde1d87-cfcd-4711-8894-bd8863e74f7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:19.108227 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acde1d87-cfcd-4711-8894-bd8863e74f7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:19.109084 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acde1d87-cfcd-4711-8894-bd8863e74f7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:19.110643 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acde1d87-cfcd-4711-8894-bd8863e74f7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:19.111144 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acde1d87-cfcd-4711-8894-bd8863e74f7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:19.175386 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b8034d00-845f-4cac-ad3b-0a2fd22c62de tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:19.184466 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b8034d00-845f-4cac-ad3b-0a2fd22c62de tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1549 microversion: 2.1 time: 0.215081 Apr 06 16:39:19.185377 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 54/124] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:18 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1549 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:19.205395 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-709c13a4-afa5-475c-870b-3f898f40b006 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:19.206123 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-709c13a4-afa5-475c-870b-3f898f40b006 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:19.213279 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-709c13a4-afa5-475c-870b-3f898f40b006 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:19.214035 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-709c13a4-afa5-475c-870b-3f898f40b006 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:19.214977 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-709c13a4-afa5-475c-870b-3f898f40b006 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:19.215528 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-709c13a4-afa5-475c-870b-3f898f40b006 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:19.287302 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-acde1d87-cfcd-4711-8894-bd8863e74f7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:19.296183 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-acde1d87-cfcd-4711-8894-bd8863e74f7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:19.298010 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-acde1d87-cfcd-4711-8894-bd8863e74f7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:19.299112 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-acde1d87-cfcd-4711-8894-bd8863e74f7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1406 microversion: 2.20 time: 0.205112 Apr 06 16:39:19.299672 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 71/125] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:39:19 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:39:19.316013 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-709c13a4-afa5-475c-870b-3f898f40b006 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117436 Apr 06 16:39:19.316642 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 55/126] 10.222.0.64 () {58 vars in 1274 bytes} [Wed Apr 6 16:39:19 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:39:20.317390 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c5e17bd2-60af-4628-9319-f61babe463ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:20.318915 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c5e17bd2-60af-4628-9319-f61babe463ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:20.327239 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5e17bd2-60af-4628-9319-f61babe463ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:20.327946 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5e17bd2-60af-4628-9319-f61babe463ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:20.329090 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5e17bd2-60af-4628-9319-f61babe463ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:20.329659 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5e17bd2-60af-4628-9319-f61babe463ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:20.337522 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-a12572f9-b0a3-4b01-83ad-ed1c0d868a2e req-1561b917-1a87-4409-bfaa-24ce06ca016e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bab853ba-a3d5-4828-baf6-1088f936bc96", "tag": "85e18e37-1e89-48a0-8d94-cf2d33254117"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:39:20.346486 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a12572f9-b0a3-4b01-83ad-ed1c0d868a2e req-1561b917-1a87-4409-bfaa-24ce06ca016e service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:20.346941 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a12572f9-b0a3-4b01-83ad-ed1c0d868a2e req-1561b917-1a87-4409-bfaa-24ce06ca016e service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:20.358518 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-a12572f9-b0a3-4b01-83ad-ed1c0d868a2e req-1561b917-1a87-4409-bfaa-24ce06ca016e service nova] Creating event network-changed:85e18e37-1e89-48a0-8d94-cf2d33254117 for instance bab853ba-a3d5-4828-baf6-1088f936bc96 on hv-cinder-83684 Apr 06 16:39:20.363553 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-a12572f9-b0a3-4b01-83ad-ed1c0d868a2e req-1561b917-1a87-4409-bfaa-24ce06ca016e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030150 Apr 06 16:39:20.364962 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 56/127] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:39:20.470104 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c5e17bd2-60af-4628-9319-f61babe463ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:20.479462 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c5e17bd2-60af-4628-9319-f61babe463ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:20.480980 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c5e17bd2-60af-4628-9319-f61babe463ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:20.482094 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c5e17bd2-60af-4628-9319-f61babe463ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1406 microversion: 2.20 time: 0.169069 Apr 06 16:39:20.482662 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 72/128] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:39:20 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:39:21.502059 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-18db2e20-65ba-4161-967f-4eb3d459b07b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:21.502748 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-18db2e20-65ba-4161-967f-4eb3d459b07b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:21.509416 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18db2e20-65ba-4161-967f-4eb3d459b07b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:21.509855 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18db2e20-65ba-4161-967f-4eb3d459b07b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:21.510645 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18db2e20-65ba-4161-967f-4eb3d459b07b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:21.511068 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18db2e20-65ba-4161-967f-4eb3d459b07b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:21.658303 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-18db2e20-65ba-4161-967f-4eb3d459b07b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:21.668740 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-18db2e20-65ba-4161-967f-4eb3d459b07b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:21.670852 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-18db2e20-65ba-4161-967f-4eb3d459b07b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:21.672442 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-18db2e20-65ba-4161-967f-4eb3d459b07b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1406 microversion: 2.20 time: 0.175180 Apr 06 16:39:21.673298 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 57/129] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:39:21 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:39:22.696878 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e258f466-ca14-42fb-aa05-0db404c7dd95 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:22.698281 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e258f466-ca14-42fb-aa05-0db404c7dd95 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:22.705401 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e258f466-ca14-42fb-aa05-0db404c7dd95 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:22.706068 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e258f466-ca14-42fb-aa05-0db404c7dd95 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:22.706900 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e258f466-ca14-42fb-aa05-0db404c7dd95 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:22.707340 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e258f466-ca14-42fb-aa05-0db404c7dd95 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:22.929149 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e258f466-ca14-42fb-aa05-0db404c7dd95 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:22.937517 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e258f466-ca14-42fb-aa05-0db404c7dd95 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:22.939010 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e258f466-ca14-42fb-aa05-0db404c7dd95 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:22.940157 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e258f466-ca14-42fb-aa05-0db404c7dd95 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1406 microversion: 2.20 time: 0.248955 Apr 06 16:39:22.940746 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 73/130] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:39:22 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1406 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:39:23.958481 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3f24637e-15fb-40a0-a2e0-90175a2cc1c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:23.959104 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3f24637e-15fb-40a0-a2e0-90175a2cc1c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:23.965683 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f24637e-15fb-40a0-a2e0-90175a2cc1c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:23.966134 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f24637e-15fb-40a0-a2e0-90175a2cc1c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:23.966911 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f24637e-15fb-40a0-a2e0-90175a2cc1c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:23.967347 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f24637e-15fb-40a0-a2e0-90175a2cc1c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:24.108237 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3f24637e-15fb-40a0-a2e0-90175a2cc1c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:24.120131 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3f24637e-15fb-40a0-a2e0-90175a2cc1c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:24.122034 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3f24637e-15fb-40a0-a2e0-90175a2cc1c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:24.123720 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3f24637e-15fb-40a0-a2e0-90175a2cc1c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1406 microversion: 2.20 time: 0.169150 Apr 06 16:39:24.124511 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 58/131] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:39:23 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:39:25.149670 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-50b80c68-2ff9-4caf-99c4-3e1b02413dfc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:25.150559 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-50b80c68-2ff9-4caf-99c4-3e1b02413dfc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:25.157226 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50b80c68-2ff9-4caf-99c4-3e1b02413dfc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:25.157629 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50b80c68-2ff9-4caf-99c4-3e1b02413dfc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:25.158428 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50b80c68-2ff9-4caf-99c4-3e1b02413dfc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:25.158862 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50b80c68-2ff9-4caf-99c4-3e1b02413dfc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:25.327864 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-50b80c68-2ff9-4caf-99c4-3e1b02413dfc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:25.337559 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-50b80c68-2ff9-4caf-99c4-3e1b02413dfc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:25.339049 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-50b80c68-2ff9-4caf-99c4-3e1b02413dfc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:25.340158 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-50b80c68-2ff9-4caf-99c4-3e1b02413dfc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1406 microversion: 2.20 time: 0.196271 Apr 06 16:39:25.340726 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 74/132] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:39:25 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:39:26.358572 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-88d26603-40f0-4516-aba4-b99e5dc1b535 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:26.359160 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-88d26603-40f0-4516-aba4-b99e5dc1b535 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:26.366783 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88d26603-40f0-4516-aba4-b99e5dc1b535 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:26.367237 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88d26603-40f0-4516-aba4-b99e5dc1b535 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:26.368027 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88d26603-40f0-4516-aba4-b99e5dc1b535 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:26.368466 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88d26603-40f0-4516-aba4-b99e5dc1b535 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:26.532561 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-88d26603-40f0-4516-aba4-b99e5dc1b535 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:26.541706 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-88d26603-40f0-4516-aba4-b99e5dc1b535 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:26.543200 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-88d26603-40f0-4516-aba4-b99e5dc1b535 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:26.544288 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-88d26603-40f0-4516-aba4-b99e5dc1b535 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1406 microversion: 2.20 time: 0.189754 Apr 06 16:39:26.544869 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 59/133] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:39:26 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:39:27.563014 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d2988373-af1b-49e5-a60b-9572bd3daea9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:27.563593 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d2988373-af1b-49e5-a60b-9572bd3daea9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:27.571322 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2988373-af1b-49e5-a60b-9572bd3daea9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:27.571766 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2988373-af1b-49e5-a60b-9572bd3daea9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:27.572532 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2988373-af1b-49e5-a60b-9572bd3daea9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:27.572992 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2988373-af1b-49e5-a60b-9572bd3daea9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:27.742302 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d2988373-af1b-49e5-a60b-9572bd3daea9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:27.750724 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d2988373-af1b-49e5-a60b-9572bd3daea9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:27.752243 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d2988373-af1b-49e5-a60b-9572bd3daea9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:27.753389 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d2988373-af1b-49e5-a60b-9572bd3daea9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1406 microversion: 2.20 time: 0.194385 Apr 06 16:39:27.753959 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 75/134] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:39:27 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:39:28.773359 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f1b5e3df-3778-432d-a9c5-d4af345d5e15 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:28.774150 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f1b5e3df-3778-432d-a9c5-d4af345d5e15 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:28.781768 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1b5e3df-3778-432d-a9c5-d4af345d5e15 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:28.782274 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1b5e3df-3778-432d-a9c5-d4af345d5e15 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:28.783386 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1b5e3df-3778-432d-a9c5-d4af345d5e15 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:28.784046 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1b5e3df-3778-432d-a9c5-d4af345d5e15 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:28.929329 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f1b5e3df-3778-432d-a9c5-d4af345d5e15 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:28.947650 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f1b5e3df-3778-432d-a9c5-d4af345d5e15 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:28.947650 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f1b5e3df-3778-432d-a9c5-d4af345d5e15 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:28.948349 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f1b5e3df-3778-432d-a9c5-d4af345d5e15 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1406 microversion: 2.20 time: 0.179193 Apr 06 16:39:28.948921 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 60/135] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:39:28 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:39:29.966916 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6329a9d3-d166-417e-8048-7d2d73610542 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:29.967673 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6329a9d3-d166-417e-8048-7d2d73610542 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:29.974387 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6329a9d3-d166-417e-8048-7d2d73610542 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:29.974882 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6329a9d3-d166-417e-8048-7d2d73610542 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:29.975672 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6329a9d3-d166-417e-8048-7d2d73610542 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:29.976140 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6329a9d3-d166-417e-8048-7d2d73610542 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:30.149798 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6329a9d3-d166-417e-8048-7d2d73610542 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:30.157718 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6329a9d3-d166-417e-8048-7d2d73610542 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:30.159222 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6329a9d3-d166-417e-8048-7d2d73610542 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:30.161325 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6329a9d3-d166-417e-8048-7d2d73610542 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1406 microversion: 2.20 time: 0.198452 Apr 06 16:39:30.161750 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 76/136] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:39:29 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:39:31.181691 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fa8c6587-b97d-4fd9-ae08-3b0f1898292d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:31.182279 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fa8c6587-b97d-4fd9-ae08-3b0f1898292d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:31.191210 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa8c6587-b97d-4fd9-ae08-3b0f1898292d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:31.191569 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa8c6587-b97d-4fd9-ae08-3b0f1898292d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:31.192352 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa8c6587-b97d-4fd9-ae08-3b0f1898292d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:31.192811 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa8c6587-b97d-4fd9-ae08-3b0f1898292d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:31.419872 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fa8c6587-b97d-4fd9-ae08-3b0f1898292d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:31.429049 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fa8c6587-b97d-4fd9-ae08-3b0f1898292d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:31.431065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fa8c6587-b97d-4fd9-ae08-3b0f1898292d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:31.432722 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fa8c6587-b97d-4fd9-ae08-3b0f1898292d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1597 microversion: 2.20 time: 0.255270 Apr 06 16:39:31.434053 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 61/137] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:39:31 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1597 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:39:31.456091 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-911c3986-dd6a-48c6-ad77-96dd316275c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:31.458275 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-911c3986-dd6a-48c6-ad77-96dd316275c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:31.467327 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-911c3986-dd6a-48c6-ad77-96dd316275c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:31.468050 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-911c3986-dd6a-48c6-ad77-96dd316275c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:31.469098 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-911c3986-dd6a-48c6-ad77-96dd316275c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:31.469862 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-911c3986-dd6a-48c6-ad77-96dd316275c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:31.599070 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-911c3986-dd6a-48c6-ad77-96dd316275c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.150943 Apr 06 16:39:31.599677 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 77/138] 10.222.0.64 () {60 vars in 1315 bytes} [Wed Apr 6 16:39:31 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 06 16:39:32.082235 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c009ea31-7f8a-423e-b0dd-3ad3b2aabaa0 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:32.082923 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c009ea31-7f8a-423e-b0dd-3ad3b2aabaa0 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:32.088957 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c009ea31-7f8a-423e-b0dd-3ad3b2aabaa0 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:32.089404 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c009ea31-7f8a-423e-b0dd-3ad3b2aabaa0 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:32.090170 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c009ea31-7f8a-423e-b0dd-3ad3b2aabaa0 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:32.090599 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c009ea31-7f8a-423e-b0dd-3ad3b2aabaa0 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:32.117965 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c009ea31-7f8a-423e-b0dd-3ad3b2aabaa0 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 06 16:39:32.215146 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c009ea31-7f8a-423e-b0dd-3ad3b2aabaa0 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "DELETE /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 204 len: 0 microversion: 2.1 time: 0.137115 Apr 06 16:39:32.219450 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 62/139] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 16:39:32 2022] DELETE /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 06 16:39:32.224188 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2695e287-2130-4067-a70c-a37370f4e68a tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:32.224848 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2695e287-2130-4067-a70c-a37370f4e68a tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:32.231839 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2695e287-2130-4067-a70c-a37370f4e68a tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:32.233024 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2695e287-2130-4067-a70c-a37370f4e68a tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:32.233824 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2695e287-2130-4067-a70c-a37370f4e68a tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:32.234263 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2695e287-2130-4067-a70c-a37370f4e68a tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:32.815266 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2695e287-2130-4067-a70c-a37370f4e68a tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:32.828092 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2695e287-2130-4067-a70c-a37370f4e68a tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1552 microversion: 2.1 time: 0.607728 Apr 06 16:39:32.828705 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 78/140] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:32 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1552 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:33.353497 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-7c7f90ed-8bc3-48ee-beaa-bee923c7ae89 req-fe58d3c3-f9f3-49d3-90a0-cf3c25735192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "330d17b1-0d7d-4519-8dc3-3210eb25aa3c", "tag": "e267cfb2-7045-4a09-851f-05d45654d0a1"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:39:33.374043 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7c7f90ed-8bc3-48ee-beaa-bee923c7ae89 req-fe58d3c3-f9f3-49d3-90a0-cf3c25735192 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:33.374641 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7c7f90ed-8bc3-48ee-beaa-bee923c7ae89 req-fe58d3c3-f9f3-49d3-90a0-cf3c25735192 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:33.387882 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-7c7f90ed-8bc3-48ee-beaa-bee923c7ae89 req-fe58d3c3-f9f3-49d3-90a0-cf3c25735192 service nova] Creating event network-changed:e267cfb2-7045-4a09-851f-05d45654d0a1 for instance 330d17b1-0d7d-4519-8dc3-3210eb25aa3c on hv-cinder-83684 Apr 06 16:39:33.398254 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-7c7f90ed-8bc3-48ee-beaa-bee923c7ae89 req-fe58d3c3-f9f3-49d3-90a0-cf3c25735192 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053086 Apr 06 16:39:33.400132 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 63/141] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:39:33.846392 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d2253a70-9a8e-4256-ba55-c468f302be8b tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:33.847037 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d2253a70-9a8e-4256-ba55-c468f302be8b tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:33.854166 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2253a70-9a8e-4256-ba55-c468f302be8b tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:33.854877 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2253a70-9a8e-4256-ba55-c468f302be8b tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:33.855650 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2253a70-9a8e-4256-ba55-c468f302be8b tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:33.856243 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2253a70-9a8e-4256-ba55-c468f302be8b tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:34.056715 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d2253a70-9a8e-4256-ba55-c468f302be8b tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:34.067129 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d2253a70-9a8e-4256-ba55-c468f302be8b tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1552 microversion: 2.1 time: 0.224600 Apr 06 16:39:34.078388 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 79/142] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:33 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1552 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:35.087932 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0a66e1fb-ef2f-4cfc-8ebc-24117dc7d2be tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:35.088642 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0a66e1fb-ef2f-4cfc-8ebc-24117dc7d2be tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:35.094781 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a66e1fb-ef2f-4cfc-8ebc-24117dc7d2be tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:35.095233 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a66e1fb-ef2f-4cfc-8ebc-24117dc7d2be tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:35.096007 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a66e1fb-ef2f-4cfc-8ebc-24117dc7d2be tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:35.096441 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a66e1fb-ef2f-4cfc-8ebc-24117dc7d2be tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:35.238619 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0a66e1fb-ef2f-4cfc-8ebc-24117dc7d2be tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:35.255736 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0a66e1fb-ef2f-4cfc-8ebc-24117dc7d2be tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1552 microversion: 2.1 time: 0.172823 Apr 06 16:39:35.256614 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 64/143] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:35 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1552 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:36.275257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f61cf063-4e43-4370-a344-547c422ddc05 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:36.275845 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f61cf063-4e43-4370-a344-547c422ddc05 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:36.282769 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f61cf063-4e43-4370-a344-547c422ddc05 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:36.283321 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f61cf063-4e43-4370-a344-547c422ddc05 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:36.284223 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f61cf063-4e43-4370-a344-547c422ddc05 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:36.284803 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f61cf063-4e43-4370-a344-547c422ddc05 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:36.479212 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f61cf063-4e43-4370-a344-547c422ddc05 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:36.490231 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f61cf063-4e43-4370-a344-547c422ddc05 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1552 microversion: 2.1 time: 0.218755 Apr 06 16:39:36.493774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 80/144] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:36 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1552 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:37.512455 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1c01ee7b-5f5d-4200-825a-7421d8098f51 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:37.514634 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1c01ee7b-5f5d-4200-825a-7421d8098f51 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:37.522096 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c01ee7b-5f5d-4200-825a-7421d8098f51 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:37.523421 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c01ee7b-5f5d-4200-825a-7421d8098f51 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:37.524479 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c01ee7b-5f5d-4200-825a-7421d8098f51 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:37.525159 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c01ee7b-5f5d-4200-825a-7421d8098f51 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:37.853323 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1c01ee7b-5f5d-4200-825a-7421d8098f51 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:37.862591 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1c01ee7b-5f5d-4200-825a-7421d8098f51 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1552 microversion: 2.1 time: 0.355097 Apr 06 16:39:37.879208 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 65/145] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:37 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1552 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:38.158148 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-c515d3e2-324f-48e7-a9b8-dee9c24f8e4f req-2d24dcfb-bf69-4d9d-9e99-0b780af102cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac", "name": "network-vif-deleted", "tag": "f126b299-b78b-4cea-9949-84de47cdca08"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:39:38.167133 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-c515d3e2-324f-48e7-a9b8-dee9c24f8e4f req-2d24dcfb-bf69-4d9d-9e99-0b780af102cb service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:38.167709 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-c515d3e2-324f-48e7-a9b8-dee9c24f8e4f req-2d24dcfb-bf69-4d9d-9e99-0b780af102cb service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:38.180074 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-c515d3e2-324f-48e7-a9b8-dee9c24f8e4f req-2d24dcfb-bf69-4d9d-9e99-0b780af102cb service nova] Creating event network-vif-deleted:f126b299-b78b-4cea-9949-84de47cdca08 for instance 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac on hv-cinder-83684 Apr 06 16:39:38.187171 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-c515d3e2-324f-48e7-a9b8-dee9c24f8e4f req-2d24dcfb-bf69-4d9d-9e99-0b780af102cb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033255 Apr 06 16:39:38.187753 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 81/146] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:39:38.879730 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4d0ed886-2c5d-4c99-b4f8-556e77abcc08 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:38.880510 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4d0ed886-2c5d-4c99-b4f8-556e77abcc08 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:38.887203 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d0ed886-2c5d-4c99-b4f8-556e77abcc08 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:38.887652 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d0ed886-2c5d-4c99-b4f8-556e77abcc08 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:38.888789 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d0ed886-2c5d-4c99-b4f8-556e77abcc08 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:38.889258 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d0ed886-2c5d-4c99-b4f8-556e77abcc08 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:38.960038 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4d0ed886-2c5d-4c99-b4f8-556e77abcc08 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7a3230cc7144a0a34f80080cca5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af9aa6c2b6c4beead00e320236c24f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:38.969845 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4d0ed886-2c5d-4c99-b4f8-556e77abcc08 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 200 len: 1345 microversion: 2.1 time: 0.093717 Apr 06 16:39:38.970155 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 66/147] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:38 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 1345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:39.451399 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8e13cdff-513c-4d25-b9a5-8e710540bcdf tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1436701903", "imageRef": "c217dd2b-7679-4860-b2e6-01a967f654df", "flavorRef": "452", "networks": [{"uuid": "ad69759f-602d-4488-99ad-7c868afbb4a0"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:39:39.509072 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-8e13cdff-513c-4d25-b9a5-8e710540bcdf tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] validate_networks() for [('ad69759f-602d-4488-99ad-7c868afbb4a0', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 06 16:39:39.871179 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-8e13cdff-513c-4d25-b9a5-8e710540bcdf tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 06 16:39:39.871770 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-8e13cdff-513c-4d25-b9a5-8e710540bcdf tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 06 16:39:39.872473 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-8e13cdff-513c-4d25-b9a5-8e710540bcdf tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 06 16:39:39.872946 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-8e13cdff-513c-4d25-b9a5-8e710540bcdf tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 06 16:39:39.873518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-8e13cdff-513c-4d25-b9a5-8e710540bcdf tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 06 16:39:39.884399 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e13cdff-513c-4d25-b9a5-8e710540bcdf tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:39.884965 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e13cdff-513c-4d25-b9a5-8e710540bcdf tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:39.885784 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e13cdff-513c-4d25-b9a5-8e710540bcdf tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:39.886213 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e13cdff-513c-4d25-b9a5-8e710540bcdf tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:39.904153 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-8e13cdff-513c-4d25-b9a5-8e710540bcdf tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Getting quotas for project ae63fb1fb5834fb8969a587fde2f5729. Resources: {'instances', 'cores', 'ram'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 16:39:39.908489 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-8e13cdff-513c-4d25-b9a5-8e710540bcdf tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Getting quotas for user de76c0a653a4440b9029b92154f9df1e and project ae63fb1fb5834fb8969a587fde2f5729. Resources: {'instances', 'cores', 'ram'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 16:39:39.920234 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8e13cdff-513c-4d25-b9a5-8e710540bcdf tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 06 16:39:39.922636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8e13cdff-513c-4d25-b9a5-8e710540bcdf tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c217dd2b-7679-4860-b2e6-01a967f654df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 06 16:39:39.974862 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8e13cdff-513c-4d25-b9a5-8e710540bcdf tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527440 Apr 06 16:39:39.981133 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 82/148] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Apr 6 16:39:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 06 16:39:39.987423 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cd51eaca-9fc3-42b2-8283-83b5ba527745 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:39.988236 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-72351150-7dd5-4a97-aad6-b10c079e5d9d tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:39.988865 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cd51eaca-9fc3-42b2-8283-83b5ba527745 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:39.989844 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-72351150-7dd5-4a97-aad6-b10c079e5d9d tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:40.021427 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72351150-7dd5-4a97-aad6-b10c079e5d9d tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:40.022322 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72351150-7dd5-4a97-aad6-b10c079e5d9d tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:40.023662 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72351150-7dd5-4a97-aad6-b10c079e5d9d tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:40.024469 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72351150-7dd5-4a97-aad6-b10c079e5d9d tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:40.044768 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-72351150-7dd5-4a97-aad6-b10c079e5d9d tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] HTTP exception thrown: Instance 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac could not be found. Apr 06 16:39:40.045630 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-72351150-7dd5-4a97-aad6-b10c079e5d9d tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Returning 404 to user: Instance 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 16:39:40.046464 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-72351150-7dd5-4a97-aad6-b10c079e5d9d tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 404 len: 111 microversion: 2.1 time: 0.063126 Apr 06 16:39:40.047225 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 83/149] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:39 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 06 16:39:40.065525 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cd51eaca-9fc3-42b2-8283-83b5ba527745 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:40.073714 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cd51eaca-9fc3-42b2-8283-83b5ba527745 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1219 microversion: 2.1 time: 0.090810 Apr 06 16:39:40.083291 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 67/150] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:39 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:40.178356 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1fdc94f3-11d1-4f9f-adf9-042a1448ac46 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:40.179841 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1fdc94f3-11d1-4f9f-adf9-042a1448ac46 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:40.186994 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1fdc94f3-11d1-4f9f-adf9-042a1448ac46 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:40.187650 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1fdc94f3-11d1-4f9f-adf9-042a1448ac46 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:40.188392 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1fdc94f3-11d1-4f9f-adf9-042a1448ac46 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:40.188839 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1fdc94f3-11d1-4f9f-adf9-042a1448ac46 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:40.203572 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-1fdc94f3-11d1-4f9f-adf9-042a1448ac46 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] HTTP exception thrown: Instance 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac could not be found. Apr 06 16:39:40.204152 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1fdc94f3-11d1-4f9f-adf9-042a1448ac46 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Returning 404 to user: Instance 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 16:39:40.204999 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1fdc94f3-11d1-4f9f-adf9-042a1448ac46 tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031009 Apr 06 16:39:40.205866 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 84/151] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:39:40 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 16:39:41.091176 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f3c1405d-d286-41ce-957e-f695473801a5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:41.091761 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f3c1405d-d286-41ce-957e-f695473801a5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:41.099275 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3c1405d-d286-41ce-957e-f695473801a5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:41.100004 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3c1405d-d286-41ce-957e-f695473801a5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:41.100980 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3c1405d-d286-41ce-957e-f695473801a5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:41.101424 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3c1405d-d286-41ce-957e-f695473801a5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:41.183425 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f3c1405d-d286-41ce-957e-f695473801a5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:41.192974 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f3c1405d-d286-41ce-957e-f695473801a5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1271 microversion: 2.1 time: 0.105595 Apr 06 16:39:41.193543 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 68/152] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:41 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1271 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:39:41.427072 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e389e8a3-ddf6-48e2-9c52-042dd9dfcdad tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:41.428662 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e389e8a3-ddf6-48e2-9c52-042dd9dfcdad tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:41.435608 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e389e8a3-ddf6-48e2-9c52-042dd9dfcdad tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:41.436266 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e389e8a3-ddf6-48e2-9c52-042dd9dfcdad tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:41.437300 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e389e8a3-ddf6-48e2-9c52-042dd9dfcdad tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:41.437866 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e389e8a3-ddf6-48e2-9c52-042dd9dfcdad tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:41.453548 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-e389e8a3-ddf6-48e2-9c52-042dd9dfcdad tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] HTTP exception thrown: Instance 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac could not be found. Apr 06 16:39:41.454124 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e389e8a3-ddf6-48e2-9c52-042dd9dfcdad tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Returning 404 to user: Instance 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 16:39:41.455245 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e389e8a3-ddf6-48e2-9c52-042dd9dfcdad tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "DELETE /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 404 len: 111 microversion: 2.1 time: 0.032404 Apr 06 16:39:41.456011 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 85/153] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 16:39:41 2022] DELETE /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 16:39:41.464459 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-394343ee-9318-457c-84b6-19d751b0202a tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:41.465058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-394343ee-9318-457c-84b6-19d751b0202a tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] [instance: 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:41.471346 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-394343ee-9318-457c-84b6-19d751b0202a tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:41.471999 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-394343ee-9318-457c-84b6-19d751b0202a tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:41.473091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-394343ee-9318-457c-84b6-19d751b0202a tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:41.473968 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-394343ee-9318-457c-84b6-19d751b0202a tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:41.493401 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-394343ee-9318-457c-84b6-19d751b0202a tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] HTTP exception thrown: Instance 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac could not be found. Apr 06 16:39:41.494585 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-394343ee-9318-457c-84b6-19d751b0202a tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] Returning 404 to user: Instance 8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 16:39:41.495631 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-394343ee-9318-457c-84b6-19d751b0202a tempest-DeleteServersTestJSON-2000346943 tempest-DeleteServersTestJSON-2000346943-project] 10.222.0.64 "GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac" status: 404 len: 111 microversion: 2.1 time: 0.035465 Apr 06 16:39:41.496913 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 69/154] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:41 2022] GET /compute/v2.1/servers/8cbe7d47-1ed1-4768-80b6-2826c1b8b4ac => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 16:39:42.211553 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3f4b68b4-9624-4881-9595-13b5fa57eee1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:42.212217 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3f4b68b4-9624-4881-9595-13b5fa57eee1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:42.219126 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f4b68b4-9624-4881-9595-13b5fa57eee1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:42.219597 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f4b68b4-9624-4881-9595-13b5fa57eee1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:42.220365 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f4b68b4-9624-4881-9595-13b5fa57eee1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:42.220829 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f4b68b4-9624-4881-9595-13b5fa57eee1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:42.302170 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3f4b68b4-9624-4881-9595-13b5fa57eee1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:42.315806 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3f4b68b4-9624-4881-9595-13b5fa57eee1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1277 microversion: 2.1 time: 0.108246 Apr 06 16:39:42.326325 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 86/155] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:42 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1277 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:43.337262 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e00b6542-d5cc-4fd8-87fd-dc8a4c7fb89d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:43.337881 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e00b6542-d5cc-4fd8-87fd-dc8a4c7fb89d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:43.344088 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e00b6542-d5cc-4fd8-87fd-dc8a4c7fb89d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:43.344524 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e00b6542-d5cc-4fd8-87fd-dc8a4c7fb89d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:43.345322 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e00b6542-d5cc-4fd8-87fd-dc8a4c7fb89d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:43.345746 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e00b6542-d5cc-4fd8-87fd-dc8a4c7fb89d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:43.561808 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e00b6542-d5cc-4fd8-87fd-dc8a4c7fb89d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:43.576854 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e00b6542-d5cc-4fd8-87fd-dc8a4c7fb89d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1319 microversion: 2.1 time: 0.244331 Apr 06 16:39:43.578228 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 70/156] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:43 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:44.594638 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-950cef4d-451d-44ac-a02e-de0ccbfbb70e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:44.595180 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-950cef4d-451d-44ac-a02e-de0ccbfbb70e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:44.601393 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-950cef4d-451d-44ac-a02e-de0ccbfbb70e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:44.602341 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-950cef4d-451d-44ac-a02e-de0ccbfbb70e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:44.603398 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-950cef4d-451d-44ac-a02e-de0ccbfbb70e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:44.604282 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-950cef4d-451d-44ac-a02e-de0ccbfbb70e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:44.893377 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-950cef4d-451d-44ac-a02e-de0ccbfbb70e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:44.906700 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-950cef4d-451d-44ac-a02e-de0ccbfbb70e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1319 microversion: 2.1 time: 0.314946 Apr 06 16:39:44.907934 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 87/157] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:44 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:45.923745 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8bc08f97-402c-4829-addf-1cc5458253ab tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:45.924528 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8bc08f97-402c-4829-addf-1cc5458253ab tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:45.932488 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8bc08f97-402c-4829-addf-1cc5458253ab tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:45.933840 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8bc08f97-402c-4829-addf-1cc5458253ab tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:45.934955 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8bc08f97-402c-4829-addf-1cc5458253ab tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:45.935448 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8bc08f97-402c-4829-addf-1cc5458253ab tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:46.117612 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8bc08f97-402c-4829-addf-1cc5458253ab tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:46.127579 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8bc08f97-402c-4829-addf-1cc5458253ab tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1319 microversion: 2.1 time: 0.207667 Apr 06 16:39:46.137892 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 71/158] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:45 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:46.402356 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-9cbc20b1-e4bc-4d75-ae50-f8488b2e77e0 req-3c2ff0f8-d30c-4732-81fa-027dbe3f3a6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d4bd75f-9dad-4b01-a3c0-62891ee17877", "tag": "dee44748-f2e3-46e6-9952-27fcadf3c288"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:39:46.421876 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9cbc20b1-e4bc-4d75-ae50-f8488b2e77e0 req-3c2ff0f8-d30c-4732-81fa-027dbe3f3a6c service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:46.422569 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-9cbc20b1-e4bc-4d75-ae50-f8488b2e77e0 req-3c2ff0f8-d30c-4732-81fa-027dbe3f3a6c service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:46.437774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-9cbc20b1-e4bc-4d75-ae50-f8488b2e77e0 req-3c2ff0f8-d30c-4732-81fa-027dbe3f3a6c service nova] Creating event network-changed:dee44748-f2e3-46e6-9952-27fcadf3c288 for instance 6d4bd75f-9dad-4b01-a3c0-62891ee17877 on hv-cinder-83684 Apr 06 16:39:46.444029 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-9cbc20b1-e4bc-4d75-ae50-f8488b2e77e0 req-3c2ff0f8-d30c-4732-81fa-027dbe3f3a6c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047111 Apr 06 16:39:46.445464 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 88/159] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:39:47.147699 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e1da4215-d3c8-4bb7-af29-db0c53886c76 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:47.148899 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e1da4215-d3c8-4bb7-af29-db0c53886c76 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:47.158814 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1da4215-d3c8-4bb7-af29-db0c53886c76 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:47.158814 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1da4215-d3c8-4bb7-af29-db0c53886c76 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:47.158814 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1da4215-d3c8-4bb7-af29-db0c53886c76 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:47.158814 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1da4215-d3c8-4bb7-af29-db0c53886c76 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:47.494335 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e1da4215-d3c8-4bb7-af29-db0c53886c76 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:47.502219 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e1da4215-d3c8-4bb7-af29-db0c53886c76 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1319 microversion: 2.1 time: 0.359504 Apr 06 16:39:47.503109 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 72/160] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:47 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1319 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:48.522101 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-08da2d75-7120-49c6-9d90-1de28028f579 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:48.522792 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-08da2d75-7120-49c6-9d90-1de28028f579 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:48.532588 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08da2d75-7120-49c6-9d90-1de28028f579 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:48.533636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08da2d75-7120-49c6-9d90-1de28028f579 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:48.534689 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08da2d75-7120-49c6-9d90-1de28028f579 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:48.535337 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08da2d75-7120-49c6-9d90-1de28028f579 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:48.718739 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-08da2d75-7120-49c6-9d90-1de28028f579 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:48.728766 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-08da2d75-7120-49c6-9d90-1de28028f579 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1319 microversion: 2.1 time: 0.211800 Apr 06 16:39:48.738406 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 89/161] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:48 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:49.414443 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1e377308-d081-4f01-9c46-131d6e14d046 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1735130437", "imageRef": "c217dd2b-7679-4860-b2e6-01a967f654df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:39:49.467131 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-1e377308-d081-4f01-9c46-131d6e14d046 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] validate_networks() for [('ee1ec51f-03d0-45fe-9943-d45124fcd980', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 06 16:39:49.746925 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f58ec814-e976-48a8-8482-17422204a05a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:49.747756 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f58ec814-e976-48a8-8482-17422204a05a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:49.756391 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f58ec814-e976-48a8-8482-17422204a05a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:49.756613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f58ec814-e976-48a8-8482-17422204a05a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:49.757361 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f58ec814-e976-48a8-8482-17422204a05a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:49.757784 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f58ec814-e976-48a8-8482-17422204a05a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:50.000199 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f58ec814-e976-48a8-8482-17422204a05a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:50.015679 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f58ec814-e976-48a8-8482-17422204a05a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1319 microversion: 2.1 time: 0.272965 Apr 06 16:39:50.016264 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 90/162] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:49 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:50.110228 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-1e377308-d081-4f01-9c46-131d6e14d046 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 06 16:39:50.110812 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-1e377308-d081-4f01-9c46-131d6e14d046 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 06 16:39:50.111547 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-1e377308-d081-4f01-9c46-131d6e14d046 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 06 16:39:50.112112 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-1e377308-d081-4f01-9c46-131d6e14d046 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 06 16:39:50.112732 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-1e377308-d081-4f01-9c46-131d6e14d046 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 06 16:39:50.124170 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e377308-d081-4f01-9c46-131d6e14d046 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:50.124662 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e377308-d081-4f01-9c46-131d6e14d046 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:50.125436 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e377308-d081-4f01-9c46-131d6e14d046 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:50.126054 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e377308-d081-4f01-9c46-131d6e14d046 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:50.143279 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-1e377308-d081-4f01-9c46-131d6e14d046 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Getting quotas for project 98c4762a201e43a1b7a5f755b26e5cf4. Resources: {'instances', 'cores', 'ram'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 16:39:50.147505 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-1e377308-d081-4f01-9c46-131d6e14d046 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Getting quotas for user 2c31bf4706fc42d992d98d9c0da54f3b and project 98c4762a201e43a1b7a5f755b26e5cf4. Resources: {'instances', 'cores', 'ram'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 16:39:50.159708 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1e377308-d081-4f01-9c46-131d6e14d046 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 06 16:39:50.162116 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1e377308-d081-4f01-9c46-131d6e14d046 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c217dd2b-7679-4860-b2e6-01a967f654df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 06 16:39:50.215958 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1e377308-d081-4f01-9c46-131d6e14d046 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.931723 Apr 06 16:39:50.216997 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 73/163] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Apr 6 16:39:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 06 16:39:50.230784 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-26e2bfeb-d2cd-4e99-861a-be182d8397e3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:50.233031 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-26e2bfeb-d2cd-4e99-861a-be182d8397e3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:50.306724 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-26e2bfeb-d2cd-4e99-861a-be182d8397e3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:50.315670 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-26e2bfeb-d2cd-4e99-861a-be182d8397e3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1222 microversion: 2.1 time: 0.092250 Apr 06 16:39:50.331138 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 91/164] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:50 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:50.381385 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9187cff4-2a54-4af7-bddf-1f3d825368f8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1729256164", "imageRef": "c217dd2b-7679-4860-b2e6-01a967f654df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:39:50.447094 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-9187cff4-2a54-4af7-bddf-1f3d825368f8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] validate_networks() for [('ee1ec51f-03d0-45fe-9943-d45124fcd980', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 06 16:39:50.875233 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-9187cff4-2a54-4af7-bddf-1f3d825368f8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 06 16:39:50.875673 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-9187cff4-2a54-4af7-bddf-1f3d825368f8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 06 16:39:50.876303 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-9187cff4-2a54-4af7-bddf-1f3d825368f8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 06 16:39:50.876760 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-9187cff4-2a54-4af7-bddf-1f3d825368f8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 06 16:39:50.877165 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-9187cff4-2a54-4af7-bddf-1f3d825368f8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 06 16:39:50.886143 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9187cff4-2a54-4af7-bddf-1f3d825368f8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:50.886599 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9187cff4-2a54-4af7-bddf-1f3d825368f8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:50.887387 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9187cff4-2a54-4af7-bddf-1f3d825368f8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:50.887815 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9187cff4-2a54-4af7-bddf-1f3d825368f8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:50.905857 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-9187cff4-2a54-4af7-bddf-1f3d825368f8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Getting quotas for project 98c4762a201e43a1b7a5f755b26e5cf4. Resources: {'instances', 'cores', 'ram'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 16:39:50.909970 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-9187cff4-2a54-4af7-bddf-1f3d825368f8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Getting quotas for user 2c31bf4706fc42d992d98d9c0da54f3b and project 98c4762a201e43a1b7a5f755b26e5cf4. Resources: {'instances', 'cores', 'ram'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 16:39:50.920982 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9187cff4-2a54-4af7-bddf-1f3d825368f8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 06 16:39:50.923122 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9187cff4-2a54-4af7-bddf-1f3d825368f8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c217dd2b-7679-4860-b2e6-01a967f654df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 06 16:39:50.971523 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9187cff4-2a54-4af7-bddf-1f3d825368f8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.599199 Apr 06 16:39:50.973313 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 74/165] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Apr 6 16:39:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 06 16:39:50.983299 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-458cd8ed-0f32-41d3-9dfb-7f179a98c74b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:50.985919 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-458cd8ed-0f32-41d3-9dfb-7f179a98c74b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:51.040663 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c7e8e5f0-6020-48bc-825b-4a85aa9a9891 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:51.041326 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c7e8e5f0-6020-48bc-825b-4a85aa9a9891 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:51.054542 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7e8e5f0-6020-48bc-825b-4a85aa9a9891 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:51.058719 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7e8e5f0-6020-48bc-825b-4a85aa9a9891 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:51.061087 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7e8e5f0-6020-48bc-825b-4a85aa9a9891 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:51.062617 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7e8e5f0-6020-48bc-825b-4a85aa9a9891 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:51.103901 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-458cd8ed-0f32-41d3-9dfb-7f179a98c74b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:51.111556 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-458cd8ed-0f32-41d3-9dfb-7f179a98c74b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1222 microversion: 2.1 time: 0.132297 Apr 06 16:39:51.125763 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 92/166] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:50 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1222 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:51.406250 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c7e8e5f0-6020-48bc-825b-4a85aa9a9891 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:51.416656 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c7e8e5f0-6020-48bc-825b-4a85aa9a9891 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1319 microversion: 2.1 time: 0.387295 Apr 06 16:39:51.427140 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 75/167] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:51 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1319 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:52.132648 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9574b8a5-b868-48b7-84e3-4e8eb46d23b5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:52.133523 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9574b8a5-b868-48b7-84e3-4e8eb46d23b5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:52.146376 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9574b8a5-b868-48b7-84e3-4e8eb46d23b5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:52.146890 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9574b8a5-b868-48b7-84e3-4e8eb46d23b5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:52.147738 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9574b8a5-b868-48b7-84e3-4e8eb46d23b5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:52.148236 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9574b8a5-b868-48b7-84e3-4e8eb46d23b5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:52.213700 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9574b8a5-b868-48b7-84e3-4e8eb46d23b5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:52.224399 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9574b8a5-b868-48b7-84e3-4e8eb46d23b5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1226 microversion: 2.1 time: 0.095969 Apr 06 16:39:52.234703 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 93/168] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:52 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:52.436322 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b68015fa-9fcc-4af9-9454-10a1a25bced2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:52.438090 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b68015fa-9fcc-4af9-9454-10a1a25bced2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:52.462239 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b68015fa-9fcc-4af9-9454-10a1a25bced2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:52.463556 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b68015fa-9fcc-4af9-9454-10a1a25bced2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:52.465317 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b68015fa-9fcc-4af9-9454-10a1a25bced2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:52.467299 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b68015fa-9fcc-4af9-9454-10a1a25bced2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:52.624071 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b68015fa-9fcc-4af9-9454-10a1a25bced2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:52.633498 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b68015fa-9fcc-4af9-9454-10a1a25bced2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1319 microversion: 2.1 time: 0.202537 Apr 06 16:39:52.636372 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 76/169] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:52 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:53.242644 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-521b13e5-10db-4cd3-b97a-1dec1283435c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:53.243249 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-521b13e5-10db-4cd3-b97a-1dec1283435c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:53.249614 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-521b13e5-10db-4cd3-b97a-1dec1283435c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:53.250057 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-521b13e5-10db-4cd3-b97a-1dec1283435c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:53.250835 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-521b13e5-10db-4cd3-b97a-1dec1283435c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:53.251259 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-521b13e5-10db-4cd3-b97a-1dec1283435c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:53.315908 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-521b13e5-10db-4cd3-b97a-1dec1283435c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:53.325149 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-521b13e5-10db-4cd3-b97a-1dec1283435c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1226 microversion: 2.1 time: 0.087049 Apr 06 16:39:53.334949 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 94/170] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:53 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:53.653427 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9b024b76-13e0-4c1e-98bb-445af5736bc7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:53.654643 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9b024b76-13e0-4c1e-98bb-445af5736bc7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:53.662092 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b024b76-13e0-4c1e-98bb-445af5736bc7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:53.662841 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b024b76-13e0-4c1e-98bb-445af5736bc7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:53.663750 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b024b76-13e0-4c1e-98bb-445af5736bc7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:53.664315 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b024b76-13e0-4c1e-98bb-445af5736bc7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:53.818485 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9b024b76-13e0-4c1e-98bb-445af5736bc7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:53.826218 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9b024b76-13e0-4c1e-98bb-445af5736bc7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1319 microversion: 2.1 time: 0.177527 Apr 06 16:39:53.826790 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 77/171] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:53 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:54.349023 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-47a1e161-9b03-4205-ba7e-91d048cc79f8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:54.354015 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-47a1e161-9b03-4205-ba7e-91d048cc79f8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:54.372326 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47a1e161-9b03-4205-ba7e-91d048cc79f8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:54.374526 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47a1e161-9b03-4205-ba7e-91d048cc79f8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:54.375786 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47a1e161-9b03-4205-ba7e-91d048cc79f8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:54.377089 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47a1e161-9b03-4205-ba7e-91d048cc79f8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:54.451496 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-47a1e161-9b03-4205-ba7e-91d048cc79f8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:54.458982 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-47a1e161-9b03-4205-ba7e-91d048cc79f8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1226 microversion: 2.1 time: 0.120367 Apr 06 16:39:54.459546 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 95/172] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:54 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1226 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:54.848768 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-09374989-c929-4154-9342-d38343fe47d4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:54.848768 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-09374989-c929-4154-9342-d38343fe47d4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:54.851739 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09374989-c929-4154-9342-d38343fe47d4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:54.852216 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09374989-c929-4154-9342-d38343fe47d4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:54.853181 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09374989-c929-4154-9342-d38343fe47d4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:54.853612 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09374989-c929-4154-9342-d38343fe47d4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:54.997053 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-09374989-c929-4154-9342-d38343fe47d4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:55.005252 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-09374989-c929-4154-9342-d38343fe47d4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1319 microversion: 2.1 time: 0.165382 Apr 06 16:39:55.005921 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 78/173] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:54 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:55.476272 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-baeb46e6-1536-4d7e-adaf-435be08b179a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:55.476917 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-baeb46e6-1536-4d7e-adaf-435be08b179a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:55.483336 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-baeb46e6-1536-4d7e-adaf-435be08b179a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:55.483773 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-baeb46e6-1536-4d7e-adaf-435be08b179a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:55.484743 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-baeb46e6-1536-4d7e-adaf-435be08b179a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:55.485181 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-baeb46e6-1536-4d7e-adaf-435be08b179a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:55.562270 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-baeb46e6-1536-4d7e-adaf-435be08b179a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:55.573710 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-baeb46e6-1536-4d7e-adaf-435be08b179a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1274 microversion: 2.1 time: 0.101443 Apr 06 16:39:55.584402 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 96/174] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:55 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1274 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:56.023731 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d44ec0df-bb9a-4f12-94dc-a96dbed8407a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:56.032590 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d44ec0df-bb9a-4f12-94dc-a96dbed8407a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:56.041688 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d44ec0df-bb9a-4f12-94dc-a96dbed8407a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:56.042261 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d44ec0df-bb9a-4f12-94dc-a96dbed8407a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:56.043045 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d44ec0df-bb9a-4f12-94dc-a96dbed8407a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:56.043497 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d44ec0df-bb9a-4f12-94dc-a96dbed8407a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:56.195567 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d44ec0df-bb9a-4f12-94dc-a96dbed8407a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:56.203485 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d44ec0df-bb9a-4f12-94dc-a96dbed8407a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1319 microversion: 2.1 time: 0.183581 Apr 06 16:39:56.204061 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 79/175] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:56 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:56.594296 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6793a765-3395-46e5-9d27-d57891cb97be tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:56.594743 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6793a765-3395-46e5-9d27-d57891cb97be tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:56.603208 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6793a765-3395-46e5-9d27-d57891cb97be tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:56.604457 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6793a765-3395-46e5-9d27-d57891cb97be tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:56.605265 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6793a765-3395-46e5-9d27-d57891cb97be tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:56.605588 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6793a765-3395-46e5-9d27-d57891cb97be tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:56.673252 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6793a765-3395-46e5-9d27-d57891cb97be tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:56.687438 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6793a765-3395-46e5-9d27-d57891cb97be tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1274 microversion: 2.1 time: 0.100015 Apr 06 16:39:56.688056 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 97/176] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:56 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1274 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:57.225405 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b1ca1c1b-752e-4764-9245-93355e2ee9a6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:57.226106 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b1ca1c1b-752e-4764-9245-93355e2ee9a6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:57.233173 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1ca1c1b-752e-4764-9245-93355e2ee9a6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:57.233634 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1ca1c1b-752e-4764-9245-93355e2ee9a6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:57.234430 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1ca1c1b-752e-4764-9245-93355e2ee9a6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:57.234836 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1ca1c1b-752e-4764-9245-93355e2ee9a6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:57.399596 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b1ca1c1b-752e-4764-9245-93355e2ee9a6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:57.425232 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b1ca1c1b-752e-4764-9245-93355e2ee9a6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1319 microversion: 2.1 time: 0.204653 Apr 06 16:39:57.427955 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 80/177] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:57 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:57.707931 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e7b87fac-3bb3-4e3f-8678-5221bb299e83 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:57.709202 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e7b87fac-3bb3-4e3f-8678-5221bb299e83 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:57.718179 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7b87fac-3bb3-4e3f-8678-5221bb299e83 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:57.718612 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7b87fac-3bb3-4e3f-8678-5221bb299e83 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:57.719578 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7b87fac-3bb3-4e3f-8678-5221bb299e83 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:57.720435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7b87fac-3bb3-4e3f-8678-5221bb299e83 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:57.793972 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e7b87fac-3bb3-4e3f-8678-5221bb299e83 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:57.801643 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e7b87fac-3bb3-4e3f-8678-5221bb299e83 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1274 microversion: 2.1 time: 0.099540 Apr 06 16:39:57.802612 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 98/178] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:57 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1274 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:58.443167 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-76298e20-1507-4870-bb8c-fad75dd19613 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:58.443906 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-76298e20-1507-4870-bb8c-fad75dd19613 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:58.451236 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76298e20-1507-4870-bb8c-fad75dd19613 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:58.451768 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76298e20-1507-4870-bb8c-fad75dd19613 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:58.452629 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76298e20-1507-4870-bb8c-fad75dd19613 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:58.453148 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76298e20-1507-4870-bb8c-fad75dd19613 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:58.614990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-76298e20-1507-4870-bb8c-fad75dd19613 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:58.622896 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-76298e20-1507-4870-bb8c-fad75dd19613 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1319 microversion: 2.1 time: 0.183581 Apr 06 16:39:58.624044 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 81/179] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:58 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:58.818891 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-146a70cb-1d70-425b-aa17-3b024c7d7466 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:58.819492 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-146a70cb-1d70-425b-aa17-3b024c7d7466 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:58.825784 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-146a70cb-1d70-425b-aa17-3b024c7d7466 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:58.826140 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-146a70cb-1d70-425b-aa17-3b024c7d7466 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:58.826924 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-146a70cb-1d70-425b-aa17-3b024c7d7466 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:58.827356 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-146a70cb-1d70-425b-aa17-3b024c7d7466 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:58.897301 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-146a70cb-1d70-425b-aa17-3b024c7d7466 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:58.906461 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-146a70cb-1d70-425b-aa17-3b024c7d7466 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1282 microversion: 2.1 time: 0.091333 Apr 06 16:39:58.907158 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 99/180] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:58 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:59.641370 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1fdaffe3-ffb5-4a24-8657-025fa868bf31 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:59.642054 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1fdaffe3-ffb5-4a24-8657-025fa868bf31 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:59.648572 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1fdaffe3-ffb5-4a24-8657-025fa868bf31 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:59.649034 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1fdaffe3-ffb5-4a24-8657-025fa868bf31 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:59.649919 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1fdaffe3-ffb5-4a24-8657-025fa868bf31 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:59.650312 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1fdaffe3-ffb5-4a24-8657-025fa868bf31 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:59.890349 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1fdaffe3-ffb5-4a24-8657-025fa868bf31 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:39:59.898528 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1fdaffe3-ffb5-4a24-8657-025fa868bf31 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1319 microversion: 2.1 time: 0.260960 Apr 06 16:39:59.899018 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 82/181] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:59 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:39:59.923626 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-383ad938-c5e3-44d9-a9a6-dbfecd60d235 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:39:59.924277 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-383ad938-c5e3-44d9-a9a6-dbfecd60d235 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:39:59.931398 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-383ad938-c5e3-44d9-a9a6-dbfecd60d235 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:59.931850 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-383ad938-c5e3-44d9-a9a6-dbfecd60d235 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:59.932603 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-383ad938-c5e3-44d9-a9a6-dbfecd60d235 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:39:59.933064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-383ad938-c5e3-44d9-a9a6-dbfecd60d235 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:39:59.995904 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-383ad938-c5e3-44d9-a9a6-dbfecd60d235 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:00.004187 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-383ad938-c5e3-44d9-a9a6-dbfecd60d235 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1282 microversion: 2.1 time: 0.084399 Apr 06 16:40:00.004805 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 100/182] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:39:59 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1282 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:00.926226 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cb16d9ce-f001-4602-b989-14597aa50f61 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:00.927134 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cb16d9ce-f001-4602-b989-14597aa50f61 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:00.965268 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb16d9ce-f001-4602-b989-14597aa50f61 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:00.965926 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb16d9ce-f001-4602-b989-14597aa50f61 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:00.966897 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb16d9ce-f001-4602-b989-14597aa50f61 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:00.967642 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb16d9ce-f001-4602-b989-14597aa50f61 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:01.026742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c9981cd9-2d52-457b-ad3f-2187f3625a3e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:01.028656 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c9981cd9-2d52-457b-ad3f-2187f3625a3e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:01.038205 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9981cd9-2d52-457b-ad3f-2187f3625a3e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:01.039594 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9981cd9-2d52-457b-ad3f-2187f3625a3e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:01.041058 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9981cd9-2d52-457b-ad3f-2187f3625a3e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:01.041913 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9981cd9-2d52-457b-ad3f-2187f3625a3e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:01.254277 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c9981cd9-2d52-457b-ad3f-2187f3625a3e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:01.259444 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cb16d9ce-f001-4602-b989-14597aa50f61 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:01.283974 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cb16d9ce-f001-4602-b989-14597aa50f61 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1319 microversion: 2.1 time: 0.360050 Apr 06 16:40:01.283974 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 83/183] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:00 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1319 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:01.284338 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c9981cd9-2d52-457b-ad3f-2187f3625a3e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1280 microversion: 2.1 time: 0.250047 Apr 06 16:40:01.286234 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 101/184] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:01 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1280 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:01.362366 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-f868cd7c-2832-404b-b010-9bf288ed9b4b req-cf5bc96b-be55-40fc-86bd-ba760b3d1471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c42ef26f-42b4-4e28-a22b-48c9149966cc", "tag": "bedf8854-58b7-4f53-a752-e82232e8ce14"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:40:01.372991 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f868cd7c-2832-404b-b010-9bf288ed9b4b req-cf5bc96b-be55-40fc-86bd-ba760b3d1471 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:01.374043 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f868cd7c-2832-404b-b010-9bf288ed9b4b req-cf5bc96b-be55-40fc-86bd-ba760b3d1471 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:01.424229 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-f868cd7c-2832-404b-b010-9bf288ed9b4b req-cf5bc96b-be55-40fc-86bd-ba760b3d1471 service nova] Creating event network-changed:bedf8854-58b7-4f53-a752-e82232e8ce14 for instance c42ef26f-42b4-4e28-a22b-48c9149966cc on hv-cinder-83684 Apr 06 16:40:01.452102 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-f868cd7c-2832-404b-b010-9bf288ed9b4b req-cf5bc96b-be55-40fc-86bd-ba760b3d1471 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091773 Apr 06 16:40:01.452102 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 84/185] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:40:02.297423 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dc0ff289-aae4-4a07-800b-fe4ac8bc3090 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:02.298031 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dc0ff289-aae4-4a07-800b-fe4ac8bc3090 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:02.300823 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-932a00e4-591a-49b3-b9e1-d040f0c44a3f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:02.303326 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-932a00e4-591a-49b3-b9e1-d040f0c44a3f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:02.314330 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc0ff289-aae4-4a07-800b-fe4ac8bc3090 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:02.317759 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-932a00e4-591a-49b3-b9e1-d040f0c44a3f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:02.318247 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc0ff289-aae4-4a07-800b-fe4ac8bc3090 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:02.319400 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc0ff289-aae4-4a07-800b-fe4ac8bc3090 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:02.319929 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc0ff289-aae4-4a07-800b-fe4ac8bc3090 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:02.322597 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-932a00e4-591a-49b3-b9e1-d040f0c44a3f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:02.324001 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-932a00e4-591a-49b3-b9e1-d040f0c44a3f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:02.324503 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-932a00e4-591a-49b3-b9e1-d040f0c44a3f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:02.512053 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-932a00e4-591a-49b3-b9e1-d040f0c44a3f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:02.526371 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-932a00e4-591a-49b3-b9e1-d040f0c44a3f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1322 microversion: 2.1 time: 0.236435 Apr 06 16:40:02.529009 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 85/186] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:02 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:02.582868 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-dc0ff289-aae4-4a07-800b-fe4ac8bc3090 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:02.591789 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dc0ff289-aae4-4a07-800b-fe4ac8bc3090 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1319 microversion: 2.1 time: 0.304093 Apr 06 16:40:02.592653 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 102/187] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:02 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:02.648552 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-20ec209f-efdc-43ae-b09d-5daa8cc6cbd1 req-ccbe398f-76a5-4a6a-8939-2c57cc0be11f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07920c31-01c7-4ec0-9198-ce3ead787c39", "tag": "d480f3dc-3944-438a-a904-2477bf3a6e11"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:40:02.663832 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-20ec209f-efdc-43ae-b09d-5daa8cc6cbd1 req-ccbe398f-76a5-4a6a-8939-2c57cc0be11f service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:02.664272 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-20ec209f-efdc-43ae-b09d-5daa8cc6cbd1 req-ccbe398f-76a5-4a6a-8939-2c57cc0be11f service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:02.675180 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-b49b1848-8fc1-4d05-8245-d9eae8953e4d req-72e035e1-e680-4446-a0db-74edebc3ce3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d4bd75f-9dad-4b01-a3c0-62891ee17877", "name": "network-vif-plugged", "status": "completed", "tag": "dee44748-f2e3-46e6-9952-27fcadf3c288"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:40:02.690723 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b49b1848-8fc1-4d05-8245-d9eae8953e4d req-72e035e1-e680-4446-a0db-74edebc3ce3a service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:02.691418 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b49b1848-8fc1-4d05-8245-d9eae8953e4d req-72e035e1-e680-4446-a0db-74edebc3ce3a service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:02.696104 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-20ec209f-efdc-43ae-b09d-5daa8cc6cbd1 req-ccbe398f-76a5-4a6a-8939-2c57cc0be11f service nova] Creating event network-changed:d480f3dc-3944-438a-a904-2477bf3a6e11 for instance 07920c31-01c7-4ec0-9198-ce3ead787c39 on hv-cinder-83684 Apr 06 16:40:02.709105 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-20ec209f-efdc-43ae-b09d-5daa8cc6cbd1 req-ccbe398f-76a5-4a6a-8939-2c57cc0be11f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065964 Apr 06 16:40:02.709919 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 86/188] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:40:02.713961 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-b49b1848-8fc1-4d05-8245-d9eae8953e4d req-72e035e1-e680-4446-a0db-74edebc3ce3a service nova] Creating event network-vif-plugged:dee44748-f2e3-46e6-9952-27fcadf3c288 for instance 6d4bd75f-9dad-4b01-a3c0-62891ee17877 on hv-cinder-83684 Apr 06 16:40:02.729953 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-b49b1848-8fc1-4d05-8245-d9eae8953e4d req-72e035e1-e680-4446-a0db-74edebc3ce3a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058002 Apr 06 16:40:02.731144 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 103/189] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:40:03.549620 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f278251e-b67a-432c-b522-d4507bc6e680 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:03.550545 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f278251e-b67a-432c-b522-d4507bc6e680 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:03.559393 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f278251e-b67a-432c-b522-d4507bc6e680 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:03.560066 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f278251e-b67a-432c-b522-d4507bc6e680 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:03.561300 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f278251e-b67a-432c-b522-d4507bc6e680 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:03.561908 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f278251e-b67a-432c-b522-d4507bc6e680 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:03.614616 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0827f143-48b0-41eb-90d5-cb7c40b886bc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:03.615520 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0827f143-48b0-41eb-90d5-cb7c40b886bc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:03.628072 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0827f143-48b0-41eb-90d5-cb7c40b886bc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:03.629316 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0827f143-48b0-41eb-90d5-cb7c40b886bc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:03.631463 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0827f143-48b0-41eb-90d5-cb7c40b886bc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:03.631902 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0827f143-48b0-41eb-90d5-cb7c40b886bc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:03.889528 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0827f143-48b0-41eb-90d5-cb7c40b886bc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:03.902038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0827f143-48b0-41eb-90d5-cb7c40b886bc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1319 microversion: 2.1 time: 0.295908 Apr 06 16:40:03.903351 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 104/190] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:03 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:04.207830 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f278251e-b67a-432c-b522-d4507bc6e680 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:04.221474 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f278251e-b67a-432c-b522-d4507bc6e680 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1322 microversion: 2.1 time: 0.677965 Apr 06 16:40:04.231972 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 87/191] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:03 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1322 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:04.919880 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-97bc38d8-60e4-476d-b795-48ba00b0650f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:04.920750 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-97bc38d8-60e4-476d-b795-48ba00b0650f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:04.927453 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97bc38d8-60e4-476d-b795-48ba00b0650f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:04.928189 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97bc38d8-60e4-476d-b795-48ba00b0650f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:04.929247 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97bc38d8-60e4-476d-b795-48ba00b0650f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:04.929682 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97bc38d8-60e4-476d-b795-48ba00b0650f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:05.094004 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-97bc38d8-60e4-476d-b795-48ba00b0650f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:05.101682 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-97bc38d8-60e4-476d-b795-48ba00b0650f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1319 microversion: 2.1 time: 0.185915 Apr 06 16:40:05.102260 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 105/192] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:04 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:40:05.238987 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-04471d28-bf06-4960-98d9-78c13289dade tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:05.239600 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-04471d28-bf06-4960-98d9-78c13289dade tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:05.251191 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04471d28-bf06-4960-98d9-78c13289dade tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:05.252008 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04471d28-bf06-4960-98d9-78c13289dade tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:05.252978 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04471d28-bf06-4960-98d9-78c13289dade tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:05.253603 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04471d28-bf06-4960-98d9-78c13289dade tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:05.513060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-04471d28-bf06-4960-98d9-78c13289dade tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:05.522810 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-04471d28-bf06-4960-98d9-78c13289dade tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1322 microversion: 2.1 time: 0.287638 Apr 06 16:40:05.523398 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 88/193] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:05 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:06.122778 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2282324f-7850-44fe-9074-582b18cac496 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:06.123625 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2282324f-7850-44fe-9074-582b18cac496 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:06.132460 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2282324f-7850-44fe-9074-582b18cac496 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:06.133123 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2282324f-7850-44fe-9074-582b18cac496 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:06.134568 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2282324f-7850-44fe-9074-582b18cac496 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:06.135555 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2282324f-7850-44fe-9074-582b18cac496 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:06.397062 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2282324f-7850-44fe-9074-582b18cac496 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:06.405530 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2282324f-7850-44fe-9074-582b18cac496 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1319 microversion: 2.1 time: 0.289524 Apr 06 16:40:06.406138 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 106/194] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:06 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:40:06.540657 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-720f9f7c-62bd-4f19-b8f5-eb8b8c7d56c1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:06.541395 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-720f9f7c-62bd-4f19-b8f5-eb8b8c7d56c1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:06.549603 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-720f9f7c-62bd-4f19-b8f5-eb8b8c7d56c1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:06.550362 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-720f9f7c-62bd-4f19-b8f5-eb8b8c7d56c1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:06.551364 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-720f9f7c-62bd-4f19-b8f5-eb8b8c7d56c1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:06.551949 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-720f9f7c-62bd-4f19-b8f5-eb8b8c7d56c1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:07.001574 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-720f9f7c-62bd-4f19-b8f5-eb8b8c7d56c1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:07.010922 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-720f9f7c-62bd-4f19-b8f5-eb8b8c7d56c1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1322 microversion: 2.1 time: 0.474068 Apr 06 16:40:07.011765 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 89/195] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:06 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1322 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:07.425901 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d823220a-dec3-4de0-ab11-577eac6bc494 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:07.427659 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d823220a-dec3-4de0-ab11-577eac6bc494 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:07.436292 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d823220a-dec3-4de0-ab11-577eac6bc494 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:07.438507 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d823220a-dec3-4de0-ab11-577eac6bc494 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:07.441312 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d823220a-dec3-4de0-ab11-577eac6bc494 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:07.441996 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d823220a-dec3-4de0-ab11-577eac6bc494 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:07.698864 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d823220a-dec3-4de0-ab11-577eac6bc494 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:07.707683 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d823220a-dec3-4de0-ab11-577eac6bc494 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1509 microversion: 2.1 time: 0.288088 Apr 06 16:40:07.708263 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 107/196] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:07 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1509 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:08.031425 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-18d314e3-513e-4108-a1d9-0b4156a9ba0f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:08.033372 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-18d314e3-513e-4108-a1d9-0b4156a9ba0f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:08.040757 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18d314e3-513e-4108-a1d9-0b4156a9ba0f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:08.041410 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18d314e3-513e-4108-a1d9-0b4156a9ba0f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:08.042406 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18d314e3-513e-4108-a1d9-0b4156a9ba0f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:08.043034 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18d314e3-513e-4108-a1d9-0b4156a9ba0f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:08.205616 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-18d314e3-513e-4108-a1d9-0b4156a9ba0f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:08.213962 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-18d314e3-513e-4108-a1d9-0b4156a9ba0f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1322 microversion: 2.1 time: 0.187622 Apr 06 16:40:08.215210 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 90/197] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:08 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:08.741232 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-ae23368d-972c-4867-bdba-c23231066f09 req-2f0043b4-ae9d-4d11-8f27-d4d385aaa173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42ef26f-42b4-4e28-a22b-48c9149966cc", "name": "network-vif-plugged", "status": "completed", "tag": "bedf8854-58b7-4f53-a752-e82232e8ce14"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:40:08.756312 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ae23368d-972c-4867-bdba-c23231066f09 req-2f0043b4-ae9d-4d11-8f27-d4d385aaa173 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:08.757332 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ae23368d-972c-4867-bdba-c23231066f09 req-2f0043b4-ae9d-4d11-8f27-d4d385aaa173 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:08.788974 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-ae23368d-972c-4867-bdba-c23231066f09 req-2f0043b4-ae9d-4d11-8f27-d4d385aaa173 service nova] Creating event network-vif-plugged:bedf8854-58b7-4f53-a752-e82232e8ce14 for instance c42ef26f-42b4-4e28-a22b-48c9149966cc on hv-cinder-83684 Apr 06 16:40:08.796125 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-ae23368d-972c-4867-bdba-c23231066f09 req-2f0043b4-ae9d-4d11-8f27-d4d385aaa173 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057919 Apr 06 16:40:08.797153 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 108/198] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:40:09.232618 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2971c697-2acd-485d-93d5-240a1f96ebe4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:09.233362 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2971c697-2acd-485d-93d5-240a1f96ebe4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:09.242417 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2971c697-2acd-485d-93d5-240a1f96ebe4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:09.243059 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2971c697-2acd-485d-93d5-240a1f96ebe4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:09.244311 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2971c697-2acd-485d-93d5-240a1f96ebe4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:09.245095 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2971c697-2acd-485d-93d5-240a1f96ebe4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:09.399208 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2971c697-2acd-485d-93d5-240a1f96ebe4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:09.407429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2971c697-2acd-485d-93d5-240a1f96ebe4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1322 microversion: 2.1 time: 0.179015 Apr 06 16:40:09.408004 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 91/199] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:09 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:10.429366 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-130f5ee2-a31a-4f1b-863f-d45334343e7e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:10.430139 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-130f5ee2-a31a-4f1b-863f-d45334343e7e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:10.437337 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-130f5ee2-a31a-4f1b-863f-d45334343e7e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:10.437697 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-130f5ee2-a31a-4f1b-863f-d45334343e7e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:10.438632 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-130f5ee2-a31a-4f1b-863f-d45334343e7e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:10.439108 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-130f5ee2-a31a-4f1b-863f-d45334343e7e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:10.612075 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-130f5ee2-a31a-4f1b-863f-d45334343e7e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:10.620857 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-130f5ee2-a31a-4f1b-863f-d45334343e7e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1322 microversion: 2.1 time: 0.198574 Apr 06 16:40:10.621576 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 109/200] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:10 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:11.646619 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-594d3046-0b45-4a4b-857b-3f11adc248b2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:11.647230 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-594d3046-0b45-4a4b-857b-3f11adc248b2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:11.654649 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-594d3046-0b45-4a4b-857b-3f11adc248b2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:11.655098 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-594d3046-0b45-4a4b-857b-3f11adc248b2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:11.655881 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-594d3046-0b45-4a4b-857b-3f11adc248b2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:11.656316 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-594d3046-0b45-4a4b-857b-3f11adc248b2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:11.802801 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-594d3046-0b45-4a4b-857b-3f11adc248b2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:11.810937 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-594d3046-0b45-4a4b-857b-3f11adc248b2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1322 microversion: 2.1 time: 0.169182 Apr 06 16:40:11.811526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 92/201] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:11 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:12.830311 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-60bb35f1-0fee-487d-9443-7003d0123746 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:12.830922 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-60bb35f1-0fee-487d-9443-7003d0123746 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:12.837587 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60bb35f1-0fee-487d-9443-7003d0123746 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:12.838037 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60bb35f1-0fee-487d-9443-7003d0123746 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:12.838934 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60bb35f1-0fee-487d-9443-7003d0123746 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:12.839396 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60bb35f1-0fee-487d-9443-7003d0123746 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:12.985490 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-60bb35f1-0fee-487d-9443-7003d0123746 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:12.996882 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-60bb35f1-0fee-487d-9443-7003d0123746 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1322 microversion: 2.1 time: 0.170498 Apr 06 16:40:12.996882 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 110/202] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:12 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:14.015579 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0f1c553c-244b-4071-a029-ae5d5b54fa39 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:14.016582 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0f1c553c-244b-4071-a029-ae5d5b54fa39 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:14.025643 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f1c553c-244b-4071-a029-ae5d5b54fa39 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:14.026296 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f1c553c-244b-4071-a029-ae5d5b54fa39 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:14.027325 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f1c553c-244b-4071-a029-ae5d5b54fa39 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:14.027822 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f1c553c-244b-4071-a029-ae5d5b54fa39 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:14.184740 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0f1c553c-244b-4071-a029-ae5d5b54fa39 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:14.192657 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0f1c553c-244b-4071-a029-ae5d5b54fa39 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1322 microversion: 2.1 time: 0.181661 Apr 06 16:40:14.193274 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 93/203] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:14 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:15.210432 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-83a2d580-36f9-471a-8d02-84ea45ad718d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:15.211036 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-83a2d580-36f9-471a-8d02-84ea45ad718d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:15.217625 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83a2d580-36f9-471a-8d02-84ea45ad718d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:15.218057 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83a2d580-36f9-471a-8d02-84ea45ad718d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:15.218827 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83a2d580-36f9-471a-8d02-84ea45ad718d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:15.219259 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83a2d580-36f9-471a-8d02-84ea45ad718d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:15.381591 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-83a2d580-36f9-471a-8d02-84ea45ad718d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:15.389468 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-83a2d580-36f9-471a-8d02-84ea45ad718d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1322 microversion: 2.1 time: 0.183014 Apr 06 16:40:15.390054 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 111/204] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:15 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:16.022473 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-d9f4de7e-226d-4906-8498-de8f2715040e req-2dfa2d86-c6c1-4449-8cb2-dbaa3dec533e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07920c31-01c7-4ec0-9198-ce3ead787c39", "name": "network-vif-plugged", "status": "completed", "tag": "d480f3dc-3944-438a-a904-2477bf3a6e11"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:40:16.038402 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d9f4de7e-226d-4906-8498-de8f2715040e req-2dfa2d86-c6c1-4449-8cb2-dbaa3dec533e service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:16.039413 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d9f4de7e-226d-4906-8498-de8f2715040e req-2dfa2d86-c6c1-4449-8cb2-dbaa3dec533e service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:16.053320 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-d9f4de7e-226d-4906-8498-de8f2715040e req-2dfa2d86-c6c1-4449-8cb2-dbaa3dec533e service nova] Creating event network-vif-plugged:d480f3dc-3944-438a-a904-2477bf3a6e11 for instance 07920c31-01c7-4ec0-9198-ce3ead787c39 on hv-cinder-83684 Apr 06 16:40:16.059874 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-d9f4de7e-226d-4906-8498-de8f2715040e req-2dfa2d86-c6c1-4449-8cb2-dbaa3dec533e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049944 Apr 06 16:40:16.060800 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 94/205] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:40:16.410039 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7336a470-d2ff-4547-8d24-e32065154fee tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:16.410911 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7336a470-d2ff-4547-8d24-e32065154fee tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:16.420051 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7336a470-d2ff-4547-8d24-e32065154fee tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:16.420841 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7336a470-d2ff-4547-8d24-e32065154fee tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:16.421653 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7336a470-d2ff-4547-8d24-e32065154fee tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:16.422080 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7336a470-d2ff-4547-8d24-e32065154fee tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:16.673718 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7336a470-d2ff-4547-8d24-e32065154fee tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:16.693665 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7336a470-d2ff-4547-8d24-e32065154fee tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1322 microversion: 2.1 time: 0.287186 Apr 06 16:40:16.707443 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 112/206] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:16 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:17.733811 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d179d31e-fc5a-4dcf-8b75-fdb6ea1951ae tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:17.735264 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d179d31e-fc5a-4dcf-8b75-fdb6ea1951ae tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:17.744360 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d179d31e-fc5a-4dcf-8b75-fdb6ea1951ae tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:17.745184 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d179d31e-fc5a-4dcf-8b75-fdb6ea1951ae tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:17.746265 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d179d31e-fc5a-4dcf-8b75-fdb6ea1951ae tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:17.746909 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d179d31e-fc5a-4dcf-8b75-fdb6ea1951ae tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:18.000225 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d179d31e-fc5a-4dcf-8b75-fdb6ea1951ae tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:18.000225 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d179d31e-fc5a-4dcf-8b75-fdb6ea1951ae tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1322 microversion: 2.1 time: 0.285190 Apr 06 16:40:18.000225 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 95/207] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:17 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:19.017266 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2a26fc13-6e1b-4360-bf8f-e1372bf98a8f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:19.018007 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2a26fc13-6e1b-4360-bf8f-e1372bf98a8f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:19.025344 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a26fc13-6e1b-4360-bf8f-e1372bf98a8f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:19.026061 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a26fc13-6e1b-4360-bf8f-e1372bf98a8f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:19.027029 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a26fc13-6e1b-4360-bf8f-e1372bf98a8f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:19.027483 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a26fc13-6e1b-4360-bf8f-e1372bf98a8f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:19.213613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2a26fc13-6e1b-4360-bf8f-e1372bf98a8f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:19.222907 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2a26fc13-6e1b-4360-bf8f-e1372bf98a8f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1517 microversion: 2.1 time: 0.209980 Apr 06 16:40:19.223915 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 113/208] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:19 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1517 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:19.240471 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5899affb-21ff-409f-961c-4bd6d1114df0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:40:19.241669 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5899affb-21ff-409f-961c-4bd6d1114df0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:19.248996 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5899affb-21ff-409f-961c-4bd6d1114df0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:19.249436 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5899affb-21ff-409f-961c-4bd6d1114df0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:19.250422 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5899affb-21ff-409f-961c-4bd6d1114df0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:19.251022 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5899affb-21ff-409f-961c-4bd6d1114df0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:19.287642 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-5899affb-21ff-409f-961c-4bd6d1114df0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lazy-loading 'flavor' on Instance uuid 07920c31-01c7-4ec0-9198-ce3ead787c39 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 06 16:40:19.399208 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-27e0153d-6b49-4501-958d-ccdd374c6fa3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:19.400019 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-27e0153d-6b49-4501-958d-ccdd374c6fa3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:19.409705 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27e0153d-6b49-4501-958d-ccdd374c6fa3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:19.410557 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27e0153d-6b49-4501-958d-ccdd374c6fa3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:19.412116 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27e0153d-6b49-4501-958d-ccdd374c6fa3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:19.412741 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27e0153d-6b49-4501-958d-ccdd374c6fa3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:19.429655 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5899affb-21ff-409f-961c-4bd6d1114df0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "POST /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39/action" status: 200 len: 32 microversion: 2.1 time: 0.193158 Apr 06 16:40:19.438575 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 96/209] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Apr 6 16:40:19 2022] POST /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39/action => generated 32 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 06 16:40:19.450800 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-27e0153d-6b49-4501-958d-ccdd374c6fa3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/ips" status: 200 len: 145 microversion: 2.1 time: 0.057675 Apr 06 16:40:19.451576 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 114/210] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Apr 6 16:40:19 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/ips => generated 145 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:40:19.455041 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-882e15a1-fd32-477e-bedb-4f1f08223681 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:19.456451 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-882e15a1-fd32-477e-bedb-4f1f08223681 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:19.468567 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-882e15a1-fd32-477e-bedb-4f1f08223681 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:19.469121 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-882e15a1-fd32-477e-bedb-4f1f08223681 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:19.470024 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-882e15a1-fd32-477e-bedb-4f1f08223681 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:19.470518 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-882e15a1-fd32-477e-bedb-4f1f08223681 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:19.779418 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-882e15a1-fd32-477e-bedb-4f1f08223681 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:19.793757 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-882e15a1-fd32-477e-bedb-4f1f08223681 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.350904 Apr 06 16:40:19.794886 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 97/211] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:19 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:20.813159 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-04e1b1f1-8096-45c3-8fc7-3aed2b6198a4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:20.813929 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-04e1b1f1-8096-45c3-8fc7-3aed2b6198a4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:20.819990 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04e1b1f1-8096-45c3-8fc7-3aed2b6198a4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:20.820808 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04e1b1f1-8096-45c3-8fc7-3aed2b6198a4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:20.821880 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04e1b1f1-8096-45c3-8fc7-3aed2b6198a4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:20.822541 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04e1b1f1-8096-45c3-8fc7-3aed2b6198a4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:21.006064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-04e1b1f1-8096-45c3-8fc7-3aed2b6198a4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:21.015143 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-04e1b1f1-8096-45c3-8fc7-3aed2b6198a4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.206318 Apr 06 16:40:21.017160 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 115/212] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:20 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:21.256094 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c471e2bf-3035-4f40-b665-93ecf9c91ba5 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-607927159", "imageRef": "c217dd2b-7679-4860-b2e6-01a967f654df", "flavorRef": "452"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:40:21.326340 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-c471e2bf-3035-4f40-b665-93ecf9c91ba5 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] validate_networks() for None {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 06 16:40:21.688504 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-c471e2bf-3035-4f40-b665-93ecf9c91ba5 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 06 16:40:21.689382 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-c471e2bf-3035-4f40-b665-93ecf9c91ba5 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 06 16:40:21.689921 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-c471e2bf-3035-4f40-b665-93ecf9c91ba5 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 06 16:40:21.690910 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-c471e2bf-3035-4f40-b665-93ecf9c91ba5 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 06 16:40:21.691575 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-c471e2bf-3035-4f40-b665-93ecf9c91ba5 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 06 16:40:21.702041 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c471e2bf-3035-4f40-b665-93ecf9c91ba5 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:21.702571 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c471e2bf-3035-4f40-b665-93ecf9c91ba5 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:21.703308 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c471e2bf-3035-4f40-b665-93ecf9c91ba5 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:21.703720 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c471e2bf-3035-4f40-b665-93ecf9c91ba5 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:21.722771 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-c471e2bf-3035-4f40-b665-93ecf9c91ba5 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Getting quotas for project 127cc8879ee44406ab28383812296e76. Resources: {'instances', 'cores', 'ram'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 16:40:21.726966 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-c471e2bf-3035-4f40-b665-93ecf9c91ba5 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Getting quotas for user 81273fe2a1844bb3a9a5c48790ce6417 and project 127cc8879ee44406ab28383812296e76. Resources: {'instances', 'cores', 'ram'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 16:40:21.739176 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c471e2bf-3035-4f40-b665-93ecf9c91ba5 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 06 16:40:21.741775 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c471e2bf-3035-4f40-b665-93ecf9c91ba5 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] [instance: 818d6923-3f75-4112-9216-bba7fa5bbf88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c217dd2b-7679-4860-b2e6-01a967f654df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 06 16:40:21.798776 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c471e2bf-3035-4f40-b665-93ecf9c91ba5 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551038 Apr 06 16:40:21.799623 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 98/213] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Apr 6 16:40:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 06 16:40:21.814829 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c7ab6813-7352-439c-935a-49a2bb703048 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:21.815540 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c7ab6813-7352-439c-935a-49a2bb703048 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] [instance: 818d6923-3f75-4112-9216-bba7fa5bbf88] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:21.922820 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c7ab6813-7352-439c-935a-49a2bb703048 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81273fe2a1844bb3a9a5c48790ce6417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127cc8879ee44406ab28383812296e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:21.930294 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c7ab6813-7352-439c-935a-49a2bb703048 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] 10.222.0.64 "GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88" status: 200 len: 1214 microversion: 2.1 time: 0.123300 Apr 06 16:40:21.930872 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 116/214] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:21 2022] GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88 => generated 1214 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:22.034494 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2f4856c2-e1a3-4d14-a510-80ebb369fe99 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:22.035089 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2f4856c2-e1a3-4d14-a510-80ebb369fe99 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:22.049362 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f4856c2-e1a3-4d14-a510-80ebb369fe99 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:22.049866 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f4856c2-e1a3-4d14-a510-80ebb369fe99 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:22.050663 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f4856c2-e1a3-4d14-a510-80ebb369fe99 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:22.051172 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f4856c2-e1a3-4d14-a510-80ebb369fe99 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:22.302712 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2f4856c2-e1a3-4d14-a510-80ebb369fe99 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:22.314061 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2f4856c2-e1a3-4d14-a510-80ebb369fe99 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.283622 Apr 06 16:40:22.325204 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 99/215] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:22 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:22.948182 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4ba1241f-9a10-4c0d-90e8-7ecd4ead245d tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:22.948834 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4ba1241f-9a10-4c0d-90e8-7ecd4ead245d tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] [instance: 818d6923-3f75-4112-9216-bba7fa5bbf88] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:22.957364 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ba1241f-9a10-4c0d-90e8-7ecd4ead245d tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:22.957960 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ba1241f-9a10-4c0d-90e8-7ecd4ead245d tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:22.959111 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ba1241f-9a10-4c0d-90e8-7ecd4ead245d tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:22.959551 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ba1241f-9a10-4c0d-90e8-7ecd4ead245d tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:23.031734 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4ba1241f-9a10-4c0d-90e8-7ecd4ead245d tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81273fe2a1844bb3a9a5c48790ce6417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127cc8879ee44406ab28383812296e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:23.039352 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4ba1241f-9a10-4c0d-90e8-7ecd4ead245d tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] 10.222.0.64 "GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88" status: 200 len: 1266 microversion: 2.1 time: 0.095551 Apr 06 16:40:23.039918 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 117/216] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:22 2022] GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:23.334680 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fe91229f-b85c-4ac0-be9a-2fba065f3aa8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:23.335307 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fe91229f-b85c-4ac0-be9a-2fba065f3aa8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:23.343405 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe91229f-b85c-4ac0-be9a-2fba065f3aa8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:23.343941 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe91229f-b85c-4ac0-be9a-2fba065f3aa8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:23.345008 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe91229f-b85c-4ac0-be9a-2fba065f3aa8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:23.345539 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe91229f-b85c-4ac0-be9a-2fba065f3aa8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:23.539021 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fe91229f-b85c-4ac0-be9a-2fba065f3aa8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:23.551260 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fe91229f-b85c-4ac0-be9a-2fba065f3aa8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.221304 Apr 06 16:40:23.552473 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 100/217] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:23 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:23.602556 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3cc5de3f-a71e-4172-8f0c-17f4ee60c921 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:23.603054 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3cc5de3f-a71e-4172-8f0c-17f4ee60c921 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:23.609336 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3cc5de3f-a71e-4172-8f0c-17f4ee60c921 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:23.609792 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3cc5de3f-a71e-4172-8f0c-17f4ee60c921 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:23.610564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3cc5de3f-a71e-4172-8f0c-17f4ee60c921 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:23.610994 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3cc5de3f-a71e-4172-8f0c-17f4ee60c921 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:23.633607 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6480b19f-28a6-4b0f-b19f-ffd0fa1fd511 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a3fb170-2d65-4fae-b533-0a5d5815f26a"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:40:23.634795 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6480b19f-28a6-4b0f-b19f-ffd0fa1fd511 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:23.635155 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3cc5de3f-a71e-4172-8f0c-17f4ee60c921 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/ips" status: 200 len: 149 microversion: 2.1 time: 0.037843 Apr 06 16:40:23.635776 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 118/218] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Apr 6 16:40:23 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:40:23.640981 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6480b19f-28a6-4b0f-b19f-ffd0fa1fd511 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:23.641434 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6480b19f-28a6-4b0f-b19f-ffd0fa1fd511 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:23.642303 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6480b19f-28a6-4b0f-b19f-ffd0fa1fd511 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:23.642737 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6480b19f-28a6-4b0f-b19f-ffd0fa1fd511 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:24.063331 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a9c30101-c9ea-4093-8bf8-7efd654b65b2 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:24.075717 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a9c30101-c9ea-4093-8bf8-7efd654b65b2 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] [instance: 818d6923-3f75-4112-9216-bba7fa5bbf88] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:24.091426 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9c30101-c9ea-4093-8bf8-7efd654b65b2 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:24.092046 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9c30101-c9ea-4093-8bf8-7efd654b65b2 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:24.093331 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9c30101-c9ea-4093-8bf8-7efd654b65b2 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:24.094151 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9c30101-c9ea-4093-8bf8-7efd654b65b2 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:24.170212 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a9c30101-c9ea-4093-8bf8-7efd654b65b2 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81273fe2a1844bb3a9a5c48790ce6417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127cc8879ee44406ab28383812296e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:24.180401 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a9c30101-c9ea-4093-8bf8-7efd654b65b2 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] 10.222.0.64 "GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88" status: 200 len: 1272 microversion: 2.1 time: 0.122433 Apr 06 16:40:24.182090 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 119/219] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:24 2022] GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88 => generated 1272 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:40:24.246070 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6480b19f-28a6-4b0f-b19f-ffd0fa1fd511 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "POST /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.615828 Apr 06 16:40:24.247138 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 101/220] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Apr 6 16:40:23 2022] POST /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 194 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:40:24.576089 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9e82225e-4d3d-40a9-a627-1045a9b8b5be tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:24.577234 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9e82225e-4d3d-40a9-a627-1045a9b8b5be tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:24.587932 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e82225e-4d3d-40a9-a627-1045a9b8b5be tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:24.589268 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e82225e-4d3d-40a9-a627-1045a9b8b5be tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:24.590661 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e82225e-4d3d-40a9-a627-1045a9b8b5be tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:24.591181 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e82225e-4d3d-40a9-a627-1045a9b8b5be tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:24.742884 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9e82225e-4d3d-40a9-a627-1045a9b8b5be tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:24.750747 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9e82225e-4d3d-40a9-a627-1045a9b8b5be tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.180118 Apr 06 16:40:24.751341 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 120/221] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:24 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:25.139417 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4b339e06-e71e-4f79-a4aa-cb47d243f2e7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca2405d2-66cf-4677-a783-e9aee0215127"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:40:25.140701 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4b339e06-e71e-4f79-a4aa-cb47d243f2e7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:25.147444 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b339e06-e71e-4f79-a4aa-cb47d243f2e7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:25.148109 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b339e06-e71e-4f79-a4aa-cb47d243f2e7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:25.149135 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b339e06-e71e-4f79-a4aa-cb47d243f2e7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:25.149839 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b339e06-e71e-4f79-a4aa-cb47d243f2e7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:25.199837 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ecdc587e-3ff9-441a-afcf-41fe272d9ef3 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:25.201346 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ecdc587e-3ff9-441a-afcf-41fe272d9ef3 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] [instance: 818d6923-3f75-4112-9216-bba7fa5bbf88] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:25.209766 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ecdc587e-3ff9-441a-afcf-41fe272d9ef3 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:25.210594 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ecdc587e-3ff9-441a-afcf-41fe272d9ef3 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:25.211890 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ecdc587e-3ff9-441a-afcf-41fe272d9ef3 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:25.212564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ecdc587e-3ff9-441a-afcf-41fe272d9ef3 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:25.449262 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ecdc587e-3ff9-441a-afcf-41fe272d9ef3 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81273fe2a1844bb3a9a5c48790ce6417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127cc8879ee44406ab28383812296e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:25.458322 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ecdc587e-3ff9-441a-afcf-41fe272d9ef3 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] 10.222.0.64 "GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88" status: 200 len: 1314 microversion: 2.1 time: 0.262941 Apr 06 16:40:25.458921 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 121/222] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:25 2022] GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:25.471155 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-23d2cfa1-6aaa-421d-a213-e674eaa57664 req-ff576288-4611-4f4f-a3b4-04b371a40c63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "818d6923-3f75-4112-9216-bba7fa5bbf88", "tag": "d32f22cb-e61a-4f96-97bc-45c33303eb7e"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:40:25.493896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-23d2cfa1-6aaa-421d-a213-e674eaa57664 req-ff576288-4611-4f4f-a3b4-04b371a40c63 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:25.494357 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-23d2cfa1-6aaa-421d-a213-e674eaa57664 req-ff576288-4611-4f4f-a3b4-04b371a40c63 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:25.513580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-23d2cfa1-6aaa-421d-a213-e674eaa57664 req-ff576288-4611-4f4f-a3b4-04b371a40c63 service nova] Creating event network-changed:d32f22cb-e61a-4f96-97bc-45c33303eb7e for instance 818d6923-3f75-4112-9216-bba7fa5bbf88 on hv-cinder-83684 Apr 06 16:40:25.521744 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-23d2cfa1-6aaa-421d-a213-e674eaa57664 req-ff576288-4611-4f4f-a3b4-04b371a40c63 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060855 Apr 06 16:40:25.522395 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 122/223] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:40:25.772529 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2e4c04b2-1696-4d29-b956-ff5df614ea9c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:25.773488 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2e4c04b2-1696-4d29-b956-ff5df614ea9c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:25.792930 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e4c04b2-1696-4d29-b956-ff5df614ea9c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:25.793908 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e4c04b2-1696-4d29-b956-ff5df614ea9c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:25.795225 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e4c04b2-1696-4d29-b956-ff5df614ea9c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:25.795912 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e4c04b2-1696-4d29-b956-ff5df614ea9c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:25.826860 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4b339e06-e71e-4f79-a4aa-cb47d243f2e7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "POST /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.692064 Apr 06 16:40:25.827899 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 102/224] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Apr 6 16:40:25 2022] POST /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 194 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:40:26.011670 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2e4c04b2-1696-4d29-b956-ff5df614ea9c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:26.019421 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2e4c04b2-1696-4d29-b956-ff5df614ea9c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.253818 Apr 06 16:40:26.020048 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 123/225] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:25 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:26.480618 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dca08ff0-1b31-44f0-a68c-f3cb21df7c7c tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:26.481356 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dca08ff0-1b31-44f0-a68c-f3cb21df7c7c tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] [instance: 818d6923-3f75-4112-9216-bba7fa5bbf88] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:26.490485 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dca08ff0-1b31-44f0-a68c-f3cb21df7c7c tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:26.490927 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dca08ff0-1b31-44f0-a68c-f3cb21df7c7c tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:26.491739 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dca08ff0-1b31-44f0-a68c-f3cb21df7c7c tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:26.492525 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dca08ff0-1b31-44f0-a68c-f3cb21df7c7c tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:26.656302 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-dca08ff0-1b31-44f0-a68c-f3cb21df7c7c tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81273fe2a1844bb3a9a5c48790ce6417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127cc8879ee44406ab28383812296e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:26.664710 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dca08ff0-1b31-44f0-a68c-f3cb21df7c7c tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] 10.222.0.64 "GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88" status: 200 len: 1314 microversion: 2.1 time: 0.191303 Apr 06 16:40:26.665714 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 103/226] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:26 2022] GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:27.036617 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4809aece-46ab-459a-8137-60bb64a567d3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:27.037236 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4809aece-46ab-459a-8137-60bb64a567d3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:27.045542 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4809aece-46ab-459a-8137-60bb64a567d3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:27.045976 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4809aece-46ab-459a-8137-60bb64a567d3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:27.046754 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4809aece-46ab-459a-8137-60bb64a567d3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:27.047185 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4809aece-46ab-459a-8137-60bb64a567d3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:27.206430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4809aece-46ab-459a-8137-60bb64a567d3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:27.214075 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4809aece-46ab-459a-8137-60bb64a567d3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.181388 Apr 06 16:40:27.214850 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 124/227] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:27 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:27.682289 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-09a0e39d-b9c1-4114-aa2c-9bcf1c747c85 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:27.682977 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-09a0e39d-b9c1-4114-aa2c-9bcf1c747c85 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] [instance: 818d6923-3f75-4112-9216-bba7fa5bbf88] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:27.690331 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09a0e39d-b9c1-4114-aa2c-9bcf1c747c85 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:27.690659 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09a0e39d-b9c1-4114-aa2c-9bcf1c747c85 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:27.691541 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09a0e39d-b9c1-4114-aa2c-9bcf1c747c85 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:27.691984 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09a0e39d-b9c1-4114-aa2c-9bcf1c747c85 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:27.942358 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-09a0e39d-b9c1-4114-aa2c-9bcf1c747c85 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81273fe2a1844bb3a9a5c48790ce6417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127cc8879ee44406ab28383812296e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:27.950844 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-09a0e39d-b9c1-4114-aa2c-9bcf1c747c85 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] 10.222.0.64 "GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88" status: 200 len: 1314 microversion: 2.1 time: 0.272497 Apr 06 16:40:27.951434 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 104/228] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:27 2022] GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:28.233265 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e2727bad-a80a-48b4-b82a-85e55d245024 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:28.233868 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e2727bad-a80a-48b4-b82a-85e55d245024 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:28.240018 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2727bad-a80a-48b4-b82a-85e55d245024 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:28.240495 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2727bad-a80a-48b4-b82a-85e55d245024 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:28.241296 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2727bad-a80a-48b4-b82a-85e55d245024 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:28.241729 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2727bad-a80a-48b4-b82a-85e55d245024 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:28.408365 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e2727bad-a80a-48b4-b82a-85e55d245024 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:28.416199 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e2727bad-a80a-48b4-b82a-85e55d245024 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.187464 Apr 06 16:40:28.417258 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 125/229] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:28 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:28.974402 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2a0b1cd3-7dbc-4df3-b04b-1b47ec3e0c2b tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:28.975152 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2a0b1cd3-7dbc-4df3-b04b-1b47ec3e0c2b tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] [instance: 818d6923-3f75-4112-9216-bba7fa5bbf88] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:28.982208 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a0b1cd3-7dbc-4df3-b04b-1b47ec3e0c2b tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:28.982671 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a0b1cd3-7dbc-4df3-b04b-1b47ec3e0c2b tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:28.983463 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a0b1cd3-7dbc-4df3-b04b-1b47ec3e0c2b tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:28.983895 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a0b1cd3-7dbc-4df3-b04b-1b47ec3e0c2b tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:29.013246 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0577972a-413d-462d-bec6-e45485d0aa2f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:29.013731 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0577972a-413d-462d-bec6-e45485d0aa2f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:29.020265 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0577972a-413d-462d-bec6-e45485d0aa2f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:29.020776 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0577972a-413d-462d-bec6-e45485d0aa2f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:29.021500 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0577972a-413d-462d-bec6-e45485d0aa2f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:29.021911 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0577972a-413d-462d-bec6-e45485d0aa2f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:29.047742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0577972a-413d-462d-bec6-e45485d0aa2f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/ips" status: 200 len: 151 microversion: 2.20 time: 0.039534 Apr 06 16:40:29.048450 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 126/230] 10.222.0.64 () {60 vars in 1288 bytes} [Wed Apr 6 16:40:29 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:40:29.136353 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2a0b1cd3-7dbc-4df3-b04b-1b47ec3e0c2b tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81273fe2a1844bb3a9a5c48790ce6417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127cc8879ee44406ab28383812296e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:29.143815 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2a0b1cd3-7dbc-4df3-b04b-1b47ec3e0c2b tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] 10.222.0.64 "GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88" status: 200 len: 1314 microversion: 2.1 time: 0.173976 Apr 06 16:40:29.144384 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 105/231] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:28 2022] GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:29.433554 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2a622e48-349e-4ccc-b2f8-2c2ebd516666 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:29.434468 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2a622e48-349e-4ccc-b2f8-2c2ebd516666 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:29.441735 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a622e48-349e-4ccc-b2f8-2c2ebd516666 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:29.442266 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a622e48-349e-4ccc-b2f8-2c2ebd516666 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:29.443608 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a622e48-349e-4ccc-b2f8-2c2ebd516666 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:29.444180 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a622e48-349e-4ccc-b2f8-2c2ebd516666 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:29.593261 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2a622e48-349e-4ccc-b2f8-2c2ebd516666 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:29.604120 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2a622e48-349e-4ccc-b2f8-2c2ebd516666 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.174955 Apr 06 16:40:29.604755 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 127/232] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:29 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:30.162830 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bfd5639f-1ee5-4e65-bdff-e7ea4f25f2f6 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:30.163507 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bfd5639f-1ee5-4e65-bdff-e7ea4f25f2f6 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] [instance: 818d6923-3f75-4112-9216-bba7fa5bbf88] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:30.172309 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bfd5639f-1ee5-4e65-bdff-e7ea4f25f2f6 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:30.173059 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bfd5639f-1ee5-4e65-bdff-e7ea4f25f2f6 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:30.173852 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bfd5639f-1ee5-4e65-bdff-e7ea4f25f2f6 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:30.174290 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bfd5639f-1ee5-4e65-bdff-e7ea4f25f2f6 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:30.325923 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-bfd5639f-1ee5-4e65-bdff-e7ea4f25f2f6 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81273fe2a1844bb3a9a5c48790ce6417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127cc8879ee44406ab28383812296e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:30.334086 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bfd5639f-1ee5-4e65-bdff-e7ea4f25f2f6 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] 10.222.0.64 "GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88" status: 200 len: 1314 microversion: 2.1 time: 0.176154 Apr 06 16:40:30.334722 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 106/233] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:30 2022] GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:30.623143 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b9cb8a26-246c-4915-9f47-516a85379aec tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:30.623794 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b9cb8a26-246c-4915-9f47-516a85379aec tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:30.630545 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9cb8a26-246c-4915-9f47-516a85379aec tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:30.631106 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9cb8a26-246c-4915-9f47-516a85379aec tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:30.631935 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9cb8a26-246c-4915-9f47-516a85379aec tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:30.632368 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9cb8a26-246c-4915-9f47-516a85379aec tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:30.790197 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b9cb8a26-246c-4915-9f47-516a85379aec tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:30.798499 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b9cb8a26-246c-4915-9f47-516a85379aec tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.180062 Apr 06 16:40:30.799400 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 128/234] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:30 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:31.351536 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8d6aae4f-958e-4d16-859d-eb00a96c1592 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:31.352089 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8d6aae4f-958e-4d16-859d-eb00a96c1592 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] [instance: 818d6923-3f75-4112-9216-bba7fa5bbf88] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:31.358996 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d6aae4f-958e-4d16-859d-eb00a96c1592 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:31.359440 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d6aae4f-958e-4d16-859d-eb00a96c1592 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:31.360217 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d6aae4f-958e-4d16-859d-eb00a96c1592 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:31.360609 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d6aae4f-958e-4d16-859d-eb00a96c1592 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:31.447153 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ef65f1ee-e8c7-4603-bf09-8a0bbf17f0af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:40:31.447798 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ef65f1ee-e8c7-4603-bf09-8a0bbf17f0af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:31.456423 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef65f1ee-e8c7-4603-bf09-8a0bbf17f0af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:31.457001 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef65f1ee-e8c7-4603-bf09-8a0bbf17f0af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:31.457876 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef65f1ee-e8c7-4603-bf09-8a0bbf17f0af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:31.458544 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef65f1ee-e8c7-4603-bf09-8a0bbf17f0af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:31.489087 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-ef65f1ee-e8c7-4603-bf09-8a0bbf17f0af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lazy-loading 'flavor' on Instance uuid 330d17b1-0d7d-4519-8dc3-3210eb25aa3c {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 06 16:40:31.506508 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8d6aae4f-958e-4d16-859d-eb00a96c1592 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81273fe2a1844bb3a9a5c48790ce6417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127cc8879ee44406ab28383812296e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:31.514976 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8d6aae4f-958e-4d16-859d-eb00a96c1592 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] 10.222.0.64 "GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88" status: 200 len: 1314 microversion: 2.1 time: 0.167291 Apr 06 16:40:31.515932 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 107/235] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:31 2022] GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:31.800841 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ef65f1ee-e8c7-4603-bf09-8a0bbf17f0af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "POST /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/action" status: 202 len: 0 microversion: 2.20 time: 0.358449 Apr 06 16:40:31.801362 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 129/236] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Apr 6 16:40:31 2022] POST /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 06 16:40:31.810109 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ce895e91-0e69-4e5f-b058-ccab505d2e7c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:31.810740 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ce895e91-0e69-4e5f-b058-ccab505d2e7c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:31.817269 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce895e91-0e69-4e5f-b058-ccab505d2e7c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:31.817717 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce895e91-0e69-4e5f-b058-ccab505d2e7c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:31.818100 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e77d27cf-5c0b-414e-825a-21b01587e160 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:31.818538 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce895e91-0e69-4e5f-b058-ccab505d2e7c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:31.818795 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e77d27cf-5c0b-414e-825a-21b01587e160 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:31.818985 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce895e91-0e69-4e5f-b058-ccab505d2e7c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:31.826739 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e77d27cf-5c0b-414e-825a-21b01587e160 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:31.827496 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e77d27cf-5c0b-414e-825a-21b01587e160 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:31.829915 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e77d27cf-5c0b-414e-825a-21b01587e160 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:31.830664 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e77d27cf-5c0b-414e-825a-21b01587e160 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:31.989782 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e77d27cf-5c0b-414e-825a-21b01587e160 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:32.000986 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e77d27cf-5c0b-414e-825a-21b01587e160 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.186787 Apr 06 16:40:32.002039 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 130/237] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:31 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:32.005815 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ce895e91-0e69-4e5f-b058-ccab505d2e7c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:32.016663 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ce895e91-0e69-4e5f-b058-ccab505d2e7c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:32.018584 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ce895e91-0e69-4e5f-b058-ccab505d2e7c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:32.019836 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ce895e91-0e69-4e5f-b058-ccab505d2e7c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1722 microversion: 2.20 time: 0.213907 Apr 06 16:40:32.020568 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 108/238] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:40:31 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:40:32.149028 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-f73ecadc-8bca-4018-9bc1-e008e0a21bdc req-dcbd404f-b85f-49fc-9ab6-bddf849abd00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818d6923-3f75-4112-9216-bba7fa5bbf88", "name": "network-vif-plugged", "status": "completed", "tag": "d32f22cb-e61a-4f96-97bc-45c33303eb7e"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:40:32.159774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f73ecadc-8bca-4018-9bc1-e008e0a21bdc req-dcbd404f-b85f-49fc-9ab6-bddf849abd00 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:32.160243 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f73ecadc-8bca-4018-9bc1-e008e0a21bdc req-dcbd404f-b85f-49fc-9ab6-bddf849abd00 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:32.179186 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-f73ecadc-8bca-4018-9bc1-e008e0a21bdc req-dcbd404f-b85f-49fc-9ab6-bddf849abd00 service nova] Creating event network-vif-plugged:d32f22cb-e61a-4f96-97bc-45c33303eb7e for instance 818d6923-3f75-4112-9216-bba7fa5bbf88 on hv-cinder-83684 Apr 06 16:40:32.185732 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-f73ecadc-8bca-4018-9bc1-e008e0a21bdc req-dcbd404f-b85f-49fc-9ab6-bddf849abd00 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039844 Apr 06 16:40:32.186725 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 131/239] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:40:32.531863 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-82d66797-eec2-4edd-812f-1cad50d61a85 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:32.532414 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-82d66797-eec2-4edd-812f-1cad50d61a85 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] [instance: 818d6923-3f75-4112-9216-bba7fa5bbf88] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:32.539204 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82d66797-eec2-4edd-812f-1cad50d61a85 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:32.539753 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82d66797-eec2-4edd-812f-1cad50d61a85 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:32.540537 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82d66797-eec2-4edd-812f-1cad50d61a85 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:32.541016 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82d66797-eec2-4edd-812f-1cad50d61a85 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:32.707145 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-82d66797-eec2-4edd-812f-1cad50d61a85 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81273fe2a1844bb3a9a5c48790ce6417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127cc8879ee44406ab28383812296e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:32.714965 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-82d66797-eec2-4edd-812f-1cad50d61a85 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] 10.222.0.64 "GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88" status: 200 len: 1314 microversion: 2.1 time: 0.186751 Apr 06 16:40:32.715553 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 109/240] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:32 2022] GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:33.024243 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c1114e17-b81b-4e0b-a7aa-1358cc8b873d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:33.024976 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c1114e17-b81b-4e0b-a7aa-1358cc8b873d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:33.031776 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1114e17-b81b-4e0b-a7aa-1358cc8b873d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:33.032224 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1114e17-b81b-4e0b-a7aa-1358cc8b873d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:33.033002 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1114e17-b81b-4e0b-a7aa-1358cc8b873d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:33.033431 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1114e17-b81b-4e0b-a7aa-1358cc8b873d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:33.039517 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-71f756f3-63ef-4792-9d74-9a9cfb1525ad tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:33.040163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-71f756f3-63ef-4792-9d74-9a9cfb1525ad tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:33.046786 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71f756f3-63ef-4792-9d74-9a9cfb1525ad tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:33.047240 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71f756f3-63ef-4792-9d74-9a9cfb1525ad tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:33.048017 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71f756f3-63ef-4792-9d74-9a9cfb1525ad tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:33.048902 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71f756f3-63ef-4792-9d74-9a9cfb1525ad tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:33.178001 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c1114e17-b81b-4e0b-a7aa-1358cc8b873d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:33.186398 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c1114e17-b81b-4e0b-a7aa-1358cc8b873d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.166416 Apr 06 16:40:33.187228 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 132/241] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:33 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:33.201314 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-71f756f3-63ef-4792-9d74-9a9cfb1525ad tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:33.204007 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-71f756f3-63ef-4792-9d74-9a9cfb1525ad tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:33.205792 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-71f756f3-63ef-4792-9d74-9a9cfb1525ad tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:33.207011 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-71f756f3-63ef-4792-9d74-9a9cfb1525ad tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1722 microversion: 2.20 time: 0.171363 Apr 06 16:40:33.207584 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 110/242] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:40:33 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:40:33.257741 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6b258ce3-7509-4587-bf8e-555b4ad0a688 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:40:33.264316 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b258ce3-7509-4587-bf8e-555b4ad0a688 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:33.264791 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b258ce3-7509-4587-bf8e-555b4ad0a688 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:33.328410 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6b258ce3-7509-4587-bf8e-555b4ad0a688 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Going to try to stop instance {{(pid=128861) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 06 16:40:33.373790 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6b258ce3-7509-4587-bf8e-555b4ad0a688 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "POST /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/action" status: 202 len: 0 microversion: 2.1 time: 0.119767 Apr 06 16:40:33.374415 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 133/243] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Apr 6 16:40:33 2022] POST /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 06 16:40:33.382556 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-75035555-56de-430f-af3b-4dee1021e466 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:33.383159 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-75035555-56de-430f-af3b-4dee1021e466 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:33.390358 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75035555-56de-430f-af3b-4dee1021e466 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:33.390804 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75035555-56de-430f-af3b-4dee1021e466 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:33.391664 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75035555-56de-430f-af3b-4dee1021e466 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:33.392038 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75035555-56de-430f-af3b-4dee1021e466 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:33.544244 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-75035555-56de-430f-af3b-4dee1021e466 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:33.552291 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-75035555-56de-430f-af3b-4dee1021e466 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1723 microversion: 2.1 time: 0.173599 Apr 06 16:40:33.552885 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 111/244] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:33 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:33.733667 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5d2dba93-d9c2-4d41-82fa-fb188bf6dcbe tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:33.734973 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5d2dba93-d9c2-4d41-82fa-fb188bf6dcbe tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] [instance: 818d6923-3f75-4112-9216-bba7fa5bbf88] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:33.745467 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d2dba93-d9c2-4d41-82fa-fb188bf6dcbe tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:33.746320 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d2dba93-d9c2-4d41-82fa-fb188bf6dcbe tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:33.747362 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d2dba93-d9c2-4d41-82fa-fb188bf6dcbe tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:33.747948 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d2dba93-d9c2-4d41-82fa-fb188bf6dcbe tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:34.125239 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5d2dba93-d9c2-4d41-82fa-fb188bf6dcbe tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81273fe2a1844bb3a9a5c48790ce6417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127cc8879ee44406ab28383812296e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:34.133933 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5d2dba93-d9c2-4d41-82fa-fb188bf6dcbe tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] 10.222.0.64 "GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88" status: 200 len: 1314 microversion: 2.1 time: 0.405771 Apr 06 16:40:34.134773 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 134/245] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:33 2022] GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88 => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:34.203714 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4cfa630d-853a-4df1-a9d4-f994738b403e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:34.204352 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4cfa630d-853a-4df1-a9d4-f994738b403e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:34.212414 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cfa630d-853a-4df1-a9d4-f994738b403e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:34.212896 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cfa630d-853a-4df1-a9d4-f994738b403e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:34.213917 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cfa630d-853a-4df1-a9d4-f994738b403e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:34.214715 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cfa630d-853a-4df1-a9d4-f994738b403e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:34.226202 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-89905671-fdf9-4864-973d-09ca508c06fd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:34.226800 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-89905671-fdf9-4864-973d-09ca508c06fd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:34.233748 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89905671-fdf9-4864-973d-09ca508c06fd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:34.234188 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89905671-fdf9-4864-973d-09ca508c06fd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:34.234965 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89905671-fdf9-4864-973d-09ca508c06fd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:34.235426 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89905671-fdf9-4864-973d-09ca508c06fd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:34.367873 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4cfa630d-853a-4df1-a9d4-f994738b403e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:34.376514 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4cfa630d-853a-4df1-a9d4-f994738b403e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.176462 Apr 06 16:40:34.377146 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 112/246] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:34 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:34.395241 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-89905671-fdf9-4864-973d-09ca508c06fd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:34.403564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-89905671-fdf9-4864-973d-09ca508c06fd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:34.405079 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-89905671-fdf9-4864-973d-09ca508c06fd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:34.406220 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-89905671-fdf9-4864-973d-09ca508c06fd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1722 microversion: 2.20 time: 0.184056 Apr 06 16:40:34.406782 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 135/247] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:40:34 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:40:34.571496 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-14fcd422-4457-499b-b032-f4a0ab2c31e1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:34.572071 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-14fcd422-4457-499b-b032-f4a0ab2c31e1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:34.579271 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14fcd422-4457-499b-b032-f4a0ab2c31e1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:34.579696 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14fcd422-4457-499b-b032-f4a0ab2c31e1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:34.580485 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14fcd422-4457-499b-b032-f4a0ab2c31e1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:34.580948 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14fcd422-4457-499b-b032-f4a0ab2c31e1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:34.718660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-14fcd422-4457-499b-b032-f4a0ab2c31e1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:34.727424 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-14fcd422-4457-499b-b032-f4a0ab2c31e1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1723 microversion: 2.1 time: 0.159922 Apr 06 16:40:34.728004 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 113/248] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:34 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:35.151477 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c451d116-881b-4199-9269-f7c207d88e9a tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:35.152382 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c451d116-881b-4199-9269-f7c207d88e9a tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] [instance: 818d6923-3f75-4112-9216-bba7fa5bbf88] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:35.158549 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c451d116-881b-4199-9269-f7c207d88e9a tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:35.158974 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c451d116-881b-4199-9269-f7c207d88e9a tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:35.160063 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c451d116-881b-4199-9269-f7c207d88e9a tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:35.160536 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c451d116-881b-4199-9269-f7c207d88e9a tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:35.251805 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2972f0e7-8d4f-471d-bf45-e7de47f5666f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbbe8c60-22f6-4714-96ab-22de9b423d20", "device": "/dev/sdb"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:40:35.253743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2972f0e7-8d4f-471d-bf45-e7de47f5666f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:35.261639 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2972f0e7-8d4f-471d-bf45-e7de47f5666f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:35.262585 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2972f0e7-8d4f-471d-bf45-e7de47f5666f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:35.263521 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2972f0e7-8d4f-471d-bf45-e7de47f5666f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:35.264261 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2972f0e7-8d4f-471d-bf45-e7de47f5666f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:35.319312 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c451d116-881b-4199-9269-f7c207d88e9a tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81273fe2a1844bb3a9a5c48790ce6417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127cc8879ee44406ab28383812296e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:35.327868 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c451d116-881b-4199-9269-f7c207d88e9a tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] 10.222.0.64 "GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88" status: 200 len: 1464 microversion: 2.1 time: 0.180444 Apr 06 16:40:35.328446 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 136/249] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:35 2022] GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88 => generated 1464 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:35.370804 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-33869290-d50a-4a64-ae20-9d9f91907460 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:35.371290 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-33869290-d50a-4a64-ae20-9d9f91907460 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] [instance: 818d6923-3f75-4112-9216-bba7fa5bbf88] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:35.377288 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33869290-d50a-4a64-ae20-9d9f91907460 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:35.377714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33869290-d50a-4a64-ae20-9d9f91907460 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:35.378499 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33869290-d50a-4a64-ae20-9d9f91907460 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:35.378923 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33869290-d50a-4a64-ae20-9d9f91907460 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:35.405635 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-33869290-d50a-4a64-ae20-9d9f91907460 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] [instance: 818d6923-3f75-4112-9216-bba7fa5bbf88] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 06 16:40:35.499696 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-33869290-d50a-4a64-ae20-9d9f91907460 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] 10.222.0.64 "DELETE /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88" status: 204 len: 0 microversion: 2.1 time: 0.132842 Apr 06 16:40:35.500364 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 137/250] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 16:40:35 2022] DELETE /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 06 16:40:35.508286 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-54dffeea-2e06-4913-9dce-6b032f13461b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:35.508995 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-54dffeea-2e06-4913-9dce-6b032f13461b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:35.515330 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54dffeea-2e06-4913-9dce-6b032f13461b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:35.515771 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54dffeea-2e06-4913-9dce-6b032f13461b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:35.516540 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54dffeea-2e06-4913-9dce-6b032f13461b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:35.516995 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54dffeea-2e06-4913-9dce-6b032f13461b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:35.581261 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2972f0e7-8d4f-471d-bf45-e7de47f5666f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "POST /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333714 Apr 06 16:40:35.581942 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 114/251] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Apr 6 16:40:35 2022] POST /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:40:35.592432 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1237c8cc-691b-4ab2-aa8b-cf658b97e4f1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:35.593750 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1237c8cc-691b-4ab2-aa8b-cf658b97e4f1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:35.606726 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1237c8cc-691b-4ab2-aa8b-cf658b97e4f1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:35.607509 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1237c8cc-691b-4ab2-aa8b-cf658b97e4f1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:35.608635 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1237c8cc-691b-4ab2-aa8b-cf658b97e4f1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:35.609532 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1237c8cc-691b-4ab2-aa8b-cf658b97e4f1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:35.678415 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-54dffeea-2e06-4913-9dce-6b032f13461b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:35.687737 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-54dffeea-2e06-4913-9dce-6b032f13461b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.183336 Apr 06 16:40:35.688329 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 138/252] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:35 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:35.692962 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a0b7aa31-d934-402e-87b0-7ee68127d3a2 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:35.693850 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a0b7aa31-d934-402e-87b0-7ee68127d3a2 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] [instance: 818d6923-3f75-4112-9216-bba7fa5bbf88] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:35.700408 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0b7aa31-d934-402e-87b0-7ee68127d3a2 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:35.700883 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0b7aa31-d934-402e-87b0-7ee68127d3a2 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:35.701755 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0b7aa31-d934-402e-87b0-7ee68127d3a2 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:35.702367 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0b7aa31-d934-402e-87b0-7ee68127d3a2 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:35.780583 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1237c8cc-691b-4ab2-aa8b-cf658b97e4f1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:35.795246 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1237c8cc-691b-4ab2-aa8b-cf658b97e4f1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:35.798151 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1237c8cc-691b-4ab2-aa8b-cf658b97e4f1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:35.800346 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1237c8cc-691b-4ab2-aa8b-cf658b97e4f1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1722 microversion: 2.20 time: 0.216611 Apr 06 16:40:35.801372 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 115/253] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:40:35 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:40:35.810058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-76da196c-05fc-40b2-9ff0-9cbf505dadf5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:35.811114 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-76da196c-05fc-40b2-9ff0-9cbf505dadf5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:35.818898 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76da196c-05fc-40b2-9ff0-9cbf505dadf5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:35.819428 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76da196c-05fc-40b2-9ff0-9cbf505dadf5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:35.820270 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76da196c-05fc-40b2-9ff0-9cbf505dadf5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:35.820810 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76da196c-05fc-40b2-9ff0-9cbf505dadf5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:35.873938 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a0b7aa31-d934-402e-87b0-7ee68127d3a2 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81273fe2a1844bb3a9a5c48790ce6417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127cc8879ee44406ab28383812296e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:35.883339 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a0b7aa31-d934-402e-87b0-7ee68127d3a2 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] 10.222.0.64 "GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88" status: 200 len: 1470 microversion: 2.1 time: 0.193926 Apr 06 16:40:35.884064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 139/254] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:35 2022] GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88 => generated 1470 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:35.965793 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-76da196c-05fc-40b2-9ff0-9cbf505dadf5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:35.979821 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-76da196c-05fc-40b2-9ff0-9cbf505dadf5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1723 microversion: 2.1 time: 0.175728 Apr 06 16:40:35.980583 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 116/255] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:35 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:36.706177 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-80e3739d-6aa3-4f0a-9552-3b6bc52733f7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:36.706877 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-80e3739d-6aa3-4f0a-9552-3b6bc52733f7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:36.713471 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80e3739d-6aa3-4f0a-9552-3b6bc52733f7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:36.714093 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80e3739d-6aa3-4f0a-9552-3b6bc52733f7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:36.715487 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80e3739d-6aa3-4f0a-9552-3b6bc52733f7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:36.715985 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80e3739d-6aa3-4f0a-9552-3b6bc52733f7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:36.819822 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-58b9be7a-3ab7-4a37-9139-ae534be653bb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:36.820396 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-58b9be7a-3ab7-4a37-9139-ae534be653bb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:36.827237 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58b9be7a-3ab7-4a37-9139-ae534be653bb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:36.827693 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58b9be7a-3ab7-4a37-9139-ae534be653bb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:36.828479 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58b9be7a-3ab7-4a37-9139-ae534be653bb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:36.829080 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58b9be7a-3ab7-4a37-9139-ae534be653bb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:36.953299 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-80e3739d-6aa3-4f0a-9552-3b6bc52733f7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:36.961082 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-80e3739d-6aa3-4f0a-9552-3b6bc52733f7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.258887 Apr 06 16:40:36.961933 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 140/256] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:36 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:36.970581 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-58b9be7a-3ab7-4a37-9139-ae534be653bb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:36.977039 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-175c55ff-1013-44d0-82a1-772c9cdc7978 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:36.977636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-175c55ff-1013-44d0-82a1-772c9cdc7978 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] [instance: 818d6923-3f75-4112-9216-bba7fa5bbf88] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:36.978797 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-58b9be7a-3ab7-4a37-9139-ae534be653bb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:36.980626 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-58b9be7a-3ab7-4a37-9139-ae534be653bb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:36.982316 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-58b9be7a-3ab7-4a37-9139-ae534be653bb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1722 microversion: 2.20 time: 0.166609 Apr 06 16:40:36.982982 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 117/257] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:40:36 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:40:36.993014 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-175c55ff-1013-44d0-82a1-772c9cdc7978 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:36.993014 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-175c55ff-1013-44d0-82a1-772c9cdc7978 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:36.993014 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-175c55ff-1013-44d0-82a1-772c9cdc7978 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:36.993014 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-175c55ff-1013-44d0-82a1-772c9cdc7978 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:37.002990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d00d6425-7adc-4076-9afd-4bea7877c79a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:37.003598 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d00d6425-7adc-4076-9afd-4bea7877c79a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:37.009504 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d00d6425-7adc-4076-9afd-4bea7877c79a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:37.009961 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d00d6425-7adc-4076-9afd-4bea7877c79a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:37.010893 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d00d6425-7adc-4076-9afd-4bea7877c79a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:37.011489 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d00d6425-7adc-4076-9afd-4bea7877c79a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:37.155693 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d00d6425-7adc-4076-9afd-4bea7877c79a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:37.166502 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d00d6425-7adc-4076-9afd-4bea7877c79a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1723 microversion: 2.1 time: 0.167271 Apr 06 16:40:37.167231 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 118/258] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:36 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:37.250342 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-175c55ff-1013-44d0-82a1-772c9cdc7978 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81273fe2a1844bb3a9a5c48790ce6417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127cc8879ee44406ab28383812296e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:37.258262 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-175c55ff-1013-44d0-82a1-772c9cdc7978 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] 10.222.0.64 "GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88" status: 200 len: 1470 microversion: 2.1 time: 0.284831 Apr 06 16:40:37.259178 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 141/259] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:36 2022] GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88 => generated 1470 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:37.978780 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e432029e-586d-4aa5-b752-fe5945409855 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:37.979622 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e432029e-586d-4aa5-b752-fe5945409855 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:37.986622 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e432029e-586d-4aa5-b752-fe5945409855 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:37.987059 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e432029e-586d-4aa5-b752-fe5945409855 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:37.987845 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e432029e-586d-4aa5-b752-fe5945409855 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:37.988274 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e432029e-586d-4aa5-b752-fe5945409855 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:38.008813 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b525cc20-d6a7-419f-9a62-1cddc710e5b6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:38.009416 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b525cc20-d6a7-419f-9a62-1cddc710e5b6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:38.018081 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b525cc20-d6a7-419f-9a62-1cddc710e5b6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:38.019206 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b525cc20-d6a7-419f-9a62-1cddc710e5b6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:38.021042 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b525cc20-d6a7-419f-9a62-1cddc710e5b6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:38.022040 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b525cc20-d6a7-419f-9a62-1cddc710e5b6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:38.295197 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b525cc20-d6a7-419f-9a62-1cddc710e5b6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:38.304884 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b525cc20-d6a7-419f-9a62-1cddc710e5b6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:38.307790 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b525cc20-d6a7-419f-9a62-1cddc710e5b6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:38.309211 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b525cc20-d6a7-419f-9a62-1cddc710e5b6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1722 microversion: 2.20 time: 0.305916 Apr 06 16:40:38.314489 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 142/260] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:40:38 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1722 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:40:38.319877 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e4db338b-0730-4e25-ae09-234a5c6f81e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:38.322246 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e4db338b-0730-4e25-ae09-234a5c6f81e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:38.327598 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e432029e-586d-4aa5-b752-fe5945409855 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:38.329725 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4db338b-0730-4e25-ae09-234a5c6f81e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:38.330476 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4db338b-0730-4e25-ae09-234a5c6f81e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:38.331442 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4db338b-0730-4e25-ae09-234a5c6f81e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:38.332108 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4db338b-0730-4e25-ae09-234a5c6f81e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:38.342179 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e432029e-586d-4aa5-b752-fe5945409855 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.367289 Apr 06 16:40:38.342779 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 119/261] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:37 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:38.360354 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-19444ee0-7d65-4dcd-9dda-4de5fbb4a7e0 req-d4c4c280-7ccf-4d22-940e-abaecd3b01d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818d6923-3f75-4112-9216-bba7fa5bbf88", "name": "network-vif-deleted", "tag": "d32f22cb-e61a-4f96-97bc-45c33303eb7e"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:40:38.374136 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-19444ee0-7d65-4dcd-9dda-4de5fbb4a7e0 req-d4c4c280-7ccf-4d22-940e-abaecd3b01d7 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:38.375774 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-19444ee0-7d65-4dcd-9dda-4de5fbb4a7e0 req-d4c4c280-7ccf-4d22-940e-abaecd3b01d7 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:38.392851 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-19444ee0-7d65-4dcd-9dda-4de5fbb4a7e0 req-d4c4c280-7ccf-4d22-940e-abaecd3b01d7 service nova] Creating event network-vif-deleted:d32f22cb-e61a-4f96-97bc-45c33303eb7e for instance 818d6923-3f75-4112-9216-bba7fa5bbf88 on hv-cinder-83684 Apr 06 16:40:38.409035 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-19444ee0-7d65-4dcd-9dda-4de5fbb4a7e0 req-d4c4c280-7ccf-4d22-940e-abaecd3b01d7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058056 Apr 06 16:40:38.410290 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 120/262] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:40:38.418830 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-96bb6f8b-859c-4420-a0b4-afb70d008ef3 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:38.419918 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-96bb6f8b-859c-4420-a0b4-afb70d008ef3 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] [instance: 818d6923-3f75-4112-9216-bba7fa5bbf88] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:38.427095 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96bb6f8b-859c-4420-a0b4-afb70d008ef3 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:38.427548 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96bb6f8b-859c-4420-a0b4-afb70d008ef3 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:38.428734 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96bb6f8b-859c-4420-a0b4-afb70d008ef3 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:38.429564 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96bb6f8b-859c-4420-a0b4-afb70d008ef3 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:38.478780 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96bb6f8b-859c-4420-a0b4-afb70d008ef3 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:38.479671 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96bb6f8b-859c-4420-a0b4-afb70d008ef3 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:38.480329 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-96bb6f8b-859c-4420-a0b4-afb70d008ef3 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lazy-loading 'fault' on Instance uuid 818d6923-3f75-4112-9216-bba7fa5bbf88 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 06 16:40:38.518148 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e4db338b-0730-4e25-ae09-234a5c6f81e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:38.526483 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e4db338b-0730-4e25-ae09-234a5c6f81e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1723 microversion: 2.1 time: 0.210443 Apr 06 16:40:38.527155 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 143/263] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:38 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:38.537854 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-96bb6f8b-859c-4420-a0b4-afb70d008ef3 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81273fe2a1844bb3a9a5c48790ce6417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127cc8879ee44406ab28383812296e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:38.546523 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-96bb6f8b-859c-4420-a0b4-afb70d008ef3 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] 10.222.0.64 "GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88" status: 200 len: 1304 microversion: 2.1 time: 0.132388 Apr 06 16:40:38.547189 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 121/264] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:38 2022] GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88 => generated 1304 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:39.327802 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-34f23904-2ed3-401b-90b6-94be17a800f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:39.329082 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-34f23904-2ed3-401b-90b6-94be17a800f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:39.335353 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34f23904-2ed3-401b-90b6-94be17a800f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:39.335791 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34f23904-2ed3-401b-90b6-94be17a800f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:39.336608 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34f23904-2ed3-401b-90b6-94be17a800f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:39.337103 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34f23904-2ed3-401b-90b6-94be17a800f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:39.359593 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2e644245-fa70-4465-a052-f7db12ae5425 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:39.361998 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2e644245-fa70-4465-a052-f7db12ae5425 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:39.370484 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e644245-fa70-4465-a052-f7db12ae5425 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:39.371672 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e644245-fa70-4465-a052-f7db12ae5425 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:39.372498 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e644245-fa70-4465-a052-f7db12ae5425 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:39.373150 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e644245-fa70-4465-a052-f7db12ae5425 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:39.494055 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-34f23904-2ed3-401b-90b6-94be17a800f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:39.503352 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-34f23904-2ed3-401b-90b6-94be17a800f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:39.505158 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-34f23904-2ed3-401b-90b6-94be17a800f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:39.506507 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-34f23904-2ed3-401b-90b6-94be17a800f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1722 microversion: 2.20 time: 0.182944 Apr 06 16:40:39.516788 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 144/265] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:40:39 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:40:39.536481 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2e644245-fa70-4465-a052-f7db12ae5425 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:39.545227 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-34854e9f-6908-49a7-a1d1-cdf78a00d6ad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:39.545468 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2e644245-fa70-4465-a052-f7db12ae5425 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.189505 Apr 06 16:40:39.545862 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-34854e9f-6908-49a7-a1d1-cdf78a00d6ad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:39.553676 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34854e9f-6908-49a7-a1d1-cdf78a00d6ad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:39.554456 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34854e9f-6908-49a7-a1d1-cdf78a00d6ad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:39.555699 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34854e9f-6908-49a7-a1d1-cdf78a00d6ad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:39.556209 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34854e9f-6908-49a7-a1d1-cdf78a00d6ad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:39.560306 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 122/266] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:39 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:39.565907 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-96120129-e5cc-42a9-a379-d09ee4673251 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:39.566574 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-96120129-e5cc-42a9-a379-d09ee4673251 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] [instance: 818d6923-3f75-4112-9216-bba7fa5bbf88] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:39.575132 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96120129-e5cc-42a9-a379-d09ee4673251 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:39.575598 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96120129-e5cc-42a9-a379-d09ee4673251 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:39.576361 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96120129-e5cc-42a9-a379-d09ee4673251 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:39.576819 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96120129-e5cc-42a9-a379-d09ee4673251 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:39.631287 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96120129-e5cc-42a9-a379-d09ee4673251 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:39.631741 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96120129-e5cc-42a9-a379-d09ee4673251 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:39.632194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-96120129-e5cc-42a9-a379-d09ee4673251 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lazy-loading 'fault' on Instance uuid 818d6923-3f75-4112-9216-bba7fa5bbf88 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 06 16:40:39.707917 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-96120129-e5cc-42a9-a379-d09ee4673251 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81273fe2a1844bb3a9a5c48790ce6417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127cc8879ee44406ab28383812296e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:39.723720 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-96120129-e5cc-42a9-a379-d09ee4673251 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] 10.222.0.64 "GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88" status: 200 len: 1304 microversion: 2.1 time: 0.161789 Apr 06 16:40:39.733814 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 123/267] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:39 2022] GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88 => generated 1304 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:39.773082 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-34854e9f-6908-49a7-a1d1-cdf78a00d6ad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:39.782629 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-34854e9f-6908-49a7-a1d1-cdf78a00d6ad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1723 microversion: 2.1 time: 0.242260 Apr 06 16:40:39.783374 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 145/268] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:39 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:40.525731 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-08305bd0-799d-4b01-b8f3-620a0bf7c27b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:40.526275 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-08305bd0-799d-4b01-b8f3-620a0bf7c27b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:40.533524 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08305bd0-799d-4b01-b8f3-620a0bf7c27b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:40.533973 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08305bd0-799d-4b01-b8f3-620a0bf7c27b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:40.534747 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08305bd0-799d-4b01-b8f3-620a0bf7c27b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:40.535183 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08305bd0-799d-4b01-b8f3-620a0bf7c27b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:40.562341 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0a28b1b6-d5fd-41eb-bb2e-94e29f8cca5e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:40.562933 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0a28b1b6-d5fd-41eb-bb2e-94e29f8cca5e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:40.569511 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a28b1b6-d5fd-41eb-bb2e-94e29f8cca5e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:40.569964 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a28b1b6-d5fd-41eb-bb2e-94e29f8cca5e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:40.570741 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a28b1b6-d5fd-41eb-bb2e-94e29f8cca5e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:40.571169 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a28b1b6-d5fd-41eb-bb2e-94e29f8cca5e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:40.682463 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-08305bd0-799d-4b01-b8f3-620a0bf7c27b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:40.691629 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-08305bd0-799d-4b01-b8f3-620a0bf7c27b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:40.693369 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-08305bd0-799d-4b01-b8f3-620a0bf7c27b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:40.694474 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-08305bd0-799d-4b01-b8f3-620a0bf7c27b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1722 microversion: 2.20 time: 0.172936 Apr 06 16:40:40.695021 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 124/269] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:40:40 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:40:40.720839 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0a28b1b6-d5fd-41eb-bb2e-94e29f8cca5e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:40.728460 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0a28b1b6-d5fd-41eb-bb2e-94e29f8cca5e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.170471 Apr 06 16:40:40.729071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 146/270] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:40 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:40.741286 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a74453b8-80fc-40db-af45-dc0c9ac9b013 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:40.741882 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a74453b8-80fc-40db-af45-dc0c9ac9b013 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] [instance: 818d6923-3f75-4112-9216-bba7fa5bbf88] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:40.748431 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a74453b8-80fc-40db-af45-dc0c9ac9b013 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:40.748923 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a74453b8-80fc-40db-af45-dc0c9ac9b013 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:40.749688 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a74453b8-80fc-40db-af45-dc0c9ac9b013 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:40.750098 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a74453b8-80fc-40db-af45-dc0c9ac9b013 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:40.764878 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-a74453b8-80fc-40db-af45-dc0c9ac9b013 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] HTTP exception thrown: Instance 818d6923-3f75-4112-9216-bba7fa5bbf88 could not be found. Apr 06 16:40:40.765328 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a74453b8-80fc-40db-af45-dc0c9ac9b013 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] Returning 404 to user: Instance 818d6923-3f75-4112-9216-bba7fa5bbf88 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 16:40:40.766147 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a74453b8-80fc-40db-af45-dc0c9ac9b013 tempest-VolumesNegativeTest-49952696 tempest-VolumesNegativeTest-49952696-project] 10.222.0.64 "GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88" status: 404 len: 111 microversion: 2.1 time: 0.028887 Apr 06 16:40:40.766703 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 125/271] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:40 2022] GET /compute/v2.1/servers/818d6923-3f75-4112-9216-bba7fa5bbf88 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 16:40:40.800560 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ce73cec7-0730-4aec-bd01-d32b295491af tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:40.801210 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ce73cec7-0730-4aec-bd01-d32b295491af tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:40.807232 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce73cec7-0730-4aec-bd01-d32b295491af tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:40.807898 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce73cec7-0730-4aec-bd01-d32b295491af tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:40.809075 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce73cec7-0730-4aec-bd01-d32b295491af tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:40.809497 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce73cec7-0730-4aec-bd01-d32b295491af tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:40.822737 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b6f7271e-4795-43d1-9c6e-35555946b322 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Action: 'create', calling method: .version_select at 0x7fa9ca2368b0>, body: {"keypair": {"name": "tempest-keypair-266657953"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:40:40.837459 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-b6f7271e-4795-43d1-9c6e-35555946b322 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Getting quotas for project a7b211944dc94094801aa5dd3d20a401. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 16:40:40.843527 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-b6f7271e-4795-43d1-9c6e-35555946b322 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Getting quotas for user 22d0f09ff8c240a485a775d3c95d626b and project a7b211944dc94094801aa5dd3d20a401. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 16:40:40.964668 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ce73cec7-0730-4aec-bd01-d32b295491af tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:40.974231 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ce73cec7-0730-4aec-bd01-d32b295491af tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1723 microversion: 2.1 time: 0.177403 Apr 06 16:40:40.980503 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 147/272] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:40 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:41.115576 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-b6f7271e-4795-43d1-9c6e-35555946b322 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Getting quotas for project a7b211944dc94094801aa5dd3d20a401. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 16:40:41.121584 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-b6f7271e-4795-43d1-9c6e-35555946b322 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Getting quotas for user 22d0f09ff8c240a485a775d3c95d626b and project a7b211944dc94094801aa5dd3d20a401. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 16:40:41.135388 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b6f7271e-4795-43d1-9c6e-35555946b322 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.316402 Apr 06 16:40:41.136372 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 126/273] 10.222.0.64 () {60 vars in 1157 bytes} [Wed Apr 6 16:40:40 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:40:41.717814 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f4e50921-4b55-410d-9162-6c28faf4225f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:41.719905 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f4e50921-4b55-410d-9162-6c28faf4225f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:41.733350 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4e50921-4b55-410d-9162-6c28faf4225f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:41.733569 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4e50921-4b55-410d-9162-6c28faf4225f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:41.734572 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4e50921-4b55-410d-9162-6c28faf4225f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:41.735074 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4e50921-4b55-410d-9162-6c28faf4225f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:41.750157 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3b987dfd-f34b-4d46-b69c-a8ed977682cd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:41.750801 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3b987dfd-f34b-4d46-b69c-a8ed977682cd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:41.758107 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b987dfd-f34b-4d46-b69c-a8ed977682cd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:41.758968 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b987dfd-f34b-4d46-b69c-a8ed977682cd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:41.760167 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b987dfd-f34b-4d46-b69c-a8ed977682cd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:41.760856 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b987dfd-f34b-4d46-b69c-a8ed977682cd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:41.936430 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3b987dfd-f34b-4d46-b69c-a8ed977682cd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:41.955666 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3b987dfd-f34b-4d46-b69c-a8ed977682cd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.202199 Apr 06 16:40:41.956672 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 127/274] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:41 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:41.998120 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-af756170-89bb-4b10-af2d-8c71cb4e5562 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:41.998969 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-af756170-89bb-4b10-af2d-8c71cb4e5562 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:42.004513 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f4e50921-4b55-410d-9162-6c28faf4225f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:42.006540 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af756170-89bb-4b10-af2d-8c71cb4e5562 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:42.007201 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af756170-89bb-4b10-af2d-8c71cb4e5562 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:42.007914 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af756170-89bb-4b10-af2d-8c71cb4e5562 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:42.008453 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af756170-89bb-4b10-af2d-8c71cb4e5562 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:42.015446 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f4e50921-4b55-410d-9162-6c28faf4225f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:42.017003 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f4e50921-4b55-410d-9162-6c28faf4225f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:42.028749 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f4e50921-4b55-410d-9162-6c28faf4225f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1722 microversion: 2.20 time: 0.306733 Apr 06 16:40:42.029792 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 148/275] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:40:41 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1722 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:40:42.200953 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-af756170-89bb-4b10-af2d-8c71cb4e5562 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:42.209261 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-af756170-89bb-4b10-af2d-8c71cb4e5562 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1723 microversion: 2.1 time: 0.217386 Apr 06 16:40:42.209839 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 128/276] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:41 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:42.711400 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1c0e8e38-9078-41bb-9aa1-9391dd762a9d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-747561301", "imageRef": "c217dd2b-7679-4860-b2e6-01a967f654df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "161b97e6-a667-4e80-ab79-6d47a727bfd9"}], "security_groups": [{"name": "tempest-securitygroup--2107612275"}], "key_name": "tempest-keypair-266657953", "user_data": "}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:40:42.978845 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f44ffdf0-61f6-4c8c-9c53-79741ae45612 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:42.979458 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f44ffdf0-61f6-4c8c-9c53-79741ae45612 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:42.987291 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f44ffdf0-61f6-4c8c-9c53-79741ae45612 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:42.987953 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f44ffdf0-61f6-4c8c-9c53-79741ae45612 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:42.988974 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f44ffdf0-61f6-4c8c-9c53-79741ae45612 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:42.989605 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f44ffdf0-61f6-4c8c-9c53-79741ae45612 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:43.000296 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-1c0e8e38-9078-41bb-9aa1-9391dd762a9d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] validate_networks() for [('161b97e6-a667-4e80-ab79-6d47a727bfd9', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 06 16:40:43.168257 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f44ffdf0-61f6-4c8c-9c53-79741ae45612 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:43.176745 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f44ffdf0-61f6-4c8c-9c53-79741ae45612 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.206498 Apr 06 16:40:43.177615 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 129/277] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:42 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:43.182651 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-210a7eba-c652-4a7e-b7d3-24e350648426 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:43.183947 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-210a7eba-c652-4a7e-b7d3-24e350648426 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:43.192570 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-210a7eba-c652-4a7e-b7d3-24e350648426 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:43.193370 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-210a7eba-c652-4a7e-b7d3-24e350648426 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:43.194379 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-210a7eba-c652-4a7e-b7d3-24e350648426 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:43.194953 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-210a7eba-c652-4a7e-b7d3-24e350648426 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:43.377945 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-210a7eba-c652-4a7e-b7d3-24e350648426 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:43.386277 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-210a7eba-c652-4a7e-b7d3-24e350648426 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:43.387939 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-210a7eba-c652-4a7e-b7d3-24e350648426 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:43.389199 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-210a7eba-c652-4a7e-b7d3-24e350648426 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1722 microversion: 2.20 time: 0.210411 Apr 06 16:40:43.389772 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 130/278] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:40:43 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:40:43.394641 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7d5b3d85-e656-44f4-a369-ba20bc72e6bd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:43.395565 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7d5b3d85-e656-44f4-a369-ba20bc72e6bd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:43.402427 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d5b3d85-e656-44f4-a369-ba20bc72e6bd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:43.402887 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d5b3d85-e656-44f4-a369-ba20bc72e6bd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:43.403828 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d5b3d85-e656-44f4-a369-ba20bc72e6bd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:43.405464 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d5b3d85-e656-44f4-a369-ba20bc72e6bd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:43.464390 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-1c0e8e38-9078-41bb-9aa1-9391dd762a9d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 06 16:40:43.464841 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-1c0e8e38-9078-41bb-9aa1-9391dd762a9d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 06 16:40:43.465297 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-1c0e8e38-9078-41bb-9aa1-9391dd762a9d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 06 16:40:43.465997 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-1c0e8e38-9078-41bb-9aa1-9391dd762a9d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 06 16:40:43.466580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-1c0e8e38-9078-41bb-9aa1-9391dd762a9d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 06 16:40:43.484159 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c0e8e38-9078-41bb-9aa1-9391dd762a9d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:43.484999 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c0e8e38-9078-41bb-9aa1-9391dd762a9d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:43.486022 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c0e8e38-9078-41bb-9aa1-9391dd762a9d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:43.486661 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c0e8e38-9078-41bb-9aa1-9391dd762a9d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:43.518834 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-1c0e8e38-9078-41bb-9aa1-9391dd762a9d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Getting quotas for project a7b211944dc94094801aa5dd3d20a401. Resources: {'instances', 'cores', 'ram'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 16:40:43.526660 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-1c0e8e38-9078-41bb-9aa1-9391dd762a9d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Getting quotas for user 22d0f09ff8c240a485a775d3c95d626b and project a7b211944dc94094801aa5dd3d20a401. Resources: {'instances', 'cores', 'ram'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 16:40:43.538114 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1c0e8e38-9078-41bb-9aa1-9391dd762a9d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 06 16:40:43.540481 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1c0e8e38-9078-41bb-9aa1-9391dd762a9d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c217dd2b-7679-4860-b2e6-01a967f654df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 06 16:40:43.564169 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7d5b3d85-e656-44f4-a369-ba20bc72e6bd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:43.584965 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7d5b3d85-e656-44f4-a369-ba20bc72e6bd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1723 microversion: 2.1 time: 0.193920 Apr 06 16:40:43.585842 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 131/279] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:43 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:43.595921 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1c0e8e38-9078-41bb-9aa1-9391dd762a9d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.890375 Apr 06 16:40:43.596823 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 149/280] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Apr 6 16:40:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 06 16:40:43.607210 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8c50b9ad-e178-4d47-b9d9-e30d0fdc6359 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:43.607830 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8c50b9ad-e178-4d47-b9d9-e30d0fdc6359 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:43.664937 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8c50b9ad-e178-4d47-b9d9-e30d0fdc6359 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:43.672557 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8c50b9ad-e178-4d47-b9d9-e30d0fdc6359 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 200 len: 1240 microversion: 2.1 time: 0.069558 Apr 06 16:40:43.673633 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 132/281] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:43 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:44.196423 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2abc18c3-da4b-4e8b-b00e-8f861ed6e04e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:44.197241 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2abc18c3-da4b-4e8b-b00e-8f861ed6e04e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:44.205941 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2abc18c3-da4b-4e8b-b00e-8f861ed6e04e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:44.206388 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2abc18c3-da4b-4e8b-b00e-8f861ed6e04e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:44.207213 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2abc18c3-da4b-4e8b-b00e-8f861ed6e04e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:44.207634 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2abc18c3-da4b-4e8b-b00e-8f861ed6e04e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:44.372162 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2abc18c3-da4b-4e8b-b00e-8f861ed6e04e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:44.380476 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2abc18c3-da4b-4e8b-b00e-8f861ed6e04e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.188647 Apr 06 16:40:44.381504 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 150/282] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:44 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:44.408280 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a63b9e3f-bd66-429a-9184-4ec43483808a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:44.409111 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a63b9e3f-bd66-429a-9184-4ec43483808a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:44.417933 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a63b9e3f-bd66-429a-9184-4ec43483808a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:44.418145 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a63b9e3f-bd66-429a-9184-4ec43483808a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:44.418804 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a63b9e3f-bd66-429a-9184-4ec43483808a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:44.419243 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a63b9e3f-bd66-429a-9184-4ec43483808a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:44.577602 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a63b9e3f-bd66-429a-9184-4ec43483808a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:44.586692 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a63b9e3f-bd66-429a-9184-4ec43483808a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:44.588156 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a63b9e3f-bd66-429a-9184-4ec43483808a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:44.589640 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a63b9e3f-bd66-429a-9184-4ec43483808a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1722 microversion: 2.20 time: 0.185561 Apr 06 16:40:44.590270 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 133/283] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:40:44 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:40:44.604133 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6611ef43-27af-4ec0-b155-9b716e907b31 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:44.604798 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6611ef43-27af-4ec0-b155-9b716e907b31 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:44.612199 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6611ef43-27af-4ec0-b155-9b716e907b31 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:44.612649 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6611ef43-27af-4ec0-b155-9b716e907b31 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:44.613505 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6611ef43-27af-4ec0-b155-9b716e907b31 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:44.613966 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6611ef43-27af-4ec0-b155-9b716e907b31 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:44.690626 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a320e56f-dd00-4e47-99ae-de3656c408fb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:44.691152 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a320e56f-dd00-4e47-99ae-de3656c408fb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:44.702524 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a320e56f-dd00-4e47-99ae-de3656c408fb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:44.710705 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a320e56f-dd00-4e47-99ae-de3656c408fb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:44.715421 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a320e56f-dd00-4e47-99ae-de3656c408fb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:44.715934 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a320e56f-dd00-4e47-99ae-de3656c408fb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:44.779895 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a320e56f-dd00-4e47-99ae-de3656c408fb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:44.789370 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a320e56f-dd00-4e47-99ae-de3656c408fb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 200 len: 1292 microversion: 2.1 time: 0.102632 Apr 06 16:40:44.789985 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 134/284] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:44 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 1292 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:44.801490 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6611ef43-27af-4ec0-b155-9b716e907b31 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:44.815532 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6611ef43-27af-4ec0-b155-9b716e907b31 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1723 microversion: 2.1 time: 0.215712 Apr 06 16:40:44.816105 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 151/285] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:44 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:45.400355 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ebf8d6f4-3f56-4ad6-bbad-c83e935f0b5c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:45.401086 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ebf8d6f4-3f56-4ad6-bbad-c83e935f0b5c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:45.409044 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebf8d6f4-3f56-4ad6-bbad-c83e935f0b5c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:45.414374 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebf8d6f4-3f56-4ad6-bbad-c83e935f0b5c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:45.415236 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebf8d6f4-3f56-4ad6-bbad-c83e935f0b5c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:45.415714 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebf8d6f4-3f56-4ad6-bbad-c83e935f0b5c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:45.615062 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9fdbd431-75b2-4601-83f0-d6ecde708041 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:45.616386 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9fdbd431-75b2-4601-83f0-d6ecde708041 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:45.624078 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fdbd431-75b2-4601-83f0-d6ecde708041 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:45.624790 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fdbd431-75b2-4601-83f0-d6ecde708041 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:45.625854 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fdbd431-75b2-4601-83f0-d6ecde708041 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:45.626377 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fdbd431-75b2-4601-83f0-d6ecde708041 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:45.664876 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ebf8d6f4-3f56-4ad6-bbad-c83e935f0b5c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:45.672432 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ebf8d6f4-3f56-4ad6-bbad-c83e935f0b5c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.278548 Apr 06 16:40:45.676421 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 135/286] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:45 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:40:45.831676 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d25df476-967c-442b-a255-1577a72da5a0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:45.832811 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d25df476-967c-442b-a255-1577a72da5a0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:45.839834 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d25df476-967c-442b-a255-1577a72da5a0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:45.840355 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d25df476-967c-442b-a255-1577a72da5a0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:45.841149 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9fdbd431-75b2-4601-83f0-d6ecde708041 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:45.841837 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d25df476-967c-442b-a255-1577a72da5a0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:45.842376 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d25df476-967c-442b-a255-1577a72da5a0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:45.852256 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9fdbd431-75b2-4601-83f0-d6ecde708041 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:45.854181 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9fdbd431-75b2-4601-83f0-d6ecde708041 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:45.855712 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9fdbd431-75b2-4601-83f0-d6ecde708041 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1722 microversion: 2.20 time: 0.245493 Apr 06 16:40:45.856495 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 152/287] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:40:45 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:40:45.862682 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fa576946-9a10-4cd8-8255-205997941014 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:45.863596 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fa576946-9a10-4cd8-8255-205997941014 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:45.873486 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa576946-9a10-4cd8-8255-205997941014 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:45.874464 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa576946-9a10-4cd8-8255-205997941014 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:45.876511 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa576946-9a10-4cd8-8255-205997941014 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:45.877236 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa576946-9a10-4cd8-8255-205997941014 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:46.087874 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fa576946-9a10-4cd8-8255-205997941014 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:46.098157 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fa576946-9a10-4cd8-8255-205997941014 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1723 microversion: 2.1 time: 0.240312 Apr 06 16:40:46.098739 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 153/288] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:45 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:46.193626 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d25df476-967c-442b-a255-1577a72da5a0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:46.205293 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d25df476-967c-442b-a255-1577a72da5a0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 200 len: 1366 microversion: 2.1 time: 0.396942 Apr 06 16:40:46.205890 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 136/289] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:45 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 1366 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:46.693967 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0458b975-8499-44a8-9e5e-4100f0ec21b7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:46.695296 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0458b975-8499-44a8-9e5e-4100f0ec21b7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:46.704377 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0458b975-8499-44a8-9e5e-4100f0ec21b7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:46.705028 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0458b975-8499-44a8-9e5e-4100f0ec21b7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:46.705825 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0458b975-8499-44a8-9e5e-4100f0ec21b7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:46.706311 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0458b975-8499-44a8-9e5e-4100f0ec21b7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:46.819987 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-23635e2a-1709-4631-8339-82500c848219 req-36ea1cd0-15ee-4ec4-ae5e-c466ca6921c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fd9a412-d36a-4da6-80ce-a49cb771a0af", "tag": "d00644e8-aa5d-4c9b-babb-b316869af868"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:40:46.830084 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-23635e2a-1709-4631-8339-82500c848219 req-36ea1cd0-15ee-4ec4-ae5e-c466ca6921c7 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:46.831387 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-23635e2a-1709-4631-8339-82500c848219 req-36ea1cd0-15ee-4ec4-ae5e-c466ca6921c7 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:46.854469 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-23635e2a-1709-4631-8339-82500c848219 req-36ea1cd0-15ee-4ec4-ae5e-c466ca6921c7 service nova] Creating event network-changed:d00644e8-aa5d-4c9b-babb-b316869af868 for instance 1fd9a412-d36a-4da6-80ce-a49cb771a0af on hv-cinder-83684 Apr 06 16:40:46.861306 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-23635e2a-1709-4631-8339-82500c848219 req-36ea1cd0-15ee-4ec4-ae5e-c466ca6921c7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045044 Apr 06 16:40:46.863179 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 137/290] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:40:46.878228 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-41a4f8fb-8f11-4c98-b4ff-e9497b4f81bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:46.878936 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-41a4f8fb-8f11-4c98-b4ff-e9497b4f81bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:46.885642 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41a4f8fb-8f11-4c98-b4ff-e9497b4f81bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:46.887714 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41a4f8fb-8f11-4c98-b4ff-e9497b4f81bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:46.888577 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41a4f8fb-8f11-4c98-b4ff-e9497b4f81bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:46.889048 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41a4f8fb-8f11-4c98-b4ff-e9497b4f81bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:46.903804 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0458b975-8499-44a8-9e5e-4100f0ec21b7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:46.912227 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0458b975-8499-44a8-9e5e-4100f0ec21b7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.222740 Apr 06 16:40:46.912822 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 154/291] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:46 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:47.043599 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-41a4f8fb-8f11-4c98-b4ff-e9497b4f81bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:47.051833 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-41a4f8fb-8f11-4c98-b4ff-e9497b4f81bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:47.053409 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-41a4f8fb-8f11-4c98-b4ff-e9497b4f81bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:47.054576 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-41a4f8fb-8f11-4c98-b4ff-e9497b4f81bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1722 microversion: 2.20 time: 0.180908 Apr 06 16:40:47.055138 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 138/292] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:40:46 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:40:47.115991 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-050c9920-a661-4f1f-9363-485605cdec18 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:47.116598 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-050c9920-a661-4f1f-9363-485605cdec18 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:47.123460 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-050c9920-a661-4f1f-9363-485605cdec18 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:47.123907 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-050c9920-a661-4f1f-9363-485605cdec18 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:47.124715 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-050c9920-a661-4f1f-9363-485605cdec18 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:47.125142 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-050c9920-a661-4f1f-9363-485605cdec18 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:47.223488 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4806245e-a99a-4c07-9ce2-f037b9e3f1d2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:47.224179 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4806245e-a99a-4c07-9ce2-f037b9e3f1d2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:47.232206 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4806245e-a99a-4c07-9ce2-f037b9e3f1d2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:47.232656 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4806245e-a99a-4c07-9ce2-f037b9e3f1d2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:47.233468 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4806245e-a99a-4c07-9ce2-f037b9e3f1d2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:47.234048 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4806245e-a99a-4c07-9ce2-f037b9e3f1d2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:47.267644 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-050c9920-a661-4f1f-9363-485605cdec18 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:47.275772 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-050c9920-a661-4f1f-9363-485605cdec18 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1723 microversion: 2.1 time: 0.163679 Apr 06 16:40:47.276387 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 155/293] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:47 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:47.370334 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4806245e-a99a-4c07-9ce2-f037b9e3f1d2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:47.378892 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4806245e-a99a-4c07-9ce2-f037b9e3f1d2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 200 len: 1366 microversion: 2.1 time: 0.158839 Apr 06 16:40:47.380522 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 139/294] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:47 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:40:47.929848 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4477a7bd-7909-4c6a-b1fd-d382eebf856e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:47.930665 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4477a7bd-7909-4c6a-b1fd-d382eebf856e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:47.938015 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4477a7bd-7909-4c6a-b1fd-d382eebf856e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:47.938707 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4477a7bd-7909-4c6a-b1fd-d382eebf856e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:47.939613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4477a7bd-7909-4c6a-b1fd-d382eebf856e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:47.940074 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4477a7bd-7909-4c6a-b1fd-d382eebf856e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:48.074703 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f68f3507-3221-4c5c-a78e-a504ca2685f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:48.075317 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f68f3507-3221-4c5c-a78e-a504ca2685f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:48.082526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f68f3507-3221-4c5c-a78e-a504ca2685f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:48.083218 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f68f3507-3221-4c5c-a78e-a504ca2685f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:48.084055 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f68f3507-3221-4c5c-a78e-a504ca2685f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:48.084510 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f68f3507-3221-4c5c-a78e-a504ca2685f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:48.097743 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4477a7bd-7909-4c6a-b1fd-d382eebf856e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:48.106658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4477a7bd-7909-4c6a-b1fd-d382eebf856e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.181180 Apr 06 16:40:48.107632 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 156/295] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:47 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:48.293914 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-31cc8b5d-2195-476f-a665-29973db948b8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:48.294531 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-31cc8b5d-2195-476f-a665-29973db948b8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:48.301885 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31cc8b5d-2195-476f-a665-29973db948b8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:48.302332 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31cc8b5d-2195-476f-a665-29973db948b8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:48.303161 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31cc8b5d-2195-476f-a665-29973db948b8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:48.303600 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31cc8b5d-2195-476f-a665-29973db948b8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:48.462243 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-31cc8b5d-2195-476f-a665-29973db948b8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:48.470851 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-31cc8b5d-2195-476f-a665-29973db948b8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1723 microversion: 2.1 time: 0.181202 Apr 06 16:40:48.471441 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 157/296] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:48 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:48.476624 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4960cb77-f18f-4a9d-be81-6c74170496de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:48.477519 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4960cb77-f18f-4a9d-be81-6c74170496de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:48.484792 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4960cb77-f18f-4a9d-be81-6c74170496de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:48.485242 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4960cb77-f18f-4a9d-be81-6c74170496de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:48.486033 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4960cb77-f18f-4a9d-be81-6c74170496de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:48.486464 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4960cb77-f18f-4a9d-be81-6c74170496de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:48.606170 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f68f3507-3221-4c5c-a78e-a504ca2685f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:48.618767 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f68f3507-3221-4c5c-a78e-a504ca2685f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:48.620709 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f68f3507-3221-4c5c-a78e-a504ca2685f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:48.623327 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f68f3507-3221-4c5c-a78e-a504ca2685f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1722 microversion: 2.20 time: 0.552957 Apr 06 16:40:48.625236 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 140/297] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:40:48 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1722 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:40:48.651161 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4960cb77-f18f-4a9d-be81-6c74170496de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:48.659888 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4960cb77-f18f-4a9d-be81-6c74170496de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 200 len: 1366 microversion: 2.1 time: 0.187186 Apr 06 16:40:48.660472 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 158/298] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:48 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:49.124780 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f0233c75-e07e-4af8-97d0-85c2ec557dab tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:49.125406 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f0233c75-e07e-4af8-97d0-85c2ec557dab tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:49.132163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0233c75-e07e-4af8-97d0-85c2ec557dab tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:49.132633 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0233c75-e07e-4af8-97d0-85c2ec557dab tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:49.133435 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0233c75-e07e-4af8-97d0-85c2ec557dab tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:49.133866 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0233c75-e07e-4af8-97d0-85c2ec557dab tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:49.300408 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f0233c75-e07e-4af8-97d0-85c2ec557dab tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:49.309482 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f0233c75-e07e-4af8-97d0-85c2ec557dab tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.188469 Apr 06 16:40:49.310284 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 141/299] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:49 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:49.491733 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d0c02612-70be-470e-aff2-ac38888ed730 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:49.492944 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d0c02612-70be-470e-aff2-ac38888ed730 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:49.502773 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0c02612-70be-470e-aff2-ac38888ed730 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:49.503467 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0c02612-70be-470e-aff2-ac38888ed730 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:49.504665 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0c02612-70be-470e-aff2-ac38888ed730 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:49.505384 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0c02612-70be-470e-aff2-ac38888ed730 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:49.642536 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cfd9842e-e59f-470d-82b6-9440aeb99ed3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:49.643405 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cfd9842e-e59f-470d-82b6-9440aeb99ed3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:49.653667 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfd9842e-e59f-470d-82b6-9440aeb99ed3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:49.654124 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfd9842e-e59f-470d-82b6-9440aeb99ed3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:49.656110 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfd9842e-e59f-470d-82b6-9440aeb99ed3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:49.656597 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfd9842e-e59f-470d-82b6-9440aeb99ed3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:49.659283 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d0c02612-70be-470e-aff2-ac38888ed730 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:49.667576 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d0c02612-70be-470e-aff2-ac38888ed730 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1723 microversion: 2.1 time: 0.181784 Apr 06 16:40:49.668618 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 159/300] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:49 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:49.677239 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-597b75ab-1fc0-4d77-995a-2e81ac51a597 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:49.677900 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-597b75ab-1fc0-4d77-995a-2e81ac51a597 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:49.684721 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-597b75ab-1fc0-4d77-995a-2e81ac51a597 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:49.685347 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-597b75ab-1fc0-4d77-995a-2e81ac51a597 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:49.686123 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-597b75ab-1fc0-4d77-995a-2e81ac51a597 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:49.686550 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-597b75ab-1fc0-4d77-995a-2e81ac51a597 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:49.819227 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cfd9842e-e59f-470d-82b6-9440aeb99ed3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:49.827958 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cfd9842e-e59f-470d-82b6-9440aeb99ed3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:49.829492 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cfd9842e-e59f-470d-82b6-9440aeb99ed3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:49.830665 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cfd9842e-e59f-470d-82b6-9440aeb99ed3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1722 microversion: 2.20 time: 0.192122 Apr 06 16:40:49.831217 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 142/301] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:40:49 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:40:49.840722 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-597b75ab-1fc0-4d77-995a-2e81ac51a597 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:49.852035 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-597b75ab-1fc0-4d77-995a-2e81ac51a597 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 200 len: 1366 microversion: 2.1 time: 0.178663 Apr 06 16:40:49.852741 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 160/302] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:49 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:50.327095 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8b7b9889-61d2-4a89-a209-d03404034b9f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:50.327698 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8b7b9889-61d2-4a89-a209-d03404034b9f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:50.337458 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b7b9889-61d2-4a89-a209-d03404034b9f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:50.337918 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b7b9889-61d2-4a89-a209-d03404034b9f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:50.338858 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b7b9889-61d2-4a89-a209-d03404034b9f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:50.339759 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b7b9889-61d2-4a89-a209-d03404034b9f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:50.488322 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8b7b9889-61d2-4a89-a209-d03404034b9f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:50.496222 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8b7b9889-61d2-4a89-a209-d03404034b9f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.173484 Apr 06 16:40:50.496956 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 143/303] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:50 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:50.686544 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a5f63b8f-067b-4d82-90b9-ae845e3c5c93 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:50.687159 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a5f63b8f-067b-4d82-90b9-ae845e3c5c93 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:50.693781 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5f63b8f-067b-4d82-90b9-ae845e3c5c93 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:50.694217 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5f63b8f-067b-4d82-90b9-ae845e3c5c93 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:50.694997 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5f63b8f-067b-4d82-90b9-ae845e3c5c93 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:50.695425 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5f63b8f-067b-4d82-90b9-ae845e3c5c93 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:50.840633 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a5f63b8f-067b-4d82-90b9-ae845e3c5c93 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:50.848866 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a5f63b8f-067b-4d82-90b9-ae845e3c5c93 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1723 microversion: 2.1 time: 0.166607 Apr 06 16:40:50.849446 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 161/304] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:50 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:50.853168 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-54830254-0607-4571-abb2-e10541298fb5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:50.853783 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-54830254-0607-4571-abb2-e10541298fb5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:50.860367 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54830254-0607-4571-abb2-e10541298fb5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:50.860846 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54830254-0607-4571-abb2-e10541298fb5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:50.861638 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54830254-0607-4571-abb2-e10541298fb5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:50.862077 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54830254-0607-4571-abb2-e10541298fb5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:50.869368 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-487c75b4-e59c-4f73-8678-f138cddea62a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:50.869964 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-487c75b4-e59c-4f73-8678-f138cddea62a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:50.876333 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-487c75b4-e59c-4f73-8678-f138cddea62a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:50.877159 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-487c75b4-e59c-4f73-8678-f138cddea62a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:50.878094 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-487c75b4-e59c-4f73-8678-f138cddea62a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:50.878680 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-487c75b4-e59c-4f73-8678-f138cddea62a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:51.003487 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-54830254-0607-4571-abb2-e10541298fb5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:51.012011 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-54830254-0607-4571-abb2-e10541298fb5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:51.013705 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-54830254-0607-4571-abb2-e10541298fb5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:51.014892 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-54830254-0607-4571-abb2-e10541298fb5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1722 microversion: 2.20 time: 0.165736 Apr 06 16:40:51.020727 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 144/305] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:40:50 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:40:51.021013 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-487c75b4-e59c-4f73-8678-f138cddea62a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:51.026910 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-487c75b4-e59c-4f73-8678-f138cddea62a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 200 len: 1366 microversion: 2.1 time: 0.161925 Apr 06 16:40:51.027856 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 162/306] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:50 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:40:51.517244 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9b702fbe-36d4-4a38-a8c9-08ce1c5c3f5c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:51.517859 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9b702fbe-36d4-4a38-a8c9-08ce1c5c3f5c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:51.526441 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b702fbe-36d4-4a38-a8c9-08ce1c5c3f5c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:51.526996 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b702fbe-36d4-4a38-a8c9-08ce1c5c3f5c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:51.528223 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b702fbe-36d4-4a38-a8c9-08ce1c5c3f5c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:51.528359 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b702fbe-36d4-4a38-a8c9-08ce1c5c3f5c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:51.694701 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9b702fbe-36d4-4a38-a8c9-08ce1c5c3f5c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:51.704160 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9b702fbe-36d4-4a38-a8c9-08ce1c5c3f5c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.193036 Apr 06 16:40:51.704831 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 145/307] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:51 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:51.868081 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8f6b46b7-f920-438e-935d-5443383d491f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:51.869038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8f6b46b7-f920-438e-935d-5443383d491f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:51.876943 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f6b46b7-f920-438e-935d-5443383d491f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:51.877443 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f6b46b7-f920-438e-935d-5443383d491f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:51.878232 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f6b46b7-f920-438e-935d-5443383d491f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:51.878671 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f6b46b7-f920-438e-935d-5443383d491f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:52.023253 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8f6b46b7-f920-438e-935d-5443383d491f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:52.032258 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8f6b46b7-f920-438e-935d-5443383d491f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1723 microversion: 2.1 time: 0.168563 Apr 06 16:40:52.032853 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 163/308] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:51 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:52.033498 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-edb5a58d-121c-4e49-8341-74d85093fae0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:52.034122 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-edb5a58d-121c-4e49-8341-74d85093fae0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:52.040362 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edb5a58d-121c-4e49-8341-74d85093fae0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:52.040827 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edb5a58d-121c-4e49-8341-74d85093fae0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:52.041602 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edb5a58d-121c-4e49-8341-74d85093fae0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:52.042030 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edb5a58d-121c-4e49-8341-74d85093fae0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:52.049475 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ce35498a-1b54-4d31-bc47-0be1d8168c1c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:52.050056 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ce35498a-1b54-4d31-bc47-0be1d8168c1c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:52.055990 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce35498a-1b54-4d31-bc47-0be1d8168c1c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:52.056431 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce35498a-1b54-4d31-bc47-0be1d8168c1c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:52.057256 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce35498a-1b54-4d31-bc47-0be1d8168c1c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:52.057760 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce35498a-1b54-4d31-bc47-0be1d8168c1c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:52.214837 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-edb5a58d-121c-4e49-8341-74d85093fae0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:52.218696 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ce35498a-1b54-4d31-bc47-0be1d8168c1c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:52.223474 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-edb5a58d-121c-4e49-8341-74d85093fae0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:52.225009 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-edb5a58d-121c-4e49-8341-74d85093fae0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:52.226182 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-edb5a58d-121c-4e49-8341-74d85093fae0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1722 microversion: 2.20 time: 0.196705 Apr 06 16:40:52.226418 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ce35498a-1b54-4d31-bc47-0be1d8168c1c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 200 len: 1366 microversion: 2.1 time: 0.181071 Apr 06 16:40:52.226743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 146/309] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:40:52 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:40:52.226977 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 164/310] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:52 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:40:52.721522 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dcb2907c-5839-4544-bbd3-13657eb5029d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:52.722139 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dcb2907c-5839-4544-bbd3-13657eb5029d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:52.728979 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dcb2907c-5839-4544-bbd3-13657eb5029d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:52.729437 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dcb2907c-5839-4544-bbd3-13657eb5029d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:52.730214 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dcb2907c-5839-4544-bbd3-13657eb5029d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:52.730654 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dcb2907c-5839-4544-bbd3-13657eb5029d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:52.885088 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-dcb2907c-5839-4544-bbd3-13657eb5029d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:52.892729 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dcb2907c-5839-4544-bbd3-13657eb5029d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.175144 Apr 06 16:40:52.893410 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 147/311] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:52 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:53.050712 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c69d67bf-7504-4d5e-a2ca-41ab23277582 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:53.051325 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c69d67bf-7504-4d5e-a2ca-41ab23277582 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:53.057651 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c69d67bf-7504-4d5e-a2ca-41ab23277582 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:53.058246 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c69d67bf-7504-4d5e-a2ca-41ab23277582 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:53.059006 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c69d67bf-7504-4d5e-a2ca-41ab23277582 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:53.059519 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c69d67bf-7504-4d5e-a2ca-41ab23277582 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:53.211747 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c69d67bf-7504-4d5e-a2ca-41ab23277582 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:53.220503 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c69d67bf-7504-4d5e-a2ca-41ab23277582 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1723 microversion: 2.1 time: 0.173779 Apr 06 16:40:53.221120 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 165/312] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:53 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:53.245231 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0230db25-6877-485f-8c81-54528f76da1c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:53.245841 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3a7e8947-b5e0-4534-95eb-b0603d142138 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:53.246016 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0230db25-6877-485f-8c81-54528f76da1c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:53.246439 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3a7e8947-b5e0-4534-95eb-b0603d142138 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:53.252144 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0230db25-6877-485f-8c81-54528f76da1c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:53.252592 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0230db25-6877-485f-8c81-54528f76da1c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:53.252731 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a7e8947-b5e0-4534-95eb-b0603d142138 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:53.253089 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a7e8947-b5e0-4534-95eb-b0603d142138 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:53.253401 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0230db25-6877-485f-8c81-54528f76da1c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:53.253833 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0230db25-6877-485f-8c81-54528f76da1c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:53.253949 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a7e8947-b5e0-4534-95eb-b0603d142138 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:53.254256 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a7e8947-b5e0-4534-95eb-b0603d142138 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:53.394354 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3a7e8947-b5e0-4534-95eb-b0603d142138 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:53.394533 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0230db25-6877-485f-8c81-54528f76da1c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:53.402035 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0230db25-6877-485f-8c81-54528f76da1c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 200 len: 1366 microversion: 2.1 time: 0.161914 Apr 06 16:40:53.402618 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3a7e8947-b5e0-4534-95eb-b0603d142138 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:53.402775 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 148/313] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:53 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:53.404817 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3a7e8947-b5e0-4534-95eb-b0603d142138 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:53.405996 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3a7e8947-b5e0-4534-95eb-b0603d142138 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1722 microversion: 2.20 time: 0.164478 Apr 06 16:40:53.406549 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 166/314] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:40:53 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:40:53.909917 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e78b9f8d-fac1-4d93-b9b0-4f250f72132b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:53.910534 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e78b9f8d-fac1-4d93-b9b0-4f250f72132b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:53.917303 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e78b9f8d-fac1-4d93-b9b0-4f250f72132b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:53.917757 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e78b9f8d-fac1-4d93-b9b0-4f250f72132b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:53.918532 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e78b9f8d-fac1-4d93-b9b0-4f250f72132b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:53.918968 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e78b9f8d-fac1-4d93-b9b0-4f250f72132b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:54.059503 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e78b9f8d-fac1-4d93-b9b0-4f250f72132b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:54.070075 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e78b9f8d-fac1-4d93-b9b0-4f250f72132b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.164181 Apr 06 16:40:54.070657 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 149/315] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:53 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:54.246008 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-583b42b0-3091-4086-86cb-e7805249c15d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:54.246008 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-583b42b0-3091-4086-86cb-e7805249c15d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:54.254427 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-583b42b0-3091-4086-86cb-e7805249c15d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:54.255234 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-583b42b0-3091-4086-86cb-e7805249c15d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:54.256524 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-583b42b0-3091-4086-86cb-e7805249c15d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:54.257275 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-583b42b0-3091-4086-86cb-e7805249c15d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:54.414371 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-583b42b0-3091-4086-86cb-e7805249c15d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:54.419266 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a95be7f1-9754-436c-8c51-ebd6cc59df92 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:54.419876 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a95be7f1-9754-436c-8c51-ebd6cc59df92 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:54.423917 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-583b42b0-3091-4086-86cb-e7805249c15d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1723 microversion: 2.1 time: 0.182837 Apr 06 16:40:54.424519 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 167/316] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:54 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:54.426620 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a95be7f1-9754-436c-8c51-ebd6cc59df92 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:54.427113 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a95be7f1-9754-436c-8c51-ebd6cc59df92 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:54.427939 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a95be7f1-9754-436c-8c51-ebd6cc59df92 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:54.428426 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a95be7f1-9754-436c-8c51-ebd6cc59df92 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:54.429383 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c3176644-8733-410e-9955-bcb3d42b7a0c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:54.429963 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c3176644-8733-410e-9955-bcb3d42b7a0c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:54.436874 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3176644-8733-410e-9955-bcb3d42b7a0c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:54.437315 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3176644-8733-410e-9955-bcb3d42b7a0c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:54.438095 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3176644-8733-410e-9955-bcb3d42b7a0c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:54.438508 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3176644-8733-410e-9955-bcb3d42b7a0c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:54.577215 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a95be7f1-9754-436c-8c51-ebd6cc59df92 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:54.585407 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a95be7f1-9754-436c-8c51-ebd6cc59df92 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 200 len: 1366 microversion: 2.1 time: 0.170164 Apr 06 16:40:54.586092 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 150/317] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:54 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:54.598657 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c3176644-8733-410e-9955-bcb3d42b7a0c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:54.607853 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c3176644-8733-410e-9955-bcb3d42b7a0c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:54.609945 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c3176644-8733-410e-9955-bcb3d42b7a0c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:54.611604 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c3176644-8733-410e-9955-bcb3d42b7a0c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1722 microversion: 2.20 time: 0.185871 Apr 06 16:40:54.612338 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 168/318] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:40:54 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:40:55.088926 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cfc4e28e-a722-4490-8f19-ad1fef273701 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:55.089548 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cfc4e28e-a722-4490-8f19-ad1fef273701 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:55.097122 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfc4e28e-a722-4490-8f19-ad1fef273701 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:55.097568 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfc4e28e-a722-4490-8f19-ad1fef273701 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:55.098350 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfc4e28e-a722-4490-8f19-ad1fef273701 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:55.098782 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfc4e28e-a722-4490-8f19-ad1fef273701 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:55.241111 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cfc4e28e-a722-4490-8f19-ad1fef273701 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:55.249343 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cfc4e28e-a722-4490-8f19-ad1fef273701 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.164455 Apr 06 16:40:55.249906 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 151/319] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:55 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:55.441676 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a4ba0fa3-a03e-460f-b5ff-4eb58997995c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:55.442280 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a4ba0fa3-a03e-460f-b5ff-4eb58997995c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:55.448924 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4ba0fa3-a03e-460f-b5ff-4eb58997995c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:55.449402 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4ba0fa3-a03e-460f-b5ff-4eb58997995c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:55.450177 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4ba0fa3-a03e-460f-b5ff-4eb58997995c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:55.450792 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4ba0fa3-a03e-460f-b5ff-4eb58997995c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:55.589575 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a4ba0fa3-a03e-460f-b5ff-4eb58997995c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:55.597543 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a4ba0fa3-a03e-460f-b5ff-4eb58997995c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1723 microversion: 2.1 time: 0.159931 Apr 06 16:40:55.598123 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 169/320] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:55 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:55.604130 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8ed3d837-bb1e-4da8-8b2d-af1bfd48817b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:55.604783 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8ed3d837-bb1e-4da8-8b2d-af1bfd48817b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:55.611536 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ed3d837-bb1e-4da8-8b2d-af1bfd48817b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:55.612010 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ed3d837-bb1e-4da8-8b2d-af1bfd48817b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:55.612805 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ed3d837-bb1e-4da8-8b2d-af1bfd48817b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:55.613231 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ed3d837-bb1e-4da8-8b2d-af1bfd48817b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:55.631022 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-67f2eecb-52e7-4e02-b9b2-7f380fdb3ccb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:55.631629 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-67f2eecb-52e7-4e02-b9b2-7f380fdb3ccb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:55.638059 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-67f2eecb-52e7-4e02-b9b2-7f380fdb3ccb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:55.638508 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-67f2eecb-52e7-4e02-b9b2-7f380fdb3ccb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:55.639290 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-67f2eecb-52e7-4e02-b9b2-7f380fdb3ccb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:55.639723 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-67f2eecb-52e7-4e02-b9b2-7f380fdb3ccb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:55.758655 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8ed3d837-bb1e-4da8-8b2d-af1bfd48817b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:55.766935 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8ed3d837-bb1e-4da8-8b2d-af1bfd48817b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 200 len: 1366 microversion: 2.1 time: 0.166577 Apr 06 16:40:55.767742 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 152/321] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:55 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:55.784863 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-67f2eecb-52e7-4e02-b9b2-7f380fdb3ccb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:55.793035 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-67f2eecb-52e7-4e02-b9b2-7f380fdb3ccb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:55.795011 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-67f2eecb-52e7-4e02-b9b2-7f380fdb3ccb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:55.796172 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-67f2eecb-52e7-4e02-b9b2-7f380fdb3ccb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1722 microversion: 2.20 time: 0.169163 Apr 06 16:40:55.796755 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 170/322] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:40:55 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:40:56.267695 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-165e5897-591c-496d-8799-17b6dab1b47e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:56.268346 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-165e5897-591c-496d-8799-17b6dab1b47e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:56.275194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-165e5897-591c-496d-8799-17b6dab1b47e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:56.275493 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-165e5897-591c-496d-8799-17b6dab1b47e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:56.276273 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-165e5897-591c-496d-8799-17b6dab1b47e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:56.276720 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-165e5897-591c-496d-8799-17b6dab1b47e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:56.424718 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-165e5897-591c-496d-8799-17b6dab1b47e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:56.432729 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-165e5897-591c-496d-8799-17b6dab1b47e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.169132 Apr 06 16:40:56.433319 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 153/323] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:56 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:56.615035 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-949ca80d-775e-414e-bcb7-e37d7a324b3d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:56.615617 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-949ca80d-775e-414e-bcb7-e37d7a324b3d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:56.622353 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-949ca80d-775e-414e-bcb7-e37d7a324b3d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:56.623056 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-949ca80d-775e-414e-bcb7-e37d7a324b3d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:56.623956 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-949ca80d-775e-414e-bcb7-e37d7a324b3d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:56.624359 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-949ca80d-775e-414e-bcb7-e37d7a324b3d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:56.775155 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-949ca80d-775e-414e-bcb7-e37d7a324b3d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:56.784086 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-949ca80d-775e-414e-bcb7-e37d7a324b3d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1723 microversion: 2.1 time: 0.172970 Apr 06 16:40:56.784352 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b9484f56-459f-4aa4-bafe-91db1c153ea6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:56.784661 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 171/324] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:56 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:56.784816 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b9484f56-459f-4aa4-bafe-91db1c153ea6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:56.796409 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9484f56-459f-4aa4-bafe-91db1c153ea6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:56.796867 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9484f56-459f-4aa4-bafe-91db1c153ea6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:56.797674 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9484f56-459f-4aa4-bafe-91db1c153ea6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:56.798087 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9484f56-459f-4aa4-bafe-91db1c153ea6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:56.815018 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-68d9d5f0-a884-46ab-a176-99be2ab0f5f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:56.815636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-68d9d5f0-a884-46ab-a176-99be2ab0f5f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:56.822187 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68d9d5f0-a884-46ab-a176-99be2ab0f5f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:56.822639 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68d9d5f0-a884-46ab-a176-99be2ab0f5f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:56.823417 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68d9d5f0-a884-46ab-a176-99be2ab0f5f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:56.823853 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68d9d5f0-a884-46ab-a176-99be2ab0f5f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:56.937243 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b9484f56-459f-4aa4-bafe-91db1c153ea6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:56.945685 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b9484f56-459f-4aa4-bafe-91db1c153ea6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 200 len: 1366 microversion: 2.1 time: 0.165575 Apr 06 16:40:56.946587 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 154/325] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:56 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:56.966470 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-68d9d5f0-a884-46ab-a176-99be2ab0f5f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:56.974517 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-68d9d5f0-a884-46ab-a176-99be2ab0f5f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:56.975996 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-68d9d5f0-a884-46ab-a176-99be2ab0f5f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:56.977190 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-68d9d5f0-a884-46ab-a176-99be2ab0f5f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1743 microversion: 2.20 time: 0.166361 Apr 06 16:40:56.977753 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 172/326] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:40:56 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:40:57.451198 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-65788fff-3302-4593-b680-262ad8d63cfd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:57.452302 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-65788fff-3302-4593-b680-262ad8d63cfd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:57.461415 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65788fff-3302-4593-b680-262ad8d63cfd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:57.462089 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65788fff-3302-4593-b680-262ad8d63cfd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:57.463346 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65788fff-3302-4593-b680-262ad8d63cfd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:57.463784 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65788fff-3302-4593-b680-262ad8d63cfd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:57.606296 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-65788fff-3302-4593-b680-262ad8d63cfd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:57.614269 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-65788fff-3302-4593-b680-262ad8d63cfd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.167402 Apr 06 16:40:57.614806 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 155/327] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:57 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:57.801644 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a94e3f41-5c2b-4650-9eff-7fa3b176e75a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:57.802230 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a94e3f41-5c2b-4650-9eff-7fa3b176e75a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:57.809709 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a94e3f41-5c2b-4650-9eff-7fa3b176e75a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:57.810567 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a94e3f41-5c2b-4650-9eff-7fa3b176e75a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:57.812181 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a94e3f41-5c2b-4650-9eff-7fa3b176e75a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:57.812927 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a94e3f41-5c2b-4650-9eff-7fa3b176e75a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:57.959884 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a94e3f41-5c2b-4650-9eff-7fa3b176e75a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:57.962893 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-70514c30-f211-4970-8066-d74bbc0262ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:57.963530 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-70514c30-f211-4970-8066-d74bbc0262ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:57.969078 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a94e3f41-5c2b-4650-9eff-7fa3b176e75a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1723 microversion: 2.1 time: 0.171358 Apr 06 16:40:57.969668 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 173/328] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:57 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:57.971954 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70514c30-f211-4970-8066-d74bbc0262ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:57.972411 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70514c30-f211-4970-8066-d74bbc0262ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:57.973263 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70514c30-f211-4970-8066-d74bbc0262ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:57.973691 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70514c30-f211-4970-8066-d74bbc0262ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:57.995865 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-824974d1-0f6e-4ad6-992b-25dc30bad2d9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:57.997778 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-824974d1-0f6e-4ad6-992b-25dc30bad2d9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:58.003914 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-824974d1-0f6e-4ad6-992b-25dc30bad2d9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:58.004360 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-824974d1-0f6e-4ad6-992b-25dc30bad2d9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:58.005164 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-824974d1-0f6e-4ad6-992b-25dc30bad2d9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:58.005594 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-824974d1-0f6e-4ad6-992b-25dc30bad2d9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:58.120887 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-70514c30-f211-4970-8066-d74bbc0262ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:58.129181 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-70514c30-f211-4970-8066-d74bbc0262ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 200 len: 1366 microversion: 2.1 time: 0.170023 Apr 06 16:40:58.129788 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 156/329] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:57 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:40:58.152784 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-824974d1-0f6e-4ad6-992b-25dc30bad2d9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:58.160984 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-824974d1-0f6e-4ad6-992b-25dc30bad2d9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:58.162471 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-824974d1-0f6e-4ad6-992b-25dc30bad2d9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:58.163617 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-824974d1-0f6e-4ad6-992b-25dc30bad2d9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1743 microversion: 2.20 time: 0.172127 Apr 06 16:40:58.164178 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 174/330] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:40:57 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:40:58.634965 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-78c7bf58-dcf5-48e9-8cce-d879eb08e631 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:58.635586 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-78c7bf58-dcf5-48e9-8cce-d879eb08e631 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:58.642669 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78c7bf58-dcf5-48e9-8cce-d879eb08e631 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:58.643150 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78c7bf58-dcf5-48e9-8cce-d879eb08e631 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:58.643934 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78c7bf58-dcf5-48e9-8cce-d879eb08e631 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:58.644371 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78c7bf58-dcf5-48e9-8cce-d879eb08e631 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:58.799129 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-78c7bf58-dcf5-48e9-8cce-d879eb08e631 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:58.806621 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-78c7bf58-dcf5-48e9-8cce-d879eb08e631 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.177303 Apr 06 16:40:58.807166 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 157/331] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:58 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:58.995429 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3cdf25a2-3153-4686-a2d3-29f1ec11cf67 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:58.996270 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3cdf25a2-3153-4686-a2d3-29f1ec11cf67 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:59.003632 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3cdf25a2-3153-4686-a2d3-29f1ec11cf67 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:59.004082 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3cdf25a2-3153-4686-a2d3-29f1ec11cf67 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:59.004892 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3cdf25a2-3153-4686-a2d3-29f1ec11cf67 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:59.005323 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3cdf25a2-3153-4686-a2d3-29f1ec11cf67 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:59.146357 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3cdf25a2-3153-4686-a2d3-29f1ec11cf67 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:59.147219 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7fe81106-3c61-41f1-b3f6-8182a581a652 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:59.147895 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7fe81106-3c61-41f1-b3f6-8182a581a652 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:59.153927 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fe81106-3c61-41f1-b3f6-8182a581a652 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:59.154568 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fe81106-3c61-41f1-b3f6-8182a581a652 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:59.154758 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3cdf25a2-3153-4686-a2d3-29f1ec11cf67 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1723 microversion: 2.1 time: 0.165879 Apr 06 16:40:59.155260 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 175/332] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:58 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:40:59.155570 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fe81106-3c61-41f1-b3f6-8182a581a652 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:59.156051 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fe81106-3c61-41f1-b3f6-8182a581a652 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:59.182085 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-be1d7525-7c06-4900-a821-1054785a1aab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:59.182685 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-be1d7525-7c06-4900-a821-1054785a1aab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:59.189605 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be1d7525-7c06-4900-a821-1054785a1aab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:59.190051 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be1d7525-7c06-4900-a821-1054785a1aab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:59.190877 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be1d7525-7c06-4900-a821-1054785a1aab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:59.191311 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be1d7525-7c06-4900-a821-1054785a1aab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:59.298327 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7fe81106-3c61-41f1-b3f6-8182a581a652 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:59.306668 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7fe81106-3c61-41f1-b3f6-8182a581a652 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 200 len: 1366 microversion: 2.1 time: 0.162640 Apr 06 16:40:59.306668 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 158/333] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:59 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:40:59.332430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-be1d7525-7c06-4900-a821-1054785a1aab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:59.340836 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-be1d7525-7c06-4900-a821-1054785a1aab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:59.342355 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-be1d7525-7c06-4900-a821-1054785a1aab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:59.343541 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-be1d7525-7c06-4900-a821-1054785a1aab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1743 microversion: 2.20 time: 0.165400 Apr 06 16:40:59.344107 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 176/334] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:40:59 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:40:59.824543 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cf92b24a-1283-44d1-a99b-c31bd32aace6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:40:59.825229 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cf92b24a-1283-44d1-a99b-c31bd32aace6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:40:59.831900 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf92b24a-1283-44d1-a99b-c31bd32aace6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:59.832370 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf92b24a-1283-44d1-a99b-c31bd32aace6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:59.833166 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf92b24a-1283-44d1-a99b-c31bd32aace6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:40:59.833594 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf92b24a-1283-44d1-a99b-c31bd32aace6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:40:59.979047 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cf92b24a-1283-44d1-a99b-c31bd32aace6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:40:59.987088 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cf92b24a-1283-44d1-a99b-c31bd32aace6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.166650 Apr 06 16:40:59.987684 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 159/335] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:40:59 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:00.174416 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b0598f6a-2c55-48bf-8f3e-4469a157e407 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:00.175184 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b0598f6a-2c55-48bf-8f3e-4469a157e407 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:00.184025 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0598f6a-2c55-48bf-8f3e-4469a157e407 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:00.184537 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0598f6a-2c55-48bf-8f3e-4469a157e407 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:00.185539 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0598f6a-2c55-48bf-8f3e-4469a157e407 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:00.186100 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0598f6a-2c55-48bf-8f3e-4469a157e407 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:00.323687 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1722d80a-0dfe-4e85-b34c-d2d8670d9abb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:00.324335 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1722d80a-0dfe-4e85-b34c-d2d8670d9abb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:00.331975 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1722d80a-0dfe-4e85-b34c-d2d8670d9abb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:00.332407 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1722d80a-0dfe-4e85-b34c-d2d8670d9abb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:00.333273 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1722d80a-0dfe-4e85-b34c-d2d8670d9abb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:00.333715 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1722d80a-0dfe-4e85-b34c-d2d8670d9abb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:00.359435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b0598f6a-2c55-48bf-8f3e-4469a157e407 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:00.370833 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b0598f6a-2c55-48bf-8f3e-4469a157e407 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1723 microversion: 2.1 time: 0.201898 Apr 06 16:41:00.371565 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 177/336] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:00 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:00.377161 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-645e9c6b-dbaa-4352-ae62-9b5568859ad1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:00.377796 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-645e9c6b-dbaa-4352-ae62-9b5568859ad1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:00.385047 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-645e9c6b-dbaa-4352-ae62-9b5568859ad1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:00.385503 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-645e9c6b-dbaa-4352-ae62-9b5568859ad1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:00.386313 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-645e9c6b-dbaa-4352-ae62-9b5568859ad1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:00.386752 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-645e9c6b-dbaa-4352-ae62-9b5568859ad1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:00.507060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1722d80a-0dfe-4e85-b34c-d2d8670d9abb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:00.518595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1722d80a-0dfe-4e85-b34c-d2d8670d9abb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 200 len: 1366 microversion: 2.1 time: 0.197523 Apr 06 16:41:00.519246 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 160/337] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:00 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:00.560375 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-645e9c6b-dbaa-4352-ae62-9b5568859ad1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:00.571456 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-645e9c6b-dbaa-4352-ae62-9b5568859ad1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:00.573045 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-645e9c6b-dbaa-4352-ae62-9b5568859ad1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:00.574253 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-645e9c6b-dbaa-4352-ae62-9b5568859ad1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1743 microversion: 2.20 time: 0.201726 Apr 06 16:41:00.574880 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 178/338] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:00 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1743 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:01.009436 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7e5caa20-8796-4dc9-a8e7-5ca8ab8ea052 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:01.010444 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7e5caa20-8796-4dc9-a8e7-5ca8ab8ea052 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:01.021638 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e5caa20-8796-4dc9-a8e7-5ca8ab8ea052 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:01.022393 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e5caa20-8796-4dc9-a8e7-5ca8ab8ea052 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:01.023667 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e5caa20-8796-4dc9-a8e7-5ca8ab8ea052 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:01.024404 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e5caa20-8796-4dc9-a8e7-5ca8ab8ea052 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:01.180117 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7e5caa20-8796-4dc9-a8e7-5ca8ab8ea052 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:01.189841 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7e5caa20-8796-4dc9-a8e7-5ca8ab8ea052 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.187024 Apr 06 16:41:01.190416 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 161/339] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:01 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:01.390770 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-06fe296d-19c0-4621-adec-bd5723b72f83 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:01.391384 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-06fe296d-19c0-4621-adec-bd5723b72f83 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:01.398038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06fe296d-19c0-4621-adec-bd5723b72f83 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:01.398489 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06fe296d-19c0-4621-adec-bd5723b72f83 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:01.399358 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06fe296d-19c0-4621-adec-bd5723b72f83 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:01.399680 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06fe296d-19c0-4621-adec-bd5723b72f83 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:01.537139 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-75297aea-be84-43ce-b593-0a5446a7a1cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:01.538261 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-75297aea-be84-43ce-b593-0a5446a7a1cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:01.547810 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75297aea-be84-43ce-b593-0a5446a7a1cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:01.548256 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75297aea-be84-43ce-b593-0a5446a7a1cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:01.549081 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75297aea-be84-43ce-b593-0a5446a7a1cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:01.549523 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75297aea-be84-43ce-b593-0a5446a7a1cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:01.552040 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-06fe296d-19c0-4621-adec-bd5723b72f83 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:01.560348 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-06fe296d-19c0-4621-adec-bd5723b72f83 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1723 microversion: 2.1 time: 0.173735 Apr 06 16:41:01.561086 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 179/340] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:01 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:01.592812 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cb203d64-b242-4803-b8c5-59a5c3ffda88 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:01.593582 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cb203d64-b242-4803-b8c5-59a5c3ffda88 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:01.599805 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb203d64-b242-4803-b8c5-59a5c3ffda88 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:01.600225 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb203d64-b242-4803-b8c5-59a5c3ffda88 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:01.601062 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb203d64-b242-4803-b8c5-59a5c3ffda88 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:01.601490 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb203d64-b242-4803-b8c5-59a5c3ffda88 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:01.711207 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-75297aea-be84-43ce-b593-0a5446a7a1cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:01.720727 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-75297aea-be84-43ce-b593-0a5446a7a1cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 200 len: 1366 microversion: 2.1 time: 0.188195 Apr 06 16:41:01.721682 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 162/341] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:01 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:01.760901 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-cb203d64-b242-4803-b8c5-59a5c3ffda88 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:01.771171 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-cb203d64-b242-4803-b8c5-59a5c3ffda88 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:01.773308 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-cb203d64-b242-4803-b8c5-59a5c3ffda88 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:01.774707 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cb203d64-b242-4803-b8c5-59a5c3ffda88 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1743 microversion: 2.20 time: 0.185976 Apr 06 16:41:01.775526 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 180/342] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:01 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1743 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:41:01.889926 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-84e9bf1a-57a5-4c84-8947-ad3df5eadb98 req-11c2e487-591b-47a4-8ccd-722d28c97ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fd9a412-d36a-4da6-80ce-a49cb771a0af", "name": "network-vif-plugged", "status": "completed", "tag": "d00644e8-aa5d-4c9b-babb-b316869af868"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:41:01.898709 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-84e9bf1a-57a5-4c84-8947-ad3df5eadb98 req-11c2e487-591b-47a4-8ccd-722d28c97ff3 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:01.899186 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-84e9bf1a-57a5-4c84-8947-ad3df5eadb98 req-11c2e487-591b-47a4-8ccd-722d28c97ff3 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:01.920323 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-84e9bf1a-57a5-4c84-8947-ad3df5eadb98 req-11c2e487-591b-47a4-8ccd-722d28c97ff3 service nova] Creating event network-vif-plugged:d00644e8-aa5d-4c9b-babb-b316869af868 for instance 1fd9a412-d36a-4da6-80ce-a49cb771a0af on hv-cinder-83684 Apr 06 16:41:01.926728 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-84e9bf1a-57a5-4c84-8947-ad3df5eadb98 req-11c2e487-591b-47a4-8ccd-722d28c97ff3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040567 Apr 06 16:41:01.927735 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 163/343] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:41:02.208490 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-081a850b-603b-4843-ade0-3ab2ee96d20c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:02.208490 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-081a850b-603b-4843-ade0-3ab2ee96d20c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:02.214287 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-081a850b-603b-4843-ade0-3ab2ee96d20c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:02.214722 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-081a850b-603b-4843-ade0-3ab2ee96d20c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:02.215471 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-081a850b-603b-4843-ade0-3ab2ee96d20c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:02.215897 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-081a850b-603b-4843-ade0-3ab2ee96d20c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:02.378724 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-081a850b-603b-4843-ade0-3ab2ee96d20c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:02.390143 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-081a850b-603b-4843-ade0-3ab2ee96d20c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.186183 Apr 06 16:41:02.391101 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 181/344] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:02 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:02.579064 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-aee95303-adc5-4614-833d-cd90e47b9e39 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:02.579797 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-aee95303-adc5-4614-833d-cd90e47b9e39 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:02.589738 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aee95303-adc5-4614-833d-cd90e47b9e39 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:02.590400 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aee95303-adc5-4614-833d-cd90e47b9e39 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:02.591519 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aee95303-adc5-4614-833d-cd90e47b9e39 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:02.592153 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aee95303-adc5-4614-833d-cd90e47b9e39 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:02.740156 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-aee95303-adc5-4614-833d-cd90e47b9e39 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:02.744664 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d5352789-8c33-46c4-92d3-ece807786678 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:02.745510 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d5352789-8c33-46c4-92d3-ece807786678 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:02.748816 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-aee95303-adc5-4614-833d-cd90e47b9e39 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1700 microversion: 2.1 time: 0.174181 Apr 06 16:41:02.749398 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 164/345] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:02 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1700 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:02.763685 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5352789-8c33-46c4-92d3-ece807786678 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:02.764214 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5352789-8c33-46c4-92d3-ece807786678 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:02.765016 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5352789-8c33-46c4-92d3-ece807786678 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:02.765556 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5352789-8c33-46c4-92d3-ece807786678 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:02.767183 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d53eae00-d8f0-4a71-8bda-cf48fabdd0bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:41:02.773639 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d53eae00-d8f0-4a71-8bda-cf48fabdd0bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:02.774124 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d53eae00-d8f0-4a71-8bda-cf48fabdd0bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:02.842587 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d53eae00-d8f0-4a71-8bda-cf48fabdd0bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Going to try to start instance {{(pid=128860) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 06 16:41:02.895566 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d53eae00-d8f0-4a71-8bda-cf48fabdd0bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "POST /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/action" status: 202 len: 0 microversion: 2.1 time: 0.132058 Apr 06 16:41:02.896360 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 165/346] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Apr 6 16:41:02 2022] POST /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 06 16:41:02.902884 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-abccb436-0128-4c6f-b64f-5e68cabeca87 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:02.903996 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-abccb436-0128-4c6f-b64f-5e68cabeca87 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:02.914200 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abccb436-0128-4c6f-b64f-5e68cabeca87 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:02.914395 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abccb436-0128-4c6f-b64f-5e68cabeca87 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:02.915388 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abccb436-0128-4c6f-b64f-5e68cabeca87 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:02.915998 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abccb436-0128-4c6f-b64f-5e68cabeca87 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:02.939596 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d5352789-8c33-46c4-92d3-ece807786678 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:02.948374 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d5352789-8c33-46c4-92d3-ece807786678 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 200 len: 1366 microversion: 2.1 time: 0.213992 Apr 06 16:41:02.949326 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 182/347] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:02 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:41:02.954777 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-91cfda5d-0f7d-4116-a7c9-5cb47ec5643d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:02.955697 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-91cfda5d-0f7d-4116-a7c9-5cb47ec5643d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:02.963039 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91cfda5d-0f7d-4116-a7c9-5cb47ec5643d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:02.963791 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91cfda5d-0f7d-4116-a7c9-5cb47ec5643d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:02.964924 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91cfda5d-0f7d-4116-a7c9-5cb47ec5643d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:02.965580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91cfda5d-0f7d-4116-a7c9-5cb47ec5643d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:03.074058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-abccb436-0128-4c6f-b64f-5e68cabeca87 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:03.083095 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-abccb436-0128-4c6f-b64f-5e68cabeca87 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:03.084727 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-abccb436-0128-4c6f-b64f-5e68cabeca87 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:03.085774 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-abccb436-0128-4c6f-b64f-5e68cabeca87 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1738 microversion: 2.20 time: 0.188052 Apr 06 16:41:03.096182 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 166/348] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:02 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:03.116094 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-91cfda5d-0f7d-4116-a7c9-5cb47ec5643d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:03.124713 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-91cfda5d-0f7d-4116-a7c9-5cb47ec5643d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1709 microversion: 2.1 time: 0.174121 Apr 06 16:41:03.125343 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 183/349] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:02 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1709 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:03.410015 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-50256963-5430-4532-a110-0c176c10e582 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:03.410015 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-50256963-5430-4532-a110-0c176c10e582 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:03.418249 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50256963-5430-4532-a110-0c176c10e582 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:03.418706 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50256963-5430-4532-a110-0c176c10e582 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:03.419516 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50256963-5430-4532-a110-0c176c10e582 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:03.419945 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50256963-5430-4532-a110-0c176c10e582 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:03.627366 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-50256963-5430-4532-a110-0c176c10e582 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:03.635838 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-50256963-5430-4532-a110-0c176c10e582 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.231039 Apr 06 16:41:03.636741 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 167/350] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:03 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:03.965608 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5d299bc8-778b-429b-8484-2840c354a91e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:03.967559 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5d299bc8-778b-429b-8484-2840c354a91e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:03.982050 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d299bc8-778b-429b-8484-2840c354a91e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:03.982486 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d299bc8-778b-429b-8484-2840c354a91e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:03.983297 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d299bc8-778b-429b-8484-2840c354a91e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:03.983930 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d299bc8-778b-429b-8484-2840c354a91e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:04.104794 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7483c452-b79c-44fa-9271-df3d08d03552 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:04.107338 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7483c452-b79c-44fa-9271-df3d08d03552 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:04.114825 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7483c452-b79c-44fa-9271-df3d08d03552 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:04.115384 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7483c452-b79c-44fa-9271-df3d08d03552 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:04.116292 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7483c452-b79c-44fa-9271-df3d08d03552 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:04.117021 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7483c452-b79c-44fa-9271-df3d08d03552 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:04.169460 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5d299bc8-778b-429b-8484-2840c354a91e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:04.180800 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5d299bc8-778b-429b-8484-2840c354a91e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 200 len: 1556 microversion: 2.1 time: 0.218981 Apr 06 16:41:04.181968 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 184/351] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:03 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 1556 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:04.187012 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d6b56570-d434-4cd0-8e5f-2432795dc288 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:04.187609 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d6b56570-d434-4cd0-8e5f-2432795dc288 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:04.194565 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6b56570-d434-4cd0-8e5f-2432795dc288 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:04.195241 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6b56570-d434-4cd0-8e5f-2432795dc288 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:04.196201 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6b56570-d434-4cd0-8e5f-2432795dc288 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:04.196815 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6b56570-d434-4cd0-8e5f-2432795dc288 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:04.361582 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7483c452-b79c-44fa-9271-df3d08d03552 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:04.373092 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7483c452-b79c-44fa-9271-df3d08d03552 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:04.374981 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7483c452-b79c-44fa-9271-df3d08d03552 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:04.376257 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7483c452-b79c-44fa-9271-df3d08d03552 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1738 microversion: 2.20 time: 0.275875 Apr 06 16:41:04.388714 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 168/352] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:04 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1738 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:04.388714 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eb78a972-66c4-4de4-b214-29bdce90ecb9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:04.388714 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eb78a972-66c4-4de4-b214-29bdce90ecb9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:04.389170 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb78a972-66c4-4de4-b214-29bdce90ecb9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:04.389617 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb78a972-66c4-4de4-b214-29bdce90ecb9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:04.390408 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb78a972-66c4-4de4-b214-29bdce90ecb9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:04.390925 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb78a972-66c4-4de4-b214-29bdce90ecb9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:04.415523 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d6b56570-d434-4cd0-8e5f-2432795dc288 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:04.426993 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d6b56570-d434-4cd0-8e5f-2432795dc288 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1709 microversion: 2.1 time: 0.243586 Apr 06 16:41:04.427591 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 185/353] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:04 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1709 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:04.500732 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eb78a972-66c4-4de4-b214-29bdce90ecb9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121900 Apr 06 16:41:04.501789 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 169/354] 10.222.0.64 () {58 vars in 1274 bytes} [Wed Apr 6 16:41:04 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:41:04.657710 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b55c4340-567b-47f3-a741-04f4e779f065 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:04.658967 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b55c4340-567b-47f3-a741-04f4e779f065 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:04.671569 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b55c4340-567b-47f3-a741-04f4e779f065 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:04.672477 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b55c4340-567b-47f3-a741-04f4e779f065 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:04.673553 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b55c4340-567b-47f3-a741-04f4e779f065 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:04.674236 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b55c4340-567b-47f3-a741-04f4e779f065 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:04.925368 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b55c4340-567b-47f3-a741-04f4e779f065 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:04.934867 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b55c4340-567b-47f3-a741-04f4e779f065 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.281042 Apr 06 16:41:04.935932 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 186/355] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:04 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:05.402133 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d489b049-ec79-4778-9cb2-727f251ce59e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:05.403565 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d489b049-ec79-4778-9cb2-727f251ce59e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:05.411071 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d489b049-ec79-4778-9cb2-727f251ce59e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:05.411855 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d489b049-ec79-4778-9cb2-727f251ce59e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:05.413088 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d489b049-ec79-4778-9cb2-727f251ce59e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:05.413671 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d489b049-ec79-4778-9cb2-727f251ce59e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:05.456469 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b40556a0-a6d0-47a6-b95e-b44d26262b08 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:05.459040 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b40556a0-a6d0-47a6-b95e-b44d26262b08 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:05.467028 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b40556a0-a6d0-47a6-b95e-b44d26262b08 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:05.467857 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b40556a0-a6d0-47a6-b95e-b44d26262b08 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:05.469451 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b40556a0-a6d0-47a6-b95e-b44d26262b08 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:05.475834 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b40556a0-a6d0-47a6-b95e-b44d26262b08 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:05.740214 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b40556a0-a6d0-47a6-b95e-b44d26262b08 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:05.758382 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b40556a0-a6d0-47a6-b95e-b44d26262b08 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1709 microversion: 2.1 time: 0.317199 Apr 06 16:41:05.760645 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 187/356] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:05 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1709 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:05.772580 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d489b049-ec79-4778-9cb2-727f251ce59e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:05.781936 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d489b049-ec79-4778-9cb2-727f251ce59e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:05.783563 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d489b049-ec79-4778-9cb2-727f251ce59e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:05.784899 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d489b049-ec79-4778-9cb2-727f251ce59e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1738 microversion: 2.20 time: 0.387671 Apr 06 16:41:05.786165 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 170/357] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:05 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1738 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:05.927904 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8e2c16bc-eb0e-4b72-bbc2-51e280376022 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:05.928400 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8e2c16bc-eb0e-4b72-bbc2-51e280376022 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:05.938727 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e2c16bc-eb0e-4b72-bbc2-51e280376022 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:05.939196 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e2c16bc-eb0e-4b72-bbc2-51e280376022 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:05.939998 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e2c16bc-eb0e-4b72-bbc2-51e280376022 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:05.940432 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e2c16bc-eb0e-4b72-bbc2-51e280376022 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:05.952056 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-78abeca2-f6df-4af3-8d6d-570671d095d0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:05.953956 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-78abeca2-f6df-4af3-8d6d-570671d095d0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:05.966152 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78abeca2-f6df-4af3-8d6d-570671d095d0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:05.966517 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78abeca2-f6df-4af3-8d6d-570671d095d0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:05.967317 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78abeca2-f6df-4af3-8d6d-570671d095d0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:05.967761 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78abeca2-f6df-4af3-8d6d-570671d095d0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:06.171515 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-8e2c16bc-eb0e-4b72-bbc2-51e280376022 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lazy-loading 'services' on Instance uuid 6d4bd75f-9dad-4b01-a3c0-62891ee17877 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 06 16:41:06.323769 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-78abeca2-f6df-4af3-8d6d-570671d095d0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:06.359941 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-78abeca2-f6df-4af3-8d6d-570671d095d0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.411994 Apr 06 16:41:06.360402 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 171/358] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:05 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:41:06.379148 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-cb30a85b-b067-4a49-a59c-3fe075ba9db3 req-9f8edd6c-423d-4dc4-bda2-8c90a0ebee69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330d17b1-0d7d-4519-8dc3-3210eb25aa3c", "name": "network-vif-plugged", "status": "completed", "tag": "e267cfb2-7045-4a09-851f-05d45654d0a1"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:41:06.388842 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-cb30a85b-b067-4a49-a59c-3fe075ba9db3 req-9f8edd6c-423d-4dc4-bda2-8c90a0ebee69 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:06.391996 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-cb30a85b-b067-4a49-a59c-3fe075ba9db3 req-9f8edd6c-423d-4dc4-bda2-8c90a0ebee69 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:06.406032 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-cb30a85b-b067-4a49-a59c-3fe075ba9db3 req-9f8edd6c-423d-4dc4-bda2-8c90a0ebee69 service nova] Creating event network-vif-plugged:e267cfb2-7045-4a09-851f-05d45654d0a1 for instance 330d17b1-0d7d-4519-8dc3-3210eb25aa3c on hv-cinder-83684 Apr 06 16:41:06.414621 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-cb30a85b-b067-4a49-a59c-3fe075ba9db3 req-9f8edd6c-423d-4dc4-bda2-8c90a0ebee69 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044257 Apr 06 16:41:06.415635 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 172/359] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:41:06.417290 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8e2c16bc-eb0e-4b72-bbc2-51e280376022 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877/os-volume_attachments/fbbe8c60-22f6-4714-96ab-22de9b423d20" status: 202 len: 0 microversion: 2.1 time: 0.494359 Apr 06 16:41:06.423549 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 188/360] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Apr 6 16:41:05 2022] DELETE /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877/os-volume_attachments/fbbe8c60-22f6-4714-96ab-22de9b423d20 => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 06 16:41:06.424010 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-8fa385da-7be7-4b63-88d8-0ececa7892db req-1e413e2c-04be-477b-86d4-e620dde4a361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fd9a412-d36a-4da6-80ce-a49cb771a0af", "tag": "d00644e8-aa5d-4c9b-babb-b316869af868"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:41:06.436772 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8fa385da-7be7-4b63-88d8-0ececa7892db req-1e413e2c-04be-477b-86d4-e620dde4a361 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:06.437516 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8fa385da-7be7-4b63-88d8-0ececa7892db req-1e413e2c-04be-477b-86d4-e620dde4a361 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:06.454717 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-8fa385da-7be7-4b63-88d8-0ececa7892db req-1e413e2c-04be-477b-86d4-e620dde4a361 service nova] Creating event network-changed:d00644e8-aa5d-4c9b-babb-b316869af868 for instance 1fd9a412-d36a-4da6-80ce-a49cb771a0af on hv-cinder-83684 Apr 06 16:41:06.461620 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-8fa385da-7be7-4b63-88d8-0ececa7892db req-1e413e2c-04be-477b-86d4-e620dde4a361 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044412 Apr 06 16:41:06.462523 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 173/361] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:41:06.804845 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2e545bfe-363b-4e5d-8535-5a26cb02cb0a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:06.804845 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2e545bfe-363b-4e5d-8535-5a26cb02cb0a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:06.804845 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e545bfe-363b-4e5d-8535-5a26cb02cb0a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:06.804845 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e545bfe-363b-4e5d-8535-5a26cb02cb0a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:06.805748 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e545bfe-363b-4e5d-8535-5a26cb02cb0a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:06.805748 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e545bfe-363b-4e5d-8535-5a26cb02cb0a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:06.805886 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9abcbd0c-d228-4f12-94c0-339b48831f9a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:06.805886 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9abcbd0c-d228-4f12-94c0-339b48831f9a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:06.812160 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9abcbd0c-d228-4f12-94c0-339b48831f9a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:06.812633 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9abcbd0c-d228-4f12-94c0-339b48831f9a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:06.813669 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9abcbd0c-d228-4f12-94c0-339b48831f9a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:06.814210 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9abcbd0c-d228-4f12-94c0-339b48831f9a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:07.018638 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2e545bfe-363b-4e5d-8535-5a26cb02cb0a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:07.027841 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2e545bfe-363b-4e5d-8535-5a26cb02cb0a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1709 microversion: 2.1 time: 0.252628 Apr 06 16:41:07.039066 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 189/362] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:06 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1709 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:07.073319 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9abcbd0c-d228-4f12-94c0-339b48831f9a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:07.089800 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9abcbd0c-d228-4f12-94c0-339b48831f9a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:07.098258 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9abcbd0c-d228-4f12-94c0-339b48831f9a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:07.099651 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9abcbd0c-d228-4f12-94c0-339b48831f9a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1738 microversion: 2.20 time: 0.299659 Apr 06 16:41:07.112711 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 174/363] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:06 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1738 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:07.382422 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-892f7860-876e-411b-a691-7be68e53fb7e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:07.385398 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-892f7860-876e-411b-a691-7be68e53fb7e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:07.395350 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-892f7860-876e-411b-a691-7be68e53fb7e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:07.395971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-892f7860-876e-411b-a691-7be68e53fb7e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:07.396859 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-892f7860-876e-411b-a691-7be68e53fb7e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:07.397352 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-892f7860-876e-411b-a691-7be68e53fb7e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:07.663481 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-892f7860-876e-411b-a691-7be68e53fb7e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:07.674502 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-892f7860-876e-411b-a691-7be68e53fb7e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.297303 Apr 06 16:41:07.676058 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 190/364] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:07 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:08.053024 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ba8f7c1d-75b6-4ac5-ab77-b552fcbc3518 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:08.055284 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ba8f7c1d-75b6-4ac5-ab77-b552fcbc3518 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:08.062882 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba8f7c1d-75b6-4ac5-ab77-b552fcbc3518 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:08.063962 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba8f7c1d-75b6-4ac5-ab77-b552fcbc3518 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:08.065218 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba8f7c1d-75b6-4ac5-ab77-b552fcbc3518 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:08.066292 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba8f7c1d-75b6-4ac5-ab77-b552fcbc3518 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:08.123357 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-734adaca-0f80-4471-b0a1-8da255473cbd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:08.124755 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-734adaca-0f80-4471-b0a1-8da255473cbd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:08.131291 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-734adaca-0f80-4471-b0a1-8da255473cbd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:08.132012 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-734adaca-0f80-4471-b0a1-8da255473cbd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:08.133005 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-734adaca-0f80-4471-b0a1-8da255473cbd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:08.133435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-734adaca-0f80-4471-b0a1-8da255473cbd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:08.248879 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ba8f7c1d-75b6-4ac5-ab77-b552fcbc3518 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:08.258341 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ba8f7c1d-75b6-4ac5-ab77-b552fcbc3518 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1709 microversion: 2.1 time: 0.215421 Apr 06 16:41:08.268730 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 175/365] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:08 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1709 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:08.317399 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-734adaca-0f80-4471-b0a1-8da255473cbd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:08.330967 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-734adaca-0f80-4471-b0a1-8da255473cbd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:08.332846 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-734adaca-0f80-4471-b0a1-8da255473cbd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:08.334055 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-734adaca-0f80-4471-b0a1-8da255473cbd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1738 microversion: 2.20 time: 0.216224 Apr 06 16:41:08.344739 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 191/366] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:08 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:41:08.692804 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-06490f3f-0e42-4e31-a8a4-8f6e6e8b8115 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:08.693586 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-06490f3f-0e42-4e31-a8a4-8f6e6e8b8115 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:08.704588 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06490f3f-0e42-4e31-a8a4-8f6e6e8b8115 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:08.705273 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06490f3f-0e42-4e31-a8a4-8f6e6e8b8115 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:08.707696 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06490f3f-0e42-4e31-a8a4-8f6e6e8b8115 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:08.708951 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06490f3f-0e42-4e31-a8a4-8f6e6e8b8115 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:09.246352 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-06490f3f-0e42-4e31-a8a4-8f6e6e8b8115 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:09.258517 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-06490f3f-0e42-4e31-a8a4-8f6e6e8b8115 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.570248 Apr 06 16:41:09.259788 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 176/367] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:08 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:09.279361 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2f80a864-1399-4742-8192-e05c996bd2af tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:09.280788 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2f80a864-1399-4742-8192-e05c996bd2af tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:09.289451 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f80a864-1399-4742-8192-e05c996bd2af tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:09.290300 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f80a864-1399-4742-8192-e05c996bd2af tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:09.291375 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f80a864-1399-4742-8192-e05c996bd2af tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:09.292409 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f80a864-1399-4742-8192-e05c996bd2af tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:09.352030 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6e0aff95-1093-407b-aaaa-b3ebbbbcdf1f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:09.352640 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6e0aff95-1093-407b-aaaa-b3ebbbbcdf1f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:09.375951 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e0aff95-1093-407b-aaaa-b3ebbbbcdf1f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:09.378505 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e0aff95-1093-407b-aaaa-b3ebbbbcdf1f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:09.383734 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e0aff95-1093-407b-aaaa-b3ebbbbcdf1f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:09.384384 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e0aff95-1093-407b-aaaa-b3ebbbbcdf1f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:09.512840 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2f80a864-1399-4742-8192-e05c996bd2af tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:09.524432 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2f80a864-1399-4742-8192-e05c996bd2af tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1709 microversion: 2.1 time: 0.250014 Apr 06 16:41:09.534629 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 192/368] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:09 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1709 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:09.685596 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6e0aff95-1093-407b-aaaa-b3ebbbbcdf1f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:09.700234 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6e0aff95-1093-407b-aaaa-b3ebbbbcdf1f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:09.705485 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6e0aff95-1093-407b-aaaa-b3ebbbbcdf1f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:09.721919 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6e0aff95-1093-407b-aaaa-b3ebbbbcdf1f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1738 microversion: 2.20 time: 0.372287 Apr 06 16:41:09.735330 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 177/369] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:09 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1738 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:10.277076 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d2d242a9-df34-44dc-b5ea-983f9cfec557 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:10.277526 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d2d242a9-df34-44dc-b5ea-983f9cfec557 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:10.288074 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2d242a9-df34-44dc-b5ea-983f9cfec557 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:10.289414 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2d242a9-df34-44dc-b5ea-983f9cfec557 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:10.290430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2d242a9-df34-44dc-b5ea-983f9cfec557 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:10.291086 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2d242a9-df34-44dc-b5ea-983f9cfec557 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:10.459472 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d2d242a9-df34-44dc-b5ea-983f9cfec557 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:10.468458 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d2d242a9-df34-44dc-b5ea-983f9cfec557 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1523 microversion: 2.1 time: 0.196085 Apr 06 16:41:10.481321 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 193/370] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:10 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:10.542942 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eedccba5-2664-46fc-b083-a766e0501bf9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:10.543816 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eedccba5-2664-46fc-b083-a766e0501bf9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:10.551367 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eedccba5-2664-46fc-b083-a766e0501bf9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:10.552205 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eedccba5-2664-46fc-b083-a766e0501bf9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:10.553250 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eedccba5-2664-46fc-b083-a766e0501bf9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:10.553755 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eedccba5-2664-46fc-b083-a766e0501bf9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:10.721938 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-eedccba5-2664-46fc-b083-a766e0501bf9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:10.732001 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eedccba5-2664-46fc-b083-a766e0501bf9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1709 microversion: 2.1 time: 0.191997 Apr 06 16:41:10.732001 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 178/371] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:10 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1709 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:10.744971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-50e7949e-4577-422d-9673-550ec5c86e82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:10.745577 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-50e7949e-4577-422d-9673-550ec5c86e82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:10.758783 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50e7949e-4577-422d-9673-550ec5c86e82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:10.759101 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50e7949e-4577-422d-9673-550ec5c86e82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:10.759956 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50e7949e-4577-422d-9673-550ec5c86e82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:10.760449 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50e7949e-4577-422d-9673-550ec5c86e82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:10.878881 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d437d2ba-cf22-47cc-8b51-d5890bf756fe tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:10.879395 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d437d2ba-cf22-47cc-8b51-d5890bf756fe tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:10.891146 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d437d2ba-cf22-47cc-8b51-d5890bf756fe tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:10.891839 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d437d2ba-cf22-47cc-8b51-d5890bf756fe tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:10.892582 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d437d2ba-cf22-47cc-8b51-d5890bf756fe tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:10.893071 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d437d2ba-cf22-47cc-8b51-d5890bf756fe tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:10.966151 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d437d2ba-cf22-47cc-8b51-d5890bf756fe tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 06 16:41:10.986154 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-50e7949e-4577-422d-9673-550ec5c86e82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:10.996156 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-50e7949e-4577-422d-9673-550ec5c86e82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:10.999335 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-50e7949e-4577-422d-9673-550ec5c86e82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:11.002218 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-50e7949e-4577-422d-9673-550ec5c86e82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1738 microversion: 2.20 time: 0.260888 Apr 06 16:41:11.003267 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 194/372] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:10 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1738 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:11.114965 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d437d2ba-cf22-47cc-8b51-d5890bf756fe tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 204 len: 0 microversion: 2.1 time: 0.239762 Apr 06 16:41:11.118996 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 179/373] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 16:41:10 2022] DELETE /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 06 16:41:11.125097 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dcdf4da7-cf8c-4ba2-8431-7bdfcd1b6582 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:11.126052 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dcdf4da7-cf8c-4ba2-8431-7bdfcd1b6582 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:11.145662 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dcdf4da7-cf8c-4ba2-8431-7bdfcd1b6582 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:11.147490 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dcdf4da7-cf8c-4ba2-8431-7bdfcd1b6582 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:11.152664 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dcdf4da7-cf8c-4ba2-8431-7bdfcd1b6582 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:11.153326 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dcdf4da7-cf8c-4ba2-8431-7bdfcd1b6582 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:11.350765 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-dcdf4da7-cf8c-4ba2-8431-7bdfcd1b6582 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:11.363083 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dcdf4da7-cf8c-4ba2-8431-7bdfcd1b6582 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1515 microversion: 2.1 time: 0.242419 Apr 06 16:41:11.363994 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 195/374] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:11 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1515 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:11.489909 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8252348a-2b68-4a44-ab37-95d81543cd49 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:11.491009 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8252348a-2b68-4a44-ab37-95d81543cd49 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:11.498060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8252348a-2b68-4a44-ab37-95d81543cd49 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:11.498896 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8252348a-2b68-4a44-ab37-95d81543cd49 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:11.499986 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8252348a-2b68-4a44-ab37-95d81543cd49 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:11.501156 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8252348a-2b68-4a44-ab37-95d81543cd49 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:11.709292 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8252348a-2b68-4a44-ab37-95d81543cd49 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:11.719369 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8252348a-2b68-4a44-ab37-95d81543cd49 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1503 microversion: 2.1 time: 0.234529 Apr 06 16:41:11.721440 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 180/375] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:11 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1503 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:11.737141 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aace688e-a011-49f5-910d-30e0c5599327 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:11.737963 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aace688e-a011-49f5-910d-30e0c5599327 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:11.748516 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aace688e-a011-49f5-910d-30e0c5599327 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:11.749016 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aace688e-a011-49f5-910d-30e0c5599327 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:11.749941 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aace688e-a011-49f5-910d-30e0c5599327 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:11.750511 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aace688e-a011-49f5-910d-30e0c5599327 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:11.751882 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-938df811-ea8a-4874-83ad-3297cc232350 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:11.752487 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-938df811-ea8a-4874-83ad-3297cc232350 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:11.759066 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-938df811-ea8a-4874-83ad-3297cc232350 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:11.760840 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-938df811-ea8a-4874-83ad-3297cc232350 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:11.761897 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-938df811-ea8a-4874-83ad-3297cc232350 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:11.762541 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-938df811-ea8a-4874-83ad-3297cc232350 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:11.952909 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-aace688e-a011-49f5-910d-30e0c5599327 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:11.956520 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-938df811-ea8a-4874-83ad-3297cc232350 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:11.967636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aace688e-a011-49f5-910d-30e0c5599327 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1517 microversion: 2.1 time: 0.234823 Apr 06 16:41:11.972727 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 196/376] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:11 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1517 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:11.978831 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-938df811-ea8a-4874-83ad-3297cc232350 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1709 microversion: 2.1 time: 0.228032 Apr 06 16:41:11.980441 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 181/377] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:11 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1709 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:12.020748 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d8ff8c13-b2db-4210-9d07-90919721c2e6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:12.021414 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d8ff8c13-b2db-4210-9d07-90919721c2e6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:12.027880 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8ff8c13-b2db-4210-9d07-90919721c2e6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:12.028322 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8ff8c13-b2db-4210-9d07-90919721c2e6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:12.029137 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8ff8c13-b2db-4210-9d07-90919721c2e6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:12.029564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8ff8c13-b2db-4210-9d07-90919721c2e6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:12.222317 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d8ff8c13-b2db-4210-9d07-90919721c2e6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:12.231053 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d8ff8c13-b2db-4210-9d07-90919721c2e6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:12.232567 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d8ff8c13-b2db-4210-9d07-90919721c2e6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:12.233783 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d8ff8c13-b2db-4210-9d07-90919721c2e6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1738 microversion: 2.20 time: 0.217975 Apr 06 16:41:12.234359 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 197/378] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:12 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:12.383640 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b95a63f8-8fdf-470f-b48c-c090980371f6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:12.384601 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b95a63f8-8fdf-470f-b48c-c090980371f6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:12.399841 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b95a63f8-8fdf-470f-b48c-c090980371f6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:12.400446 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b95a63f8-8fdf-470f-b48c-c090980371f6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:12.403762 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b95a63f8-8fdf-470f-b48c-c090980371f6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:12.404475 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b95a63f8-8fdf-470f-b48c-c090980371f6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:12.599977 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b95a63f8-8fdf-470f-b48c-c090980371f6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:12.608256 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b95a63f8-8fdf-470f-b48c-c090980371f6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1515 microversion: 2.1 time: 0.228888 Apr 06 16:41:12.609252 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 182/379] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:12 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1515 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:12.999704 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-694a0a24-1190-4345-9bd8-2c5555df4fcf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:13.001652 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-694a0a24-1190-4345-9bd8-2c5555df4fcf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:13.010164 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-694a0a24-1190-4345-9bd8-2c5555df4fcf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:13.011576 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-694a0a24-1190-4345-9bd8-2c5555df4fcf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:13.013391 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-694a0a24-1190-4345-9bd8-2c5555df4fcf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:13.014420 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-694a0a24-1190-4345-9bd8-2c5555df4fcf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:13.182901 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-694a0a24-1190-4345-9bd8-2c5555df4fcf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:13.192308 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-694a0a24-1190-4345-9bd8-2c5555df4fcf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1713 microversion: 2.1 time: 0.197028 Apr 06 16:41:13.193218 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 198/380] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:12 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1713 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:13.254066 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ed83ef9a-d95a-4ca8-b1c7-09ec7aaecaf8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:13.254638 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ed83ef9a-d95a-4ca8-b1c7-09ec7aaecaf8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:13.261629 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed83ef9a-d95a-4ca8-b1c7-09ec7aaecaf8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:13.262171 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed83ef9a-d95a-4ca8-b1c7-09ec7aaecaf8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:13.263034 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed83ef9a-d95a-4ca8-b1c7-09ec7aaecaf8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:13.263541 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed83ef9a-d95a-4ca8-b1c7-09ec7aaecaf8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:13.434864 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ed83ef9a-d95a-4ca8-b1c7-09ec7aaecaf8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:13.444246 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ed83ef9a-d95a-4ca8-b1c7-09ec7aaecaf8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:13.445802 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ed83ef9a-d95a-4ca8-b1c7-09ec7aaecaf8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:13.447024 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ed83ef9a-d95a-4ca8-b1c7-09ec7aaecaf8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1738 microversion: 2.20 time: 0.197978 Apr 06 16:41:13.447877 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 183/381] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:13 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:13.490580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-92928a6b-55b8-409c-82be-791848886b12 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:41:13.491638 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-92928a6b-55b8-409c-82be-791848886b12 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:13.498593 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92928a6b-55b8-409c-82be-791848886b12 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:13.499032 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92928a6b-55b8-409c-82be-791848886b12 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:13.499839 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92928a6b-55b8-409c-82be-791848886b12 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:13.500337 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92928a6b-55b8-409c-82be-791848886b12 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:13.533645 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-92928a6b-55b8-409c-82be-791848886b12 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lazy-loading 'flavor' on Instance uuid c42ef26f-42b4-4e28-a22b-48c9149966cc {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 06 16:41:13.629144 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-06981c91-bde0-4b40-9028-365c87a5b68e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:13.629791 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-06981c91-bde0-4b40-9028-365c87a5b68e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:13.638251 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06981c91-bde0-4b40-9028-365c87a5b68e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:13.638979 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06981c91-bde0-4b40-9028-365c87a5b68e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:13.639974 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06981c91-bde0-4b40-9028-365c87a5b68e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:13.640553 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06981c91-bde0-4b40-9028-365c87a5b68e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:13.645004 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-92928a6b-55b8-409c-82be-791848886b12 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "POST /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc/action" status: 200 len: 32 microversion: 2.1 time: 0.157448 Apr 06 16:41:13.651135 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 199/382] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Apr 6 16:41:13 2022] POST /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 06 16:41:13.667245 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-952f2e06-1a13-482d-937e-58519bbafafd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:13.668217 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-952f2e06-1a13-482d-937e-58519bbafafd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:13.680370 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-952f2e06-1a13-482d-937e-58519bbafafd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:13.681159 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-952f2e06-1a13-482d-937e-58519bbafafd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:13.682575 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-952f2e06-1a13-482d-937e-58519bbafafd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:13.683320 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-952f2e06-1a13-482d-937e-58519bbafafd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:13.813978 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-06981c91-bde0-4b40-9028-365c87a5b68e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:13.823347 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-06981c91-bde0-4b40-9028-365c87a5b68e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1515 microversion: 2.1 time: 0.199476 Apr 06 16:41:13.825000 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 184/383] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:13 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1515 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:14.097290 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-952f2e06-1a13-482d-937e-58519bbafafd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:14.113016 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-952f2e06-1a13-482d-937e-58519bbafafd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.459179 Apr 06 16:41:14.114548 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 200/384] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:13 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:14.466312 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-68ecd4b0-8779-4df7-9e16-c3569fa73c0d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:14.466950 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-68ecd4b0-8779-4df7-9e16-c3569fa73c0d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:14.473405 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68ecd4b0-8779-4df7-9e16-c3569fa73c0d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:14.473854 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68ecd4b0-8779-4df7-9e16-c3569fa73c0d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:14.474623 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68ecd4b0-8779-4df7-9e16-c3569fa73c0d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:14.475051 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68ecd4b0-8779-4df7-9e16-c3569fa73c0d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:14.630527 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-68ecd4b0-8779-4df7-9e16-c3569fa73c0d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:14.641583 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-68ecd4b0-8779-4df7-9e16-c3569fa73c0d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:14.643393 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-68ecd4b0-8779-4df7-9e16-c3569fa73c0d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:14.645248 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-68ecd4b0-8779-4df7-9e16-c3569fa73c0d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1738 microversion: 2.20 time: 0.182399 Apr 06 16:41:14.645881 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 185/385] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:14 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:14.841770 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-72d1782c-a9f8-4e05-880e-b641bce99044 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:14.842415 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-72d1782c-a9f8-4e05-880e-b641bce99044 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:14.852009 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72d1782c-a9f8-4e05-880e-b641bce99044 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:14.852009 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72d1782c-a9f8-4e05-880e-b641bce99044 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:14.852009 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72d1782c-a9f8-4e05-880e-b641bce99044 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:14.852009 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72d1782c-a9f8-4e05-880e-b641bce99044 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:14.995810 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-72d1782c-a9f8-4e05-880e-b641bce99044 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:15.003966 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-72d1782c-a9f8-4e05-880e-b641bce99044 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1515 microversion: 2.1 time: 0.166282 Apr 06 16:41:15.004550 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 201/386] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:14 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:15.131471 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-579eaf0e-5ed7-426e-8b9c-97bd3c78f1c8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:15.132081 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-579eaf0e-5ed7-426e-8b9c-97bd3c78f1c8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:15.139864 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-579eaf0e-5ed7-426e-8b9c-97bd3c78f1c8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:15.140399 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-579eaf0e-5ed7-426e-8b9c-97bd3c78f1c8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:15.141461 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-579eaf0e-5ed7-426e-8b9c-97bd3c78f1c8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:15.141990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-579eaf0e-5ed7-426e-8b9c-97bd3c78f1c8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:15.284796 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-579eaf0e-5ed7-426e-8b9c-97bd3c78f1c8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:15.292820 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-579eaf0e-5ed7-426e-8b9c-97bd3c78f1c8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.165311 Apr 06 16:41:15.293365 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 186/387] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:15 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:15.666000 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-335594d7-98c8-474e-8835-fe37af3c0e5c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:15.666628 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-335594d7-98c8-474e-8835-fe37af3c0e5c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:15.673789 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-335594d7-98c8-474e-8835-fe37af3c0e5c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:15.674206 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-335594d7-98c8-474e-8835-fe37af3c0e5c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:15.674993 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-335594d7-98c8-474e-8835-fe37af3c0e5c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:15.675426 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-335594d7-98c8-474e-8835-fe37af3c0e5c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:15.825556 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-335594d7-98c8-474e-8835-fe37af3c0e5c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:15.834829 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-335594d7-98c8-474e-8835-fe37af3c0e5c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:15.836323 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-335594d7-98c8-474e-8835-fe37af3c0e5c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:15.837526 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-335594d7-98c8-474e-8835-fe37af3c0e5c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1738 microversion: 2.20 time: 0.175637 Apr 06 16:41:15.838092 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 202/388] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:15 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:16.023734 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7df73c03-48df-4f52-acbc-b2dfc42ef491 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:16.024386 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7df73c03-48df-4f52-acbc-b2dfc42ef491 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:16.031312 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7df73c03-48df-4f52-acbc-b2dfc42ef491 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:16.031772 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7df73c03-48df-4f52-acbc-b2dfc42ef491 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:16.032628 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7df73c03-48df-4f52-acbc-b2dfc42ef491 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:16.033282 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7df73c03-48df-4f52-acbc-b2dfc42ef491 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:16.187442 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7df73c03-48df-4f52-acbc-b2dfc42ef491 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:16.196274 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7df73c03-48df-4f52-acbc-b2dfc42ef491 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1515 microversion: 2.1 time: 0.177632 Apr 06 16:41:16.196855 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 187/389] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:16 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:16.311079 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-365b318f-894c-45c5-9cef-752e50280db7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:16.311678 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-365b318f-894c-45c5-9cef-752e50280db7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:16.322098 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-365b318f-894c-45c5-9cef-752e50280db7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:16.322548 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-365b318f-894c-45c5-9cef-752e50280db7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:16.323339 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-365b318f-894c-45c5-9cef-752e50280db7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:16.323767 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-365b318f-894c-45c5-9cef-752e50280db7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:16.473269 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-365b318f-894c-45c5-9cef-752e50280db7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:16.481333 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-365b318f-894c-45c5-9cef-752e50280db7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.174799 Apr 06 16:41:16.481897 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 203/390] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:16 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:16.856500 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3b986b9a-eaf9-4356-afb1-75536bfacfec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:16.857514 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3b986b9a-eaf9-4356-afb1-75536bfacfec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:16.864230 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b986b9a-eaf9-4356-afb1-75536bfacfec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:16.864716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b986b9a-eaf9-4356-afb1-75536bfacfec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:16.865488 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b986b9a-eaf9-4356-afb1-75536bfacfec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:16.865918 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b986b9a-eaf9-4356-afb1-75536bfacfec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:17.015366 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3b986b9a-eaf9-4356-afb1-75536bfacfec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:17.024191 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3b986b9a-eaf9-4356-afb1-75536bfacfec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:17.025723 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3b986b9a-eaf9-4356-afb1-75536bfacfec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:17.026989 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3b986b9a-eaf9-4356-afb1-75536bfacfec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1738 microversion: 2.20 time: 0.175016 Apr 06 16:41:17.027555 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 188/391] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:16 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:17.214810 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c5d1c2eb-cd8d-433e-8591-e53ebe02b12b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:17.215682 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c5d1c2eb-cd8d-433e-8591-e53ebe02b12b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:17.228720 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5d1c2eb-cd8d-433e-8591-e53ebe02b12b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:17.229173 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5d1c2eb-cd8d-433e-8591-e53ebe02b12b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:17.229954 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5d1c2eb-cd8d-433e-8591-e53ebe02b12b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:17.230381 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5d1c2eb-cd8d-433e-8591-e53ebe02b12b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:17.381569 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c5d1c2eb-cd8d-433e-8591-e53ebe02b12b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:17.389519 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c5d1c2eb-cd8d-433e-8591-e53ebe02b12b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1515 microversion: 2.1 time: 0.179188 Apr 06 16:41:17.390103 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 204/392] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:17 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:17.500011 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-759e6695-f3eb-4867-a208-3e2fad3b24af tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:17.500622 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-759e6695-f3eb-4867-a208-3e2fad3b24af tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:17.508120 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-759e6695-f3eb-4867-a208-3e2fad3b24af tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:17.508542 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-759e6695-f3eb-4867-a208-3e2fad3b24af tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:17.509585 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-759e6695-f3eb-4867-a208-3e2fad3b24af tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:17.510022 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-759e6695-f3eb-4867-a208-3e2fad3b24af tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:17.669655 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-759e6695-f3eb-4867-a208-3e2fad3b24af tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:17.690420 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-759e6695-f3eb-4867-a208-3e2fad3b24af tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.193860 Apr 06 16:41:17.690786 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 189/393] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:17 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:18.048345 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9e8fbe29-5c65-472d-b175-e093e57610ba tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:18.049131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9e8fbe29-5c65-472d-b175-e093e57610ba tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:18.056102 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e8fbe29-5c65-472d-b175-e093e57610ba tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:18.056551 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e8fbe29-5c65-472d-b175-e093e57610ba tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:18.057366 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e8fbe29-5c65-472d-b175-e093e57610ba tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:18.057799 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e8fbe29-5c65-472d-b175-e093e57610ba tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:18.347333 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9e8fbe29-5c65-472d-b175-e093e57610ba tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:18.359321 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9e8fbe29-5c65-472d-b175-e093e57610ba tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:18.361669 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9e8fbe29-5c65-472d-b175-e093e57610ba tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:18.363328 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9e8fbe29-5c65-472d-b175-e093e57610ba tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1720 microversion: 2.20 time: 0.320710 Apr 06 16:41:18.364409 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 205/394] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:18 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1720 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:18.405959 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5f1b94b7-de56-4f71-b542-96e464bd12b0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:18.407261 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5f1b94b7-de56-4f71-b542-96e464bd12b0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:18.414741 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f1b94b7-de56-4f71-b542-96e464bd12b0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:18.415423 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f1b94b7-de56-4f71-b542-96e464bd12b0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:18.416377 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f1b94b7-de56-4f71-b542-96e464bd12b0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:18.417233 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f1b94b7-de56-4f71-b542-96e464bd12b0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:18.711915 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f1e564d1-f630-4809-aab1-f5370f0e49bf tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:18.713237 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f1e564d1-f630-4809-aab1-f5370f0e49bf tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:18.721191 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5f1b94b7-de56-4f71-b542-96e464bd12b0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:18.735189 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5f1b94b7-de56-4f71-b542-96e464bd12b0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1515 microversion: 2.1 time: 0.333071 Apr 06 16:41:18.736665 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 190/395] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:18 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1515 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:18.740177 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1e564d1-f630-4809-aab1-f5370f0e49bf tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:18.741083 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1e564d1-f630-4809-aab1-f5370f0e49bf tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:18.743200 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1e564d1-f630-4809-aab1-f5370f0e49bf tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:18.744216 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1e564d1-f630-4809-aab1-f5370f0e49bf tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:18.833058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-e50eced5-bc28-426f-a6c8-fca3284d36e5 req-00263dce-f034-4aac-8a5f-4f3868ced17b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d4bd75f-9dad-4b01-a3c0-62891ee17877", "name": "network-vif-deleted", "tag": "dee44748-f2e3-46e6-9952-27fcadf3c288"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:41:18.841684 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e50eced5-bc28-426f-a6c8-fca3284d36e5 req-00263dce-f034-4aac-8a5f-4f3868ced17b service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:18.842126 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e50eced5-bc28-426f-a6c8-fca3284d36e5 req-00263dce-f034-4aac-8a5f-4f3868ced17b service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:18.856333 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-e50eced5-bc28-426f-a6c8-fca3284d36e5 req-00263dce-f034-4aac-8a5f-4f3868ced17b service nova] Creating event network-vif-deleted:dee44748-f2e3-46e6-9952-27fcadf3c288 for instance 6d4bd75f-9dad-4b01-a3c0-62891ee17877 on hv-cinder-83684 Apr 06 16:41:18.863547 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-e50eced5-bc28-426f-a6c8-fca3284d36e5 req-00263dce-f034-4aac-8a5f-4f3868ced17b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035765 Apr 06 16:41:18.864523 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 191/396] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:41:18.946951 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f1e564d1-f630-4809-aab1-f5370f0e49bf tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:18.954835 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f1e564d1-f630-4809-aab1-f5370f0e49bf tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.250346 Apr 06 16:41:18.955463 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 206/397] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:18 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:19.384081 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c607e983-bcdd-4436-801c-9f4212d07d4a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:19.384992 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c607e983-bcdd-4436-801c-9f4212d07d4a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:19.391555 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c607e983-bcdd-4436-801c-9f4212d07d4a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:19.392072 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c607e983-bcdd-4436-801c-9f4212d07d4a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:19.392992 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c607e983-bcdd-4436-801c-9f4212d07d4a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:19.393425 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c607e983-bcdd-4436-801c-9f4212d07d4a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:19.538554 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c607e983-bcdd-4436-801c-9f4212d07d4a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:19.547453 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c607e983-bcdd-4436-801c-9f4212d07d4a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:19.549317 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c607e983-bcdd-4436-801c-9f4212d07d4a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:19.550716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c607e983-bcdd-4436-801c-9f4212d07d4a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1720 microversion: 2.20 time: 0.171026 Apr 06 16:41:19.551276 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 192/398] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:19 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:19.768104 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-56139bbd-91ed-4970-8777-8d07e5bc5db3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:19.768899 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-56139bbd-91ed-4970-8777-8d07e5bc5db3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:19.774907 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56139bbd-91ed-4970-8777-8d07e5bc5db3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:19.775387 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56139bbd-91ed-4970-8777-8d07e5bc5db3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:19.776194 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56139bbd-91ed-4970-8777-8d07e5bc5db3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:19.776628 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56139bbd-91ed-4970-8777-8d07e5bc5db3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:19.842599 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-56139bbd-91ed-4970-8777-8d07e5bc5db3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:19.850501 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-56139bbd-91ed-4970-8777-8d07e5bc5db3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1304 microversion: 2.1 time: 0.087650 Apr 06 16:41:19.851109 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 207/399] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:19 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1304 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:19.871560 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-04b6cbbb-5951-4e2d-86cd-57269b19ffb2 req-8dc3f581-b882-4217-ac8d-7e98828f21b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330d17b1-0d7d-4519-8dc3-3210eb25aa3c", "name": "network-vif-unplugged", "status": "completed", "tag": "e267cfb2-7045-4a09-851f-05d45654d0a1"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:41:19.880595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-04b6cbbb-5951-4e2d-86cd-57269b19ffb2 req-8dc3f581-b882-4217-ac8d-7e98828f21b7 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:19.881219 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-04b6cbbb-5951-4e2d-86cd-57269b19ffb2 req-8dc3f581-b882-4217-ac8d-7e98828f21b7 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:19.897742 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-04b6cbbb-5951-4e2d-86cd-57269b19ffb2 req-8dc3f581-b882-4217-ac8d-7e98828f21b7 service nova] Creating event network-vif-unplugged:e267cfb2-7045-4a09-851f-05d45654d0a1 for instance 330d17b1-0d7d-4519-8dc3-3210eb25aa3c on hv-cinder-83684 Apr 06 16:41:19.903722 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-04b6cbbb-5951-4e2d-86cd-57269b19ffb2 req-8dc3f581-b882-4217-ac8d-7e98828f21b7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038116 Apr 06 16:41:19.904340 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 193/400] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:41:19.973690 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4ff09884-277b-486a-baba-c1f83054cb4e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:19.973690 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4ff09884-277b-486a-baba-c1f83054cb4e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:19.979370 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ff09884-277b-486a-baba-c1f83054cb4e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:19.979916 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ff09884-277b-486a-baba-c1f83054cb4e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:19.980844 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ff09884-277b-486a-baba-c1f83054cb4e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:19.981279 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ff09884-277b-486a-baba-c1f83054cb4e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:20.136056 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4ff09884-277b-486a-baba-c1f83054cb4e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:20.146559 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4ff09884-277b-486a-baba-c1f83054cb4e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.178380 Apr 06 16:41:20.147583 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 208/401] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:19 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:20.573591 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a6d04707-3b54-4f14-993f-0713bbc82cb2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:20.574457 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a6d04707-3b54-4f14-993f-0713bbc82cb2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:20.582986 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6d04707-3b54-4f14-993f-0713bbc82cb2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:20.583523 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6d04707-3b54-4f14-993f-0713bbc82cb2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:20.584343 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6d04707-3b54-4f14-993f-0713bbc82cb2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:20.584804 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6d04707-3b54-4f14-993f-0713bbc82cb2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:20.737893 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a6d04707-3b54-4f14-993f-0713bbc82cb2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:20.746881 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a6d04707-3b54-4f14-993f-0713bbc82cb2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:20.748364 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a6d04707-3b54-4f14-993f-0713bbc82cb2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:20.749625 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a6d04707-3b54-4f14-993f-0713bbc82cb2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1720 microversion: 2.20 time: 0.182920 Apr 06 16:41:20.750226 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 194/402] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:20 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:20.870642 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a75b2712-ad22-46ca-b623-09c29fb361ae tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:20.871666 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a75b2712-ad22-46ca-b623-09c29fb361ae tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:20.880365 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a75b2712-ad22-46ca-b623-09c29fb361ae tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:20.880841 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a75b2712-ad22-46ca-b623-09c29fb361ae tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:20.881606 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a75b2712-ad22-46ca-b623-09c29fb361ae tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:20.882020 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a75b2712-ad22-46ca-b623-09c29fb361ae tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:20.944678 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a75b2712-ad22-46ca-b623-09c29fb361ae tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:20.953433 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a75b2712-ad22-46ca-b623-09c29fb361ae tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1304 microversion: 2.1 time: 0.088307 Apr 06 16:41:20.954003 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 209/403] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:20 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1304 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:21.168297 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8387167d-aa91-42da-ac7f-96bbb22a3825 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:21.168950 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8387167d-aa91-42da-ac7f-96bbb22a3825 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:21.175300 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8387167d-aa91-42da-ac7f-96bbb22a3825 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:21.175758 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8387167d-aa91-42da-ac7f-96bbb22a3825 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:21.176537 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8387167d-aa91-42da-ac7f-96bbb22a3825 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:21.177004 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8387167d-aa91-42da-ac7f-96bbb22a3825 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:21.331685 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8387167d-aa91-42da-ac7f-96bbb22a3825 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:21.340295 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8387167d-aa91-42da-ac7f-96bbb22a3825 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.175841 Apr 06 16:41:21.340894 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 195/404] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:21 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:21.772088 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0dcee8e6-3f3a-48db-a004-aa6b79460849 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:21.772614 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0dcee8e6-3f3a-48db-a004-aa6b79460849 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:21.779616 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0dcee8e6-3f3a-48db-a004-aa6b79460849 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:21.780096 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0dcee8e6-3f3a-48db-a004-aa6b79460849 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:21.780913 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0dcee8e6-3f3a-48db-a004-aa6b79460849 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:21.781363 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0dcee8e6-3f3a-48db-a004-aa6b79460849 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:21.945169 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0dcee8e6-3f3a-48db-a004-aa6b79460849 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:21.953159 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0dcee8e6-3f3a-48db-a004-aa6b79460849 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:21.954802 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0dcee8e6-3f3a-48db-a004-aa6b79460849 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:21.956159 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0dcee8e6-3f3a-48db-a004-aa6b79460849 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1723 microversion: 2.20 time: 0.191009 Apr 06 16:41:21.956741 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 210/405] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:21 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:41:21.972255 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-12c05383-a0b0-4ecb-a827-8d6551bc664e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:21.973088 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-12c05383-a0b0-4ecb-a827-8d6551bc664e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:21.975825 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-11956233-d0fb-47fd-9e30-6d90d73ce329 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9410269a-3541-47f1-938f-5b827c7e11ae"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:41:21.977165 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-11956233-d0fb-47fd-9e30-6d90d73ce329 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:21.981391 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12c05383-a0b0-4ecb-a827-8d6551bc664e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:21.981921 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12c05383-a0b0-4ecb-a827-8d6551bc664e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:21.982931 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12c05383-a0b0-4ecb-a827-8d6551bc664e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:21.983436 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12c05383-a0b0-4ecb-a827-8d6551bc664e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:21.984252 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11956233-d0fb-47fd-9e30-6d90d73ce329 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:21.984843 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11956233-d0fb-47fd-9e30-6d90d73ce329 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:21.985796 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11956233-d0fb-47fd-9e30-6d90d73ce329 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:21.986290 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11956233-d0fb-47fd-9e30-6d90d73ce329 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:22.021341 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12c05383-a0b0-4ecb-a827-8d6551bc664e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:22.021978 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12c05383-a0b0-4ecb-a827-8d6551bc664e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:22.022392 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-12c05383-a0b0-4ecb-a827-8d6551bc664e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lazy-loading 'fault' on Instance uuid 6d4bd75f-9dad-4b01-a3c0-62891ee17877 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 06 16:41:22.066005 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-12c05383-a0b0-4ecb-a827-8d6551bc664e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:22.073609 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-12c05383-a0b0-4ecb-a827-8d6551bc664e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 200 len: 1309 microversion: 2.1 time: 0.105644 Apr 06 16:41:22.074184 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 196/406] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:21 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:22.317318 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-11956233-d0fb-47fd-9e30-6d90d73ce329 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "POST /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.346367 Apr 06 16:41:22.317945 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 211/407] 10.222.0.64 () {62 vars in 1363 bytes} [Wed Apr 6 16:41:21 2022] POST /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 188 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:41:22.358561 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0a6c70ea-ef58-4d87-a20d-fde01ec4bebe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:22.363362 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0a6c70ea-ef58-4d87-a20d-fde01ec4bebe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:22.371462 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a6c70ea-ef58-4d87-a20d-fde01ec4bebe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:22.371989 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a6c70ea-ef58-4d87-a20d-fde01ec4bebe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:22.372921 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a6c70ea-ef58-4d87-a20d-fde01ec4bebe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:22.373421 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a6c70ea-ef58-4d87-a20d-fde01ec4bebe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:22.449696 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a8a31564-fcec-4616-a1f3-5f37428483a4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:41:22.450256 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a8a31564-fcec-4616-a1f3-5f37428483a4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:22.457781 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8a31564-fcec-4616-a1f3-5f37428483a4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:22.458557 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8a31564-fcec-4616-a1f3-5f37428483a4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:22.459006 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8a31564-fcec-4616-a1f3-5f37428483a4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:22.459619 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8a31564-fcec-4616-a1f3-5f37428483a4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:22.563273 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0a6c70ea-ef58-4d87-a20d-fde01ec4bebe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:22.573501 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0a6c70ea-ef58-4d87-a20d-fde01ec4bebe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.217927 Apr 06 16:41:22.574578 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 197/408] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:22 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:22.641840 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a8a31564-fcec-4616-a1f3-5f37428483a4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "POST /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/action" status: 202 len: 0 microversion: 2.20 time: 0.192561 Apr 06 16:41:22.642527 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 212/409] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Apr 6 16:41:22 2022] POST /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 06 16:41:22.651176 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e47d4d3f-dd52-4fb5-9140-fd9b6c947468 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:22.652155 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e47d4d3f-dd52-4fb5-9140-fd9b6c947468 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:22.663313 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e47d4d3f-dd52-4fb5-9140-fd9b6c947468 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:22.663763 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e47d4d3f-dd52-4fb5-9140-fd9b6c947468 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:22.664656 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e47d4d3f-dd52-4fb5-9140-fd9b6c947468 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:22.665082 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e47d4d3f-dd52-4fb5-9140-fd9b6c947468 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:22.864621 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e47d4d3f-dd52-4fb5-9140-fd9b6c947468 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:22.880554 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e47d4d3f-dd52-4fb5-9140-fd9b6c947468 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:22.883432 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e47d4d3f-dd52-4fb5-9140-fd9b6c947468 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:22.886002 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e47d4d3f-dd52-4fb5-9140-fd9b6c947468 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1749 microversion: 2.20 time: 0.238955 Apr 06 16:41:22.886946 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 198/410] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:22 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1749 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:23.093047 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e4fb5380-e165-455c-8025-5b8b4dec7293 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:23.094792 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e4fb5380-e165-455c-8025-5b8b4dec7293 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: 6d4bd75f-9dad-4b01-a3c0-62891ee17877] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:23.102305 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4fb5380-e165-455c-8025-5b8b4dec7293 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:23.103051 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4fb5380-e165-455c-8025-5b8b4dec7293 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:23.104150 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4fb5380-e165-455c-8025-5b8b4dec7293 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:23.105252 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4fb5380-e165-455c-8025-5b8b4dec7293 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:23.124593 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-e4fb5380-e165-455c-8025-5b8b4dec7293 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] HTTP exception thrown: Instance 6d4bd75f-9dad-4b01-a3c0-62891ee17877 could not be found. Apr 06 16:41:23.125712 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e4fb5380-e165-455c-8025-5b8b4dec7293 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Returning 404 to user: Instance 6d4bd75f-9dad-4b01-a3c0-62891ee17877 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 16:41:23.128451 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e4fb5380-e165-455c-8025-5b8b4dec7293 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877" status: 404 len: 111 microversion: 2.1 time: 0.041143 Apr 06 16:41:23.133375 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 213/411] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:23 2022] GET /compute/v2.1/servers/6d4bd75f-9dad-4b01-a3c0-62891ee17877 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 16:41:23.591567 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c06a20b3-5eb7-44da-9646-d3f1a2de399b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:23.592110 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c06a20b3-5eb7-44da-9646-d3f1a2de399b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:23.599765 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c06a20b3-5eb7-44da-9646-d3f1a2de399b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:23.600214 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c06a20b3-5eb7-44da-9646-d3f1a2de399b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:23.601217 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c06a20b3-5eb7-44da-9646-d3f1a2de399b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:23.601648 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c06a20b3-5eb7-44da-9646-d3f1a2de399b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:23.756815 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c06a20b3-5eb7-44da-9646-d3f1a2de399b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:23.764891 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c06a20b3-5eb7-44da-9646-d3f1a2de399b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.177256 Apr 06 16:41:23.765471 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 199/412] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:23 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:23.916786 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f81509b6-733a-4813-8ed4-c119258fecb4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:23.917817 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f81509b6-733a-4813-8ed4-c119258fecb4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:23.929294 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f81509b6-733a-4813-8ed4-c119258fecb4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:23.929790 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f81509b6-733a-4813-8ed4-c119258fecb4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:23.930915 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f81509b6-733a-4813-8ed4-c119258fecb4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:23.931245 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f81509b6-733a-4813-8ed4-c119258fecb4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:24.092333 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f81509b6-733a-4813-8ed4-c119258fecb4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:24.101441 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f81509b6-733a-4813-8ed4-c119258fecb4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:24.102912 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f81509b6-733a-4813-8ed4-c119258fecb4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:24.104108 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f81509b6-733a-4813-8ed4-c119258fecb4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1749 microversion: 2.20 time: 0.193033 Apr 06 16:41:24.104669 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 214/413] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:23 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1749 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:24.783279 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b30022e8-47a3-4855-bb65-2e9cc52a0cee tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:24.783870 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b30022e8-47a3-4855-bb65-2e9cc52a0cee tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:24.790769 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b30022e8-47a3-4855-bb65-2e9cc52a0cee tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:24.791217 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b30022e8-47a3-4855-bb65-2e9cc52a0cee tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:24.792009 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b30022e8-47a3-4855-bb65-2e9cc52a0cee tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:24.792439 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b30022e8-47a3-4855-bb65-2e9cc52a0cee tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:24.937200 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b30022e8-47a3-4855-bb65-2e9cc52a0cee tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:24.945380 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b30022e8-47a3-4855-bb65-2e9cc52a0cee tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.166531 Apr 06 16:41:24.945966 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 200/414] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:24 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:25.123416 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9876967b-1fab-4b96-bb62-b702e8f81afe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:25.124005 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9876967b-1fab-4b96-bb62-b702e8f81afe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:25.132263 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9876967b-1fab-4b96-bb62-b702e8f81afe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:25.132836 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9876967b-1fab-4b96-bb62-b702e8f81afe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:25.133613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9876967b-1fab-4b96-bb62-b702e8f81afe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:25.134035 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9876967b-1fab-4b96-bb62-b702e8f81afe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:25.278671 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9876967b-1fab-4b96-bb62-b702e8f81afe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:25.288257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9876967b-1fab-4b96-bb62-b702e8f81afe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:25.289719 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9876967b-1fab-4b96-bb62-b702e8f81afe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:25.290880 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9876967b-1fab-4b96-bb62-b702e8f81afe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1749 microversion: 2.20 time: 0.171431 Apr 06 16:41:25.291435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 215/415] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:25 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1749 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:25.962920 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ba5418a5-d119-4179-8474-ce3f3d45d27e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:25.963519 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ba5418a5-d119-4179-8474-ce3f3d45d27e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:25.970903 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba5418a5-d119-4179-8474-ce3f3d45d27e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:25.971366 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba5418a5-d119-4179-8474-ce3f3d45d27e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:25.972152 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba5418a5-d119-4179-8474-ce3f3d45d27e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:25.972586 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba5418a5-d119-4179-8474-ce3f3d45d27e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:26.120756 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ba5418a5-d119-4179-8474-ce3f3d45d27e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:26.128378 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ba5418a5-d119-4179-8474-ce3f3d45d27e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.169364 Apr 06 16:41:26.128995 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 201/416] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:25 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:26.312612 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-887b7ebc-0e3e-4605-8069-7663ce0928ae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:26.313239 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-887b7ebc-0e3e-4605-8069-7663ce0928ae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:26.320646 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-887b7ebc-0e3e-4605-8069-7663ce0928ae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:26.321185 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-887b7ebc-0e3e-4605-8069-7663ce0928ae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:26.321906 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-887b7ebc-0e3e-4605-8069-7663ce0928ae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:26.322336 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-887b7ebc-0e3e-4605-8069-7663ce0928ae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:26.499265 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-887b7ebc-0e3e-4605-8069-7663ce0928ae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:26.508547 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-887b7ebc-0e3e-4605-8069-7663ce0928ae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:26.510211 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-887b7ebc-0e3e-4605-8069-7663ce0928ae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:26.511522 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-887b7ebc-0e3e-4605-8069-7663ce0928ae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1749 microversion: 2.20 time: 0.205306 Apr 06 16:41:26.512229 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 216/417] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:26 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1749 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:27.146895 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1c5930fa-7b69-4b7e-a26d-cbbb7d80a906 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:27.147629 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1c5930fa-7b69-4b7e-a26d-cbbb7d80a906 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:27.154377 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c5930fa-7b69-4b7e-a26d-cbbb7d80a906 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:27.154832 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c5930fa-7b69-4b7e-a26d-cbbb7d80a906 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:27.155609 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c5930fa-7b69-4b7e-a26d-cbbb7d80a906 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:27.156043 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c5930fa-7b69-4b7e-a26d-cbbb7d80a906 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:27.299980 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1c5930fa-7b69-4b7e-a26d-cbbb7d80a906 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:27.314803 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1c5930fa-7b69-4b7e-a26d-cbbb7d80a906 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.171369 Apr 06 16:41:27.316019 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 202/418] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:27 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:27.535641 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-93065333-5591-4af5-9a70-109c39474a96 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:27.536698 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-93065333-5591-4af5-9a70-109c39474a96 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:27.546370 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93065333-5591-4af5-9a70-109c39474a96 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:27.547385 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93065333-5591-4af5-9a70-109c39474a96 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:27.548603 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93065333-5591-4af5-9a70-109c39474a96 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:27.549393 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93065333-5591-4af5-9a70-109c39474a96 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:27.713595 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-93065333-5591-4af5-9a70-109c39474a96 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:27.725131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-93065333-5591-4af5-9a70-109c39474a96 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:27.726815 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-93065333-5591-4af5-9a70-109c39474a96 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:27.728518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-93065333-5591-4af5-9a70-109c39474a96 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1751 microversion: 2.20 time: 0.200124 Apr 06 16:41:27.729955 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 217/419] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:27 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1751 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:28.331798 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-772672a7-45f4-49b9-8356-62403ca84e11 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:28.332407 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-772672a7-45f4-49b9-8356-62403ca84e11 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:28.339379 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-772672a7-45f4-49b9-8356-62403ca84e11 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:28.339824 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-772672a7-45f4-49b9-8356-62403ca84e11 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:28.340670 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-772672a7-45f4-49b9-8356-62403ca84e11 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:28.341142 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-772672a7-45f4-49b9-8356-62403ca84e11 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:28.490451 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-772672a7-45f4-49b9-8356-62403ca84e11 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:28.498675 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-772672a7-45f4-49b9-8356-62403ca84e11 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.170854 Apr 06 16:41:28.499262 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 203/420] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:28 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:28.749974 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-af10abb8-06a1-4721-933f-d04196d4b6e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:28.751568 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-af10abb8-06a1-4721-933f-d04196d4b6e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:28.761073 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af10abb8-06a1-4721-933f-d04196d4b6e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:28.761889 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af10abb8-06a1-4721-933f-d04196d4b6e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:28.762896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af10abb8-06a1-4721-933f-d04196d4b6e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:28.763473 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af10abb8-06a1-4721-933f-d04196d4b6e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:29.042378 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-af10abb8-06a1-4721-933f-d04196d4b6e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:29.051703 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-af10abb8-06a1-4721-933f-d04196d4b6e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:29.053213 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-af10abb8-06a1-4721-933f-d04196d4b6e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:29.054358 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-af10abb8-06a1-4721-933f-d04196d4b6e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1807 microversion: 2.20 time: 0.308382 Apr 06 16:41:29.055633 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 218/421] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:28 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1807 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:29.515575 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-52bc4be1-17c8-40f9-8beb-01ed1e6067a6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:29.516191 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-52bc4be1-17c8-40f9-8beb-01ed1e6067a6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:29.523001 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52bc4be1-17c8-40f9-8beb-01ed1e6067a6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:29.523473 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52bc4be1-17c8-40f9-8beb-01ed1e6067a6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:29.524245 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52bc4be1-17c8-40f9-8beb-01ed1e6067a6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:29.524715 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52bc4be1-17c8-40f9-8beb-01ed1e6067a6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:29.675444 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-52bc4be1-17c8-40f9-8beb-01ed1e6067a6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:29.683471 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-52bc4be1-17c8-40f9-8beb-01ed1e6067a6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.171679 Apr 06 16:41:29.693358 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 204/422] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:29 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:30.074140 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c794638f-a879-4d9a-a339-fd36af24021e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:30.074866 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c794638f-a879-4d9a-a339-fd36af24021e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:30.081425 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c794638f-a879-4d9a-a339-fd36af24021e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:30.081874 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c794638f-a879-4d9a-a339-fd36af24021e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:30.082656 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c794638f-a879-4d9a-a339-fd36af24021e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:30.083090 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c794638f-a879-4d9a-a339-fd36af24021e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:30.234974 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c794638f-a879-4d9a-a339-fd36af24021e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:30.247041 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c794638f-a879-4d9a-a339-fd36af24021e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:30.248851 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c794638f-a879-4d9a-a339-fd36af24021e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:30.250156 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c794638f-a879-4d9a-a339-fd36af24021e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1807 microversion: 2.20 time: 0.180404 Apr 06 16:41:30.250834 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 219/423] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:30 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:30.705486 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2948bc8f-00b4-42cd-be2b-ab331b7d4888 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:30.706345 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2948bc8f-00b4-42cd-be2b-ab331b7d4888 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:30.713525 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2948bc8f-00b4-42cd-be2b-ab331b7d4888 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:30.714270 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2948bc8f-00b4-42cd-be2b-ab331b7d4888 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:30.714963 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2948bc8f-00b4-42cd-be2b-ab331b7d4888 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:30.715389 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2948bc8f-00b4-42cd-be2b-ab331b7d4888 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:31.215972 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2948bc8f-00b4-42cd-be2b-ab331b7d4888 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:31.234382 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2948bc8f-00b4-42cd-be2b-ab331b7d4888 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.533308 Apr 06 16:41:31.234976 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 205/424] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:30 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:31.270268 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-def0e38f-4549-4472-9aa6-b71fb88babad tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:31.271519 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-def0e38f-4549-4472-9aa6-b71fb88babad tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:31.278311 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-def0e38f-4549-4472-9aa6-b71fb88babad tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:31.278761 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-def0e38f-4549-4472-9aa6-b71fb88babad tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:31.280203 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-def0e38f-4549-4472-9aa6-b71fb88babad tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:31.280640 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-def0e38f-4549-4472-9aa6-b71fb88babad tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:31.475786 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-def0e38f-4549-4472-9aa6-b71fb88babad tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:31.486547 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-def0e38f-4549-4472-9aa6-b71fb88babad tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:31.489046 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-def0e38f-4549-4472-9aa6-b71fb88babad tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:31.491330 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-def0e38f-4549-4472-9aa6-b71fb88babad tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1807 microversion: 2.20 time: 0.226322 Apr 06 16:41:31.492402 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 220/425] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:31 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1807 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:32.204909 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8337f9c6-e509-4f17-99a0-c0d1ebd57940 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-435145370", "imageRef": "c217dd2b-7679-4860-b2e6-01a967f654df", "flavorRef": "452", "networks": [{"uuid": "ad69759f-602d-4488-99ad-7c868afbb4a0"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:41:32.252209 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2bba6b5c-137d-4755-8354-dd4c2af2a9a2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:32.253189 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2bba6b5c-137d-4755-8354-dd4c2af2a9a2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:32.260870 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bba6b5c-137d-4755-8354-dd4c2af2a9a2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:32.264101 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bba6b5c-137d-4755-8354-dd4c2af2a9a2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:32.267923 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bba6b5c-137d-4755-8354-dd4c2af2a9a2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:32.268465 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bba6b5c-137d-4755-8354-dd4c2af2a9a2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:32.275105 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-8337f9c6-e509-4f17-99a0-c0d1ebd57940 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] validate_networks() for [('ad69759f-602d-4488-99ad-7c868afbb4a0', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 06 16:41:32.463370 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2bba6b5c-137d-4755-8354-dd4c2af2a9a2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:32.473381 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2bba6b5c-137d-4755-8354-dd4c2af2a9a2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.225633 Apr 06 16:41:32.475486 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 221/426] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:32 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:32.512244 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8d6c9b6d-99ad-471f-9f98-d80d5f465373 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:32.513561 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8d6c9b6d-99ad-471f-9f98-d80d5f465373 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:32.525028 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d6c9b6d-99ad-471f-9f98-d80d5f465373 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:32.526988 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d6c9b6d-99ad-471f-9f98-d80d5f465373 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:32.528261 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d6c9b6d-99ad-471f-9f98-d80d5f465373 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:32.529000 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d6c9b6d-99ad-471f-9f98-d80d5f465373 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:32.744572 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8d6c9b6d-99ad-471f-9f98-d80d5f465373 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:32.776162 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8d6c9b6d-99ad-471f-9f98-d80d5f465373 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:32.802153 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8d6c9b6d-99ad-471f-9f98-d80d5f465373 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:32.803396 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8d6c9b6d-99ad-471f-9f98-d80d5f465373 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1807 microversion: 2.20 time: 0.296406 Apr 06 16:41:32.810804 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 222/427] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:32 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1807 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:33.075207 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-8337f9c6-e509-4f17-99a0-c0d1ebd57940 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 06 16:41:33.075851 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-8337f9c6-e509-4f17-99a0-c0d1ebd57940 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 06 16:41:33.076479 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-8337f9c6-e509-4f17-99a0-c0d1ebd57940 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 06 16:41:33.077088 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-8337f9c6-e509-4f17-99a0-c0d1ebd57940 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 06 16:41:33.077652 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-8337f9c6-e509-4f17-99a0-c0d1ebd57940 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 06 16:41:33.093181 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8337f9c6-e509-4f17-99a0-c0d1ebd57940 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:33.093632 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8337f9c6-e509-4f17-99a0-c0d1ebd57940 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:33.100250 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8337f9c6-e509-4f17-99a0-c0d1ebd57940 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:33.100993 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8337f9c6-e509-4f17-99a0-c0d1ebd57940 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:33.138276 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-8337f9c6-e509-4f17-99a0-c0d1ebd57940 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Getting quotas for project ae63fb1fb5834fb8969a587fde2f5729. Resources: {'instances', 'cores', 'ram'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 16:41:33.146386 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-8337f9c6-e509-4f17-99a0-c0d1ebd57940 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Getting quotas for user de76c0a653a4440b9029b92154f9df1e and project ae63fb1fb5834fb8969a587fde2f5729. Resources: {'instances', 'cores', 'ram'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 16:41:33.176438 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8337f9c6-e509-4f17-99a0-c0d1ebd57940 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 06 16:41:33.179172 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8337f9c6-e509-4f17-99a0-c0d1ebd57940 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c217dd2b-7679-4860-b2e6-01a967f654df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 06 16:41:33.297392 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8337f9c6-e509-4f17-99a0-c0d1ebd57940 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.096552 Apr 06 16:41:33.298258 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 206/428] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Apr 6 16:41:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 06 16:41:33.308492 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6342dc33-3525-4774-9a55-563e3a43e484 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:33.309185 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6342dc33-3525-4774-9a55-563e3a43e484 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:33.473267 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6342dc33-3525-4774-9a55-563e3a43e484 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:33.482068 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6342dc33-3525-4774-9a55-563e3a43e484 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1218 microversion: 2.1 time: 0.177312 Apr 06 16:41:33.482658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 223/429] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:33 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1218 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:33.500327 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c8a0cef9-df39-449b-a69a-ba3be31f85a0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:33.501270 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c8a0cef9-df39-449b-a69a-ba3be31f85a0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:33.512716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8a0cef9-df39-449b-a69a-ba3be31f85a0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:33.513188 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8a0cef9-df39-449b-a69a-ba3be31f85a0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:33.514007 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8a0cef9-df39-449b-a69a-ba3be31f85a0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:33.514543 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8a0cef9-df39-449b-a69a-ba3be31f85a0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:33.825916 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e502ea21-f7a7-451c-b52a-4b1d6d0fd905 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:33.826968 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e502ea21-f7a7-451c-b52a-4b1d6d0fd905 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:33.843451 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e502ea21-f7a7-451c-b52a-4b1d6d0fd905 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:33.845066 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e502ea21-f7a7-451c-b52a-4b1d6d0fd905 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:33.847485 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e502ea21-f7a7-451c-b52a-4b1d6d0fd905 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:33.852661 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e502ea21-f7a7-451c-b52a-4b1d6d0fd905 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:33.872518 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c8a0cef9-df39-449b-a69a-ba3be31f85a0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:33.886786 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c8a0cef9-df39-449b-a69a-ba3be31f85a0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.389972 Apr 06 16:41:33.891371 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 207/430] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:33 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:34.236670 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e502ea21-f7a7-451c-b52a-4b1d6d0fd905 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:34.249917 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e502ea21-f7a7-451c-b52a-4b1d6d0fd905 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:34.252884 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e502ea21-f7a7-451c-b52a-4b1d6d0fd905 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:34.258720 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e502ea21-f7a7-451c-b52a-4b1d6d0fd905 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1807 microversion: 2.20 time: 0.439631 Apr 06 16:41:34.271184 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 224/431] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:33 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1807 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:41:34.500036 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-25596c4d-a9a5-4c99-a5be-17cb3c20ada4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:34.501538 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-25596c4d-a9a5-4c99-a5be-17cb3c20ada4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:34.510394 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25596c4d-a9a5-4c99-a5be-17cb3c20ada4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:34.511267 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25596c4d-a9a5-4c99-a5be-17cb3c20ada4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:34.512641 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25596c4d-a9a5-4c99-a5be-17cb3c20ada4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:34.513351 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25596c4d-a9a5-4c99-a5be-17cb3c20ada4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:34.592330 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-25596c4d-a9a5-4c99-a5be-17cb3c20ada4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:34.601365 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-25596c4d-a9a5-4c99-a5be-17cb3c20ada4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1222 microversion: 2.1 time: 0.105328 Apr 06 16:41:34.603372 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 208/432] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:34 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:34.911180 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ee6b4506-2a28-4ac7-9ad7-4eaefe93eeb4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:34.912797 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ee6b4506-2a28-4ac7-9ad7-4eaefe93eeb4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:34.919282 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee6b4506-2a28-4ac7-9ad7-4eaefe93eeb4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:34.919978 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee6b4506-2a28-4ac7-9ad7-4eaefe93eeb4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:34.921048 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee6b4506-2a28-4ac7-9ad7-4eaefe93eeb4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:34.921695 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee6b4506-2a28-4ac7-9ad7-4eaefe93eeb4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:35.180822 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ee6b4506-2a28-4ac7-9ad7-4eaefe93eeb4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:35.191157 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ee6b4506-2a28-4ac7-9ad7-4eaefe93eeb4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.286916 Apr 06 16:41:35.209187 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 225/433] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:34 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:35.279410 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-070ea8a1-1b63-49bb-9125-638f9b50b045 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:35.280068 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-070ea8a1-1b63-49bb-9125-638f9b50b045 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:35.298964 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-070ea8a1-1b63-49bb-9125-638f9b50b045 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:35.299412 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-070ea8a1-1b63-49bb-9125-638f9b50b045 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:35.300210 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-070ea8a1-1b63-49bb-9125-638f9b50b045 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:35.302038 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-070ea8a1-1b63-49bb-9125-638f9b50b045 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:35.573414 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-070ea8a1-1b63-49bb-9125-638f9b50b045 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:35.628624 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-667100a1-f56f-41e2-a147-eb3fe289fd2d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:35.640384 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-667100a1-f56f-41e2-a147-eb3fe289fd2d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:35.653961 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-070ea8a1-1b63-49bb-9125-638f9b50b045 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:35.657217 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-070ea8a1-1b63-49bb-9125-638f9b50b045 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:35.659122 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-070ea8a1-1b63-49bb-9125-638f9b50b045 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1807 microversion: 2.20 time: 0.383782 Apr 06 16:41:35.660212 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 209/434] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:35 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1807 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:35.694442 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-667100a1-f56f-41e2-a147-eb3fe289fd2d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:35.696958 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-667100a1-f56f-41e2-a147-eb3fe289fd2d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:35.707857 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-667100a1-f56f-41e2-a147-eb3fe289fd2d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:35.712145 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-667100a1-f56f-41e2-a147-eb3fe289fd2d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:35.868480 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-667100a1-f56f-41e2-a147-eb3fe289fd2d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:35.881806 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-667100a1-f56f-41e2-a147-eb3fe289fd2d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1222 microversion: 2.1 time: 0.264097 Apr 06 16:41:35.884168 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 226/435] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:35 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1222 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:36.210123 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ff6ed5bc-34e4-46e3-b844-dc70f60b5913 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:36.211184 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ff6ed5bc-34e4-46e3-b844-dc70f60b5913 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:36.217861 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff6ed5bc-34e4-46e3-b844-dc70f60b5913 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:36.218698 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff6ed5bc-34e4-46e3-b844-dc70f60b5913 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:36.219770 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff6ed5bc-34e4-46e3-b844-dc70f60b5913 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:36.220431 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff6ed5bc-34e4-46e3-b844-dc70f60b5913 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:36.540994 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ff6ed5bc-34e4-46e3-b844-dc70f60b5913 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:36.555611 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ff6ed5bc-34e4-46e3-b844-dc70f60b5913 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.345941 Apr 06 16:41:36.556383 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 210/436] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:36 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:36.691853 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-110ffc19-825b-45c8-8901-b251bd71b9cc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:36.692616 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-110ffc19-825b-45c8-8901-b251bd71b9cc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:36.703950 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-110ffc19-825b-45c8-8901-b251bd71b9cc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:36.705537 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-110ffc19-825b-45c8-8901-b251bd71b9cc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:36.706858 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-110ffc19-825b-45c8-8901-b251bd71b9cc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:36.709620 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-110ffc19-825b-45c8-8901-b251bd71b9cc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:36.902634 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-29dec9ad-7725-4004-930e-0884c8521657 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:36.903323 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-29dec9ad-7725-4004-930e-0884c8521657 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:36.916330 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29dec9ad-7725-4004-930e-0884c8521657 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:36.917213 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29dec9ad-7725-4004-930e-0884c8521657 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:36.918498 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29dec9ad-7725-4004-930e-0884c8521657 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:36.919087 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29dec9ad-7725-4004-930e-0884c8521657 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:37.053513 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-29dec9ad-7725-4004-930e-0884c8521657 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:37.065824 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-29dec9ad-7725-4004-930e-0884c8521657 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1222 microversion: 2.1 time: 0.167791 Apr 06 16:41:37.067430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-110ffc19-825b-45c8-8901-b251bd71b9cc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:37.067849 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 211/437] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:36 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1222 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:37.087453 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-110ffc19-825b-45c8-8901-b251bd71b9cc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:37.091031 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-110ffc19-825b-45c8-8901-b251bd71b9cc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:37.091719 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-110ffc19-825b-45c8-8901-b251bd71b9cc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1807 microversion: 2.20 time: 0.407808 Apr 06 16:41:37.092877 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 227/438] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:36 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1807 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:37.575233 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3bf362a1-767e-4820-bd56-245e7d4f0264 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:37.576433 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3bf362a1-767e-4820-bd56-245e7d4f0264 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:37.593753 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bf362a1-767e-4820-bd56-245e7d4f0264 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:37.594227 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bf362a1-767e-4820-bd56-245e7d4f0264 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:37.595166 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bf362a1-767e-4820-bd56-245e7d4f0264 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:37.595596 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bf362a1-767e-4820-bd56-245e7d4f0264 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:37.792115 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3bf362a1-767e-4820-bd56-245e7d4f0264 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:37.801294 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3bf362a1-767e-4820-bd56-245e7d4f0264 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.230713 Apr 06 16:41:37.802193 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 212/439] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:37 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:38.089837 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8abbc22c-cc4d-4b70-84ff-a1d2b013e41b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:38.091256 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8abbc22c-cc4d-4b70-84ff-a1d2b013e41b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:38.099079 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8abbc22c-cc4d-4b70-84ff-a1d2b013e41b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:38.100002 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8abbc22c-cc4d-4b70-84ff-a1d2b013e41b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:38.101163 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8abbc22c-cc4d-4b70-84ff-a1d2b013e41b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:38.101765 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8abbc22c-cc4d-4b70-84ff-a1d2b013e41b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:38.111297 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c35c0497-c6f2-4b4d-a2b4-4255051d6155 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:38.112089 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c35c0497-c6f2-4b4d-a2b4-4255051d6155 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:38.122700 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c35c0497-c6f2-4b4d-a2b4-4255051d6155 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:38.127669 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c35c0497-c6f2-4b4d-a2b4-4255051d6155 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:38.128701 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c35c0497-c6f2-4b4d-a2b4-4255051d6155 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:38.129360 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c35c0497-c6f2-4b4d-a2b4-4255051d6155 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:38.284472 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8abbc22c-cc4d-4b70-84ff-a1d2b013e41b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:38.293461 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8abbc22c-cc4d-4b70-84ff-a1d2b013e41b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1222 microversion: 2.1 time: 0.213467 Apr 06 16:41:38.315962 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 228/440] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:38 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1222 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:38.559635 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c35c0497-c6f2-4b4d-a2b4-4255051d6155 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:38.582135 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c35c0497-c6f2-4b4d-a2b4-4255051d6155 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:38.584416 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c35c0497-c6f2-4b4d-a2b4-4255051d6155 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:38.588085 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c35c0497-c6f2-4b4d-a2b4-4255051d6155 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1807 microversion: 2.20 time: 0.481318 Apr 06 16:41:38.589607 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 213/441] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:38 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1807 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:41:38.822142 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-47c6bdc3-ec64-46e5-9077-4f1bd12d956b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:38.823094 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-47c6bdc3-ec64-46e5-9077-4f1bd12d956b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:38.835870 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47c6bdc3-ec64-46e5-9077-4f1bd12d956b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:38.839794 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47c6bdc3-ec64-46e5-9077-4f1bd12d956b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:38.841241 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47c6bdc3-ec64-46e5-9077-4f1bd12d956b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:38.843176 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47c6bdc3-ec64-46e5-9077-4f1bd12d956b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:39.245899 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-47c6bdc3-ec64-46e5-9077-4f1bd12d956b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:39.263340 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-47c6bdc3-ec64-46e5-9077-4f1bd12d956b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.447246 Apr 06 16:41:39.263929 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 229/442] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:38 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:39.334378 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2fcc450e-e4af-4668-a613-37acb1c6d5dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:39.335805 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2fcc450e-e4af-4668-a613-37acb1c6d5dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:39.347203 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2fcc450e-e4af-4668-a613-37acb1c6d5dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:39.347649 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2fcc450e-e4af-4668-a613-37acb1c6d5dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:39.348434 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2fcc450e-e4af-4668-a613-37acb1c6d5dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:39.348905 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2fcc450e-e4af-4668-a613-37acb1c6d5dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:39.472102 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2fcc450e-e4af-4668-a613-37acb1c6d5dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:39.484800 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2fcc450e-e4af-4668-a613-37acb1c6d5dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1222 microversion: 2.1 time: 0.154738 Apr 06 16:41:39.486995 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 214/443] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:39 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1222 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:39.609967 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6a6c6030-02c3-4ea4-a006-47ccb345de66 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:39.610625 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6a6c6030-02c3-4ea4-a006-47ccb345de66 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:39.622272 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6a6c6030-02c3-4ea4-a006-47ccb345de66 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:39.622878 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6a6c6030-02c3-4ea4-a006-47ccb345de66 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:39.623704 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6a6c6030-02c3-4ea4-a006-47ccb345de66 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:39.624137 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6a6c6030-02c3-4ea4-a006-47ccb345de66 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:39.925294 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6a6c6030-02c3-4ea4-a006-47ccb345de66 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:39.950977 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6a6c6030-02c3-4ea4-a006-47ccb345de66 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:39.953257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6a6c6030-02c3-4ea4-a006-47ccb345de66 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:39.956717 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6a6c6030-02c3-4ea4-a006-47ccb345de66 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1807 microversion: 2.20 time: 0.350625 Apr 06 16:41:39.958465 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 230/444] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:39 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1807 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:40.282012 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f2b3f52e-ebee-4996-ba8f-77aebc3c74da tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:40.282951 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f2b3f52e-ebee-4996-ba8f-77aebc3c74da tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:40.306612 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2b3f52e-ebee-4996-ba8f-77aebc3c74da tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:40.307079 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2b3f52e-ebee-4996-ba8f-77aebc3c74da tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:40.307895 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2b3f52e-ebee-4996-ba8f-77aebc3c74da tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:40.308325 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2b3f52e-ebee-4996-ba8f-77aebc3c74da tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:40.503984 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d2eac96c-b910-4b09-bebb-8637472f4212 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:40.504666 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d2eac96c-b910-4b09-bebb-8637472f4212 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:40.521752 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2eac96c-b910-4b09-bebb-8637472f4212 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:40.522211 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2eac96c-b910-4b09-bebb-8637472f4212 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:40.523013 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2eac96c-b910-4b09-bebb-8637472f4212 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:40.523448 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2eac96c-b910-4b09-bebb-8637472f4212 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:40.669621 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f2b3f52e-ebee-4996-ba8f-77aebc3c74da tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:40.678293 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f2b3f52e-ebee-4996-ba8f-77aebc3c74da tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.400230 Apr 06 16:41:40.681389 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 215/445] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:40 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:40.788236 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d2eac96c-b910-4b09-bebb-8637472f4212 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:40.820824 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d2eac96c-b910-4b09-bebb-8637472f4212 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1222 microversion: 2.1 time: 0.321031 Apr 06 16:41:40.821596 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 231/446] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:40 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1222 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:40.977398 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-524d3f75-5fa7-4ac6-b69a-64773c37594c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:40.978102 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-524d3f75-5fa7-4ac6-b69a-64773c37594c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:40.996359 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-524d3f75-5fa7-4ac6-b69a-64773c37594c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:41.000081 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-524d3f75-5fa7-4ac6-b69a-64773c37594c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:41.001256 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-524d3f75-5fa7-4ac6-b69a-64773c37594c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:41.001957 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-524d3f75-5fa7-4ac6-b69a-64773c37594c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:41.311129 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-524d3f75-5fa7-4ac6-b69a-64773c37594c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:41.356634 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-524d3f75-5fa7-4ac6-b69a-64773c37594c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:41.361198 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-524d3f75-5fa7-4ac6-b69a-64773c37594c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:41.367494 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-524d3f75-5fa7-4ac6-b69a-64773c37594c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1807 microversion: 2.20 time: 0.392931 Apr 06 16:41:41.372615 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 216/447] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:40 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1807 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:41.699622 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3851cb72-7279-4931-9c3b-ebf7ddef2751 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:41.701011 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3851cb72-7279-4931-9c3b-ebf7ddef2751 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:41.717197 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3851cb72-7279-4931-9c3b-ebf7ddef2751 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:41.722092 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3851cb72-7279-4931-9c3b-ebf7ddef2751 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:41.723293 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3851cb72-7279-4931-9c3b-ebf7ddef2751 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:41.723927 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3851cb72-7279-4931-9c3b-ebf7ddef2751 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:41.849583 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e5381d57-59f8-4651-b119-2f4a8f396e17 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:41.851101 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e5381d57-59f8-4651-b119-2f4a8f396e17 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:41.875978 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5381d57-59f8-4651-b119-2f4a8f396e17 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:41.879893 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5381d57-59f8-4651-b119-2f4a8f396e17 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:41.886014 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5381d57-59f8-4651-b119-2f4a8f396e17 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:41.886719 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5381d57-59f8-4651-b119-2f4a8f396e17 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:42.046909 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e5381d57-59f8-4651-b119-2f4a8f396e17 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:42.070075 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3851cb72-7279-4931-9c3b-ebf7ddef2751 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:42.072378 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e5381d57-59f8-4651-b119-2f4a8f396e17 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1222 microversion: 2.1 time: 0.235632 Apr 06 16:41:42.075544 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 217/448] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:41 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1222 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:42.081567 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3851cb72-7279-4931-9c3b-ebf7ddef2751 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.386479 Apr 06 16:41:42.082467 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 232/449] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:41 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:42.386779 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1e0f4a56-7fc6-4bfe-8fc5-9ae41a4e198f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:42.387757 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1e0f4a56-7fc6-4bfe-8fc5-9ae41a4e198f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:42.395546 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e0f4a56-7fc6-4bfe-8fc5-9ae41a4e198f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:42.396323 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e0f4a56-7fc6-4bfe-8fc5-9ae41a4e198f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:42.397347 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e0f4a56-7fc6-4bfe-8fc5-9ae41a4e198f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:42.398844 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e0f4a56-7fc6-4bfe-8fc5-9ae41a4e198f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:42.877433 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1e0f4a56-7fc6-4bfe-8fc5-9ae41a4e198f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:42.899624 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1e0f4a56-7fc6-4bfe-8fc5-9ae41a4e198f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:42.902183 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1e0f4a56-7fc6-4bfe-8fc5-9ae41a4e198f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:42.906251 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1e0f4a56-7fc6-4bfe-8fc5-9ae41a4e198f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1807 microversion: 2.20 time: 0.524018 Apr 06 16:41:42.911291 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 218/450] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:42 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1807 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:43.092953 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5eeb67b5-4fc0-4c94-bbe3-581f828b99b9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:43.093906 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5eeb67b5-4fc0-4c94-bbe3-581f828b99b9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:43.105532 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bfa4176e-cc04-4894-af25-49f8db045315 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:43.108561 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bfa4176e-cc04-4894-af25-49f8db045315 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:43.124096 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5eeb67b5-4fc0-4c94-bbe3-581f828b99b9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:43.124550 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5eeb67b5-4fc0-4c94-bbe3-581f828b99b9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:43.126527 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bfa4176e-cc04-4894-af25-49f8db045315 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:43.126971 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bfa4176e-cc04-4894-af25-49f8db045315 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:43.127766 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bfa4176e-cc04-4894-af25-49f8db045315 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:43.132034 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5eeb67b5-4fc0-4c94-bbe3-581f828b99b9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:43.132989 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5eeb67b5-4fc0-4c94-bbe3-581f828b99b9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:43.135232 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bfa4176e-cc04-4894-af25-49f8db045315 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:43.261397 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5eeb67b5-4fc0-4c94-bbe3-581f828b99b9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:43.271154 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5eeb67b5-4fc0-4c94-bbe3-581f828b99b9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1222 microversion: 2.1 time: 0.183000 Apr 06 16:41:43.272149 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 233/451] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:43 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1222 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:41:43.473995 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-bfa4176e-cc04-4894-af25-49f8db045315 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:43.488252 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bfa4176e-cc04-4894-af25-49f8db045315 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.388573 Apr 06 16:41:43.489188 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 219/452] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:43 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:43.930712 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a1925baf-e4f0-479d-b419-6089ad36a901 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:43.931322 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a1925baf-e4f0-479d-b419-6089ad36a901 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:43.940842 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1925baf-e4f0-479d-b419-6089ad36a901 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:43.941585 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1925baf-e4f0-479d-b419-6089ad36a901 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:43.942367 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1925baf-e4f0-479d-b419-6089ad36a901 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:43.942891 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1925baf-e4f0-479d-b419-6089ad36a901 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:44.122167 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a1925baf-e4f0-479d-b419-6089ad36a901 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:44.133273 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a1925baf-e4f0-479d-b419-6089ad36a901 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:44.134790 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a1925baf-e4f0-479d-b419-6089ad36a901 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:44.136067 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a1925baf-e4f0-479d-b419-6089ad36a901 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1807 microversion: 2.20 time: 0.211949 Apr 06 16:41:44.136646 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 234/453] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:43 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1807 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:44.297009 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-58fde84c-a6e2-4d81-bad8-06c8243ab131 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:44.297730 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-58fde84c-a6e2-4d81-bad8-06c8243ab131 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:44.311324 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58fde84c-a6e2-4d81-bad8-06c8243ab131 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:44.311324 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58fde84c-a6e2-4d81-bad8-06c8243ab131 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:44.311324 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58fde84c-a6e2-4d81-bad8-06c8243ab131 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:44.311324 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58fde84c-a6e2-4d81-bad8-06c8243ab131 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:44.444971 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-58fde84c-a6e2-4d81-bad8-06c8243ab131 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:44.453184 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-58fde84c-a6e2-4d81-bad8-06c8243ab131 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1270 microversion: 2.1 time: 0.160017 Apr 06 16:41:44.463390 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 220/454] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:44 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:44.506625 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-615a958d-210f-44b3-8734-1a738f46cb4d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:44.507647 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-615a958d-210f-44b3-8734-1a738f46cb4d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:44.517988 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-615a958d-210f-44b3-8734-1a738f46cb4d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:44.518447 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-615a958d-210f-44b3-8734-1a738f46cb4d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:44.519245 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-615a958d-210f-44b3-8734-1a738f46cb4d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:44.519678 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-615a958d-210f-44b3-8734-1a738f46cb4d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:44.717257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-615a958d-210f-44b3-8734-1a738f46cb4d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:44.739429 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-615a958d-210f-44b3-8734-1a738f46cb4d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.236441 Apr 06 16:41:44.744730 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 235/455] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:44 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:45.155546 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3447b70b-e8d7-44f8-8344-445f9f41a172 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:45.156438 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3447b70b-e8d7-44f8-8344-445f9f41a172 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:45.165635 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3447b70b-e8d7-44f8-8344-445f9f41a172 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:45.166387 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3447b70b-e8d7-44f8-8344-445f9f41a172 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:45.167434 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3447b70b-e8d7-44f8-8344-445f9f41a172 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:45.168066 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3447b70b-e8d7-44f8-8344-445f9f41a172 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:45.455559 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3447b70b-e8d7-44f8-8344-445f9f41a172 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:45.471163 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-37f32e98-d153-4019-abce-0ba5ea4ad88c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:45.472580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-37f32e98-d153-4019-abce-0ba5ea4ad88c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:45.479620 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3447b70b-e8d7-44f8-8344-445f9f41a172 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:45.482039 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37f32e98-d153-4019-abce-0ba5ea4ad88c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:45.482248 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3447b70b-e8d7-44f8-8344-445f9f41a172 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:45.482484 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37f32e98-d153-4019-abce-0ba5ea4ad88c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:45.483260 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37f32e98-d153-4019-abce-0ba5ea4ad88c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:45.483656 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3447b70b-e8d7-44f8-8344-445f9f41a172 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1807 microversion: 2.20 time: 0.332688 Apr 06 16:41:45.483811 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37f32e98-d153-4019-abce-0ba5ea4ad88c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:45.484384 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 221/456] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:45 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1807 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:45.577869 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-37f32e98-d153-4019-abce-0ba5ea4ad88c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:45.589559 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-37f32e98-d153-4019-abce-0ba5ea4ad88c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1288 microversion: 2.1 time: 0.122244 Apr 06 16:41:45.590500 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 236/457] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:45 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1288 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:45.757542 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e5cb5be0-22ae-48cc-8b78-6611581905f2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:45.758113 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e5cb5be0-22ae-48cc-8b78-6611581905f2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:45.771330 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5cb5be0-22ae-48cc-8b78-6611581905f2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:45.771785 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5cb5be0-22ae-48cc-8b78-6611581905f2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:45.772585 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5cb5be0-22ae-48cc-8b78-6611581905f2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:45.773064 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5cb5be0-22ae-48cc-8b78-6611581905f2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:46.341872 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e5cb5be0-22ae-48cc-8b78-6611581905f2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:46.354527 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e5cb5be0-22ae-48cc-8b78-6611581905f2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.601048 Apr 06 16:41:46.355387 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 222/458] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:45 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:46.507713 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2ffdcbe1-7d2c-4c0b-9283-3600d05bc122 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:46.510536 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2ffdcbe1-7d2c-4c0b-9283-3600d05bc122 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:46.526371 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ffdcbe1-7d2c-4c0b-9283-3600d05bc122 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:46.527221 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ffdcbe1-7d2c-4c0b-9283-3600d05bc122 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:46.528327 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ffdcbe1-7d2c-4c0b-9283-3600d05bc122 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:46.529656 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ffdcbe1-7d2c-4c0b-9283-3600d05bc122 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:46.609505 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c32d446b-0ef4-4a0c-9667-22fe6a3db3c3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:46.610255 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c32d446b-0ef4-4a0c-9667-22fe6a3db3c3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:46.636515 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c32d446b-0ef4-4a0c-9667-22fe6a3db3c3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:46.638703 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c32d446b-0ef4-4a0c-9667-22fe6a3db3c3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:46.639750 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c32d446b-0ef4-4a0c-9667-22fe6a3db3c3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:46.649413 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c32d446b-0ef4-4a0c-9667-22fe6a3db3c3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:46.833375 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2ffdcbe1-7d2c-4c0b-9283-3600d05bc122 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:46.849509 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2ffdcbe1-7d2c-4c0b-9283-3600d05bc122 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:46.852178 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2ffdcbe1-7d2c-4c0b-9283-3600d05bc122 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:46.854453 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2ffdcbe1-7d2c-4c0b-9283-3600d05bc122 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1807 microversion: 2.20 time: 0.352059 Apr 06 16:41:46.866135 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 237/459] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:46 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1807 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:46.911867 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c32d446b-0ef4-4a0c-9667-22fe6a3db3c3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:46.921740 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c32d446b-0ef4-4a0c-9667-22fe6a3db3c3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1318 microversion: 2.1 time: 0.317103 Apr 06 16:41:46.928916 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 223/460] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:46 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:41:47.381906 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7dcfb110-40f1-4609-a8d1-72c7d271960d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:47.382349 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7dcfb110-40f1-4609-a8d1-72c7d271960d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:47.391193 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dcfb110-40f1-4609-a8d1-72c7d271960d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:47.391772 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dcfb110-40f1-4609-a8d1-72c7d271960d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:47.392576 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dcfb110-40f1-4609-a8d1-72c7d271960d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:47.393038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dcfb110-40f1-4609-a8d1-72c7d271960d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:47.684501 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7dcfb110-40f1-4609-a8d1-72c7d271960d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:47.697226 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7dcfb110-40f1-4609-a8d1-72c7d271960d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1503 microversion: 2.1 time: 0.327093 Apr 06 16:41:47.710484 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 238/461] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:47 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1503 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:47.719238 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8c5d7001-fce5-4c77-bb67-9225c3e826d5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1760c7e4-5525-4c24-a5da-26c8d8d69f2b"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:41:47.720459 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8c5d7001-fce5-4c77-bb67-9225c3e826d5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:47.734377 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c5d7001-fce5-4c77-bb67-9225c3e826d5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:47.735043 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c5d7001-fce5-4c77-bb67-9225c3e826d5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:47.736428 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c5d7001-fce5-4c77-bb67-9225c3e826d5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:47.736909 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c5d7001-fce5-4c77-bb67-9225c3e826d5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:47.775719 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-8c5d7001-fce5-4c77-bb67-9225c3e826d5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] HTTP exception thrown: Cannot 'attach_volume' instance c42ef26f-42b4-4e28-a22b-48c9149966cc while it is in vm_state rescued Apr 06 16:41:47.781042 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8c5d7001-fce5-4c77-bb67-9225c3e826d5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Returning 409 to user: Cannot 'attach_volume' instance c42ef26f-42b4-4e28-a22b-48c9149966cc while it is in vm_state rescued {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 16:41:47.786037 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8c5d7001-fce5-4c77-bb67-9225c3e826d5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "POST /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.070813 Apr 06 16:41:47.787295 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 224/462] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Apr 6 16:41:47 2022] POST /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc/os-volume_attachments => generated 152 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 06 16:41:47.798913 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f0c33b28-8cf7-4fae-a14a-d9bfd718c62c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:41:47.802775 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f0c33b28-8cf7-4fae-a14a-d9bfd718c62c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:47.813853 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0c33b28-8cf7-4fae-a14a-d9bfd718c62c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:47.817444 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0c33b28-8cf7-4fae-a14a-d9bfd718c62c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:47.818553 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0c33b28-8cf7-4fae-a14a-d9bfd718c62c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:47.819165 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0c33b28-8cf7-4fae-a14a-d9bfd718c62c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:47.872634 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e37c3876-abaa-4bc3-9798-025d6a7fa09d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:47.873882 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e37c3876-abaa-4bc3-9798-025d6a7fa09d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:47.888509 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e37c3876-abaa-4bc3-9798-025d6a7fa09d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:47.889286 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e37c3876-abaa-4bc3-9798-025d6a7fa09d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:47.894139 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e37c3876-abaa-4bc3-9798-025d6a7fa09d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:47.894849 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e37c3876-abaa-4bc3-9798-025d6a7fa09d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:47.961363 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f0c33b28-8cf7-4fae-a14a-d9bfd718c62c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "POST /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc/action" status: 202 len: 0 microversion: 2.1 time: 0.168874 Apr 06 16:41:47.962682 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 239/463] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Apr 6 16:41:47 2022] POST /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 06 16:41:47.983409 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f9993784-ae3a-4d1c-88a4-9db97ee34be4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:47.984137 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f9993784-ae3a-4d1c-88a4-9db97ee34be4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:48.006266 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9993784-ae3a-4d1c-88a4-9db97ee34be4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:48.007500 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9993784-ae3a-4d1c-88a4-9db97ee34be4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:48.008549 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9993784-ae3a-4d1c-88a4-9db97ee34be4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:48.009210 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f9993784-ae3a-4d1c-88a4-9db97ee34be4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:48.305785 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f9993784-ae3a-4d1c-88a4-9db97ee34be4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:48.314795 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f9993784-ae3a-4d1c-88a4-9db97ee34be4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1318 microversion: 2.1 time: 0.350516 Apr 06 16:41:48.320898 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 240/464] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:47 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1318 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:48.326043 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4028bbf6-d89f-44c2-93d7-344b4e8e37d9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:48.331734 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4028bbf6-d89f-44c2-93d7-344b4e8e37d9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:48.348626 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4028bbf6-d89f-44c2-93d7-344b4e8e37d9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:48.349389 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4028bbf6-d89f-44c2-93d7-344b4e8e37d9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:48.350375 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4028bbf6-d89f-44c2-93d7-344b4e8e37d9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:48.350972 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4028bbf6-d89f-44c2-93d7-344b4e8e37d9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:48.394100 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e37c3876-abaa-4bc3-9798-025d6a7fa09d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:48.418823 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e37c3876-abaa-4bc3-9798-025d6a7fa09d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:48.420753 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e37c3876-abaa-4bc3-9798-025d6a7fa09d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:48.422313 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e37c3876-abaa-4bc3-9798-025d6a7fa09d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1807 microversion: 2.20 time: 0.553544 Apr 06 16:41:48.423596 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 225/465] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:47 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1807 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:48.429059 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-c6a65ce0-024a-4d9a-a796-69a76eb61eb4 req-a23ff565-08db-415f-934e-48d8cd5c2c4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce", "tag": "e5eff3a1-0302-4963-a5c6-4309ac8d884f"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:41:48.439358 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c6a65ce0-024a-4d9a-a796-69a76eb61eb4 req-a23ff565-08db-415f-934e-48d8cd5c2c4c service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:48.440080 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c6a65ce0-024a-4d9a-a796-69a76eb61eb4 req-a23ff565-08db-415f-934e-48d8cd5c2c4c service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:48.464798 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-c6a65ce0-024a-4d9a-a796-69a76eb61eb4 req-a23ff565-08db-415f-934e-48d8cd5c2c4c service nova] Creating event network-changed:e5eff3a1-0302-4963-a5c6-4309ac8d884f for instance c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce on hv-cinder-83684 Apr 06 16:41:48.473071 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-c6a65ce0-024a-4d9a-a796-69a76eb61eb4 req-a23ff565-08db-415f-934e-48d8cd5c2c4c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046505 Apr 06 16:41:48.475779 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 226/466] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:41:48.747409 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4028bbf6-d89f-44c2-93d7-344b4e8e37d9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:48.759343 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4028bbf6-d89f-44c2-93d7-344b4e8e37d9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1511 microversion: 2.1 time: 0.436786 Apr 06 16:41:48.761059 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 241/467] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:48 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1511 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:49.338608 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-75a47981-093e-48c4-a16d-cf634e8319fb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:49.340608 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-75a47981-093e-48c4-a16d-cf634e8319fb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:49.360595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75a47981-093e-48c4-a16d-cf634e8319fb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:49.361256 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75a47981-093e-48c4-a16d-cf634e8319fb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:49.362076 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75a47981-093e-48c4-a16d-cf634e8319fb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:49.362518 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75a47981-093e-48c4-a16d-cf634e8319fb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:49.449098 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c24262fa-05ad-4834-8e10-71787ab8e226 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:49.450510 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c24262fa-05ad-4834-8e10-71787ab8e226 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:49.462941 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c24262fa-05ad-4834-8e10-71787ab8e226 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:49.463304 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c24262fa-05ad-4834-8e10-71787ab8e226 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:49.470910 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c24262fa-05ad-4834-8e10-71787ab8e226 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:49.477308 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c24262fa-05ad-4834-8e10-71787ab8e226 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:49.594953 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-75a47981-093e-48c4-a16d-cf634e8319fb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:49.605140 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-75a47981-093e-48c4-a16d-cf634e8319fb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1318 microversion: 2.1 time: 0.271207 Apr 06 16:41:49.608113 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 227/468] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:49 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:49.775947 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fb737d78-5123-428e-a69e-941fd7581838 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:49.776921 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fb737d78-5123-428e-a69e-941fd7581838 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:49.787898 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb737d78-5123-428e-a69e-941fd7581838 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:49.790652 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb737d78-5123-428e-a69e-941fd7581838 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:49.795662 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb737d78-5123-428e-a69e-941fd7581838 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:49.796263 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb737d78-5123-428e-a69e-941fd7581838 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:49.848245 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c24262fa-05ad-4834-8e10-71787ab8e226 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:49.861484 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c24262fa-05ad-4834-8e10-71787ab8e226 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:49.862985 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c24262fa-05ad-4834-8e10-71787ab8e226 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:49.864336 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c24262fa-05ad-4834-8e10-71787ab8e226 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1807 microversion: 2.20 time: 0.420010 Apr 06 16:41:49.875418 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 242/469] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:49 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1807 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:41:50.007836 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fb737d78-5123-428e-a69e-941fd7581838 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:50.018495 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fb737d78-5123-428e-a69e-941fd7581838 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1511 microversion: 2.1 time: 0.246386 Apr 06 16:41:50.019059 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 228/470] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:49 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1511 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:41:50.625858 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-746f20ea-485f-4198-8f5d-adace7ddf643 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:50.627055 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-746f20ea-485f-4198-8f5d-adace7ddf643 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:50.637777 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-746f20ea-485f-4198-8f5d-adace7ddf643 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:50.638345 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-746f20ea-485f-4198-8f5d-adace7ddf643 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:50.640410 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-746f20ea-485f-4198-8f5d-adace7ddf643 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:50.641543 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-746f20ea-485f-4198-8f5d-adace7ddf643 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:50.836816 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-746f20ea-485f-4198-8f5d-adace7ddf643 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:50.845301 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-746f20ea-485f-4198-8f5d-adace7ddf643 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1318 microversion: 2.1 time: 0.223981 Apr 06 16:41:50.846288 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 243/471] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:50 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:50.883551 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a749444e-3c7d-4b3b-9ccb-bc27dfba2949 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:50.884918 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a749444e-3c7d-4b3b-9ccb-bc27dfba2949 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:50.893356 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a749444e-3c7d-4b3b-9ccb-bc27dfba2949 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:50.894101 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a749444e-3c7d-4b3b-9ccb-bc27dfba2949 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:50.895101 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a749444e-3c7d-4b3b-9ccb-bc27dfba2949 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:50.895537 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a749444e-3c7d-4b3b-9ccb-bc27dfba2949 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:51.039475 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-676d707a-1aad-4f77-8b6a-c970d16aa6b0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:51.040049 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-676d707a-1aad-4f77-8b6a-c970d16aa6b0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:51.067470 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-676d707a-1aad-4f77-8b6a-c970d16aa6b0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:51.068051 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-676d707a-1aad-4f77-8b6a-c970d16aa6b0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:51.077867 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-676d707a-1aad-4f77-8b6a-c970d16aa6b0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:51.078320 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-676d707a-1aad-4f77-8b6a-c970d16aa6b0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:51.189569 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a749444e-3c7d-4b3b-9ccb-bc27dfba2949 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:51.201184 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a749444e-3c7d-4b3b-9ccb-bc27dfba2949 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:51.203233 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a749444e-3c7d-4b3b-9ccb-bc27dfba2949 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:51.204944 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a749444e-3c7d-4b3b-9ccb-bc27dfba2949 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1807 microversion: 2.20 time: 0.325494 Apr 06 16:41:51.206083 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 229/472] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:50 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1807 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:51.330687 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-676d707a-1aad-4f77-8b6a-c970d16aa6b0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:51.342999 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-676d707a-1aad-4f77-8b6a-c970d16aa6b0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1511 microversion: 2.1 time: 0.307504 Apr 06 16:41:51.343596 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 244/473] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:51 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1511 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:41:51.863530 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-22a8b581-1918-4e38-8404-af87dd2fe949 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:51.864123 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-22a8b581-1918-4e38-8404-af87dd2fe949 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:51.875013 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22a8b581-1918-4e38-8404-af87dd2fe949 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:51.875537 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22a8b581-1918-4e38-8404-af87dd2fe949 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:51.876341 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22a8b581-1918-4e38-8404-af87dd2fe949 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:51.876830 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22a8b581-1918-4e38-8404-af87dd2fe949 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:52.053600 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-22a8b581-1918-4e38-8404-af87dd2fe949 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:52.061740 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-22a8b581-1918-4e38-8404-af87dd2fe949 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1318 microversion: 2.1 time: 0.202276 Apr 06 16:41:52.063612 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 230/474] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:51 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:52.229425 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0d536b98-18f5-4ee9-9c22-6341f8f3c312 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:52.230033 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0d536b98-18f5-4ee9-9c22-6341f8f3c312 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:52.236671 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d536b98-18f5-4ee9-9c22-6341f8f3c312 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:52.237148 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d536b98-18f5-4ee9-9c22-6341f8f3c312 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:52.244858 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d536b98-18f5-4ee9-9c22-6341f8f3c312 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:52.245777 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d536b98-18f5-4ee9-9c22-6341f8f3c312 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:52.365385 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-df37c5e8-7afb-47a7-aa12-a993b2981fd7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:52.365989 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-df37c5e8-7afb-47a7-aa12-a993b2981fd7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:52.373704 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df37c5e8-7afb-47a7-aa12-a993b2981fd7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:52.374157 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df37c5e8-7afb-47a7-aa12-a993b2981fd7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:52.376041 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df37c5e8-7afb-47a7-aa12-a993b2981fd7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:52.392162 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df37c5e8-7afb-47a7-aa12-a993b2981fd7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:52.433129 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0d536b98-18f5-4ee9-9c22-6341f8f3c312 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:52.443017 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0d536b98-18f5-4ee9-9c22-6341f8f3c312 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:52.445132 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0d536b98-18f5-4ee9-9c22-6341f8f3c312 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:52.446559 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0d536b98-18f5-4ee9-9c22-6341f8f3c312 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1807 microversion: 2.20 time: 0.221230 Apr 06 16:41:52.457964 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 245/475] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:52 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1807 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:52.622542 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-df37c5e8-7afb-47a7-aa12-a993b2981fd7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:52.638740 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-df37c5e8-7afb-47a7-aa12-a993b2981fd7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1511 microversion: 2.1 time: 0.278572 Apr 06 16:41:52.639451 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 231/476] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:52 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1511 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:52.732928 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-84dccdd4-b412-4950-acf6-de2e394af875 req-9ad32f63-c8c1-48a6-b43c-ad2a4ff6f5ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330d17b1-0d7d-4519-8dc3-3210eb25aa3c", "name": "network-vif-plugged", "status": "completed", "tag": "e267cfb2-7045-4a09-851f-05d45654d0a1"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:41:52.747991 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-84dccdd4-b412-4950-acf6-de2e394af875 req-9ad32f63-c8c1-48a6-b43c-ad2a4ff6f5ed service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:52.749509 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-84dccdd4-b412-4950-acf6-de2e394af875 req-9ad32f63-c8c1-48a6-b43c-ad2a4ff6f5ed service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:52.772435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-84dccdd4-b412-4950-acf6-de2e394af875 req-9ad32f63-c8c1-48a6-b43c-ad2a4ff6f5ed service nova] Creating event network-vif-plugged:e267cfb2-7045-4a09-851f-05d45654d0a1 for instance 330d17b1-0d7d-4519-8dc3-3210eb25aa3c on hv-cinder-83684 Apr 06 16:41:52.781189 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-84dccdd4-b412-4950-acf6-de2e394af875 req-9ad32f63-c8c1-48a6-b43c-ad2a4ff6f5ed service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052250 Apr 06 16:41:52.782884 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 246/477] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:41:53.081076 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3cb0d36e-0732-47fd-b48c-e0b831829960 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:53.081687 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3cb0d36e-0732-47fd-b48c-e0b831829960 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:53.097758 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cb0d36e-0732-47fd-b48c-e0b831829960 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:53.098214 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cb0d36e-0732-47fd-b48c-e0b831829960 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:53.101468 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cb0d36e-0732-47fd-b48c-e0b831829960 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:53.101912 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cb0d36e-0732-47fd-b48c-e0b831829960 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:53.265275 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3cb0d36e-0732-47fd-b48c-e0b831829960 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:53.273845 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3cb0d36e-0732-47fd-b48c-e0b831829960 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1318 microversion: 2.1 time: 0.198055 Apr 06 16:41:53.274655 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 232/478] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:53 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:53.466757 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0b5cfb95-5cd5-4c6a-9ce5-ca97cc0497bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:53.469526 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0b5cfb95-5cd5-4c6a-9ce5-ca97cc0497bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:53.482919 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b5cfb95-5cd5-4c6a-9ce5-ca97cc0497bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:53.483679 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b5cfb95-5cd5-4c6a-9ce5-ca97cc0497bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:53.488034 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b5cfb95-5cd5-4c6a-9ce5-ca97cc0497bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:53.489009 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b5cfb95-5cd5-4c6a-9ce5-ca97cc0497bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:53.658222 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b2c1d231-a5e6-492b-bb83-0c8782c09ae4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:53.659125 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b2c1d231-a5e6-492b-bb83-0c8782c09ae4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:53.666413 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2c1d231-a5e6-492b-bb83-0c8782c09ae4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:53.667159 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2c1d231-a5e6-492b-bb83-0c8782c09ae4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:53.668539 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2c1d231-a5e6-492b-bb83-0c8782c09ae4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:53.669243 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2c1d231-a5e6-492b-bb83-0c8782c09ae4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:53.726540 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0b5cfb95-5cd5-4c6a-9ce5-ca97cc0497bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:53.735845 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0b5cfb95-5cd5-4c6a-9ce5-ca97cc0497bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:53.737648 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0b5cfb95-5cd5-4c6a-9ce5-ca97cc0497bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:53.739053 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0b5cfb95-5cd5-4c6a-9ce5-ca97cc0497bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1807 microversion: 2.20 time: 0.277499 Apr 06 16:41:53.740120 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 247/479] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:53 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1807 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:53.746064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f47c3c2a-6aaf-4c7d-a7ef-17d9cb16fdaa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:53.746818 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f47c3c2a-6aaf-4c7d-a7ef-17d9cb16fdaa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:53.753825 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f47c3c2a-6aaf-4c7d-a7ef-17d9cb16fdaa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:53.754562 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f47c3c2a-6aaf-4c7d-a7ef-17d9cb16fdaa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:53.755613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f47c3c2a-6aaf-4c7d-a7ef-17d9cb16fdaa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:53.756201 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f47c3c2a-6aaf-4c7d-a7ef-17d9cb16fdaa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:53.784646 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f47c3c2a-6aaf-4c7d-a7ef-17d9cb16fdaa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af/ips" status: 200 len: 150 microversion: 2.1 time: 0.043191 Apr 06 16:41:53.785825 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 248/480] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Apr 6 16:41:53 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:41:53.795913 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3de42c5b-d4b7-484e-b2e6-50c2898ed60b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca2405d2-66cf-4677-a783-e9aee0215127"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:41:53.797299 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3de42c5b-d4b7-484e-b2e6-50c2898ed60b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:53.803983 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3de42c5b-d4b7-484e-b2e6-50c2898ed60b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:53.804433 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3de42c5b-d4b7-484e-b2e6-50c2898ed60b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:53.805246 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3de42c5b-d4b7-484e-b2e6-50c2898ed60b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:53.805863 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3de42c5b-d4b7-484e-b2e6-50c2898ed60b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:53.856743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b2c1d231-a5e6-492b-bb83-0c8782c09ae4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:53.866105 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b2c1d231-a5e6-492b-bb83-0c8782c09ae4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1517 microversion: 2.1 time: 0.213940 Apr 06 16:41:53.878770 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 233/481] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:53 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1517 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:53.953719 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-3de42c5b-d4b7-484e-b2e6-50c2898ed60b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] HTTP exception thrown: Invalid volume: volume ca2405d2-66cf-4677-a783-e9aee0215127 is already attached to instances: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c Apr 06 16:41:53.954550 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3de42c5b-d4b7-484e-b2e6-50c2898ed60b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Returning 400 to user: Invalid volume: volume ca2405d2-66cf-4677-a783-e9aee0215127 is already attached to instances: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 16:41:53.955397 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3de42c5b-d4b7-484e-b2e6-50c2898ed60b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "POST /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.163581 Apr 06 16:41:53.959761 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 249/482] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Apr 6 16:41:53 2022] POST /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af/os-volume_attachments => generated 174 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 06 16:41:53.971579 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6dd33af9-7773-4d15-8fa9-200e1a85bdac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:53.972644 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6dd33af9-7773-4d15-8fa9-200e1a85bdac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:53.985652 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dd33af9-7773-4d15-8fa9-200e1a85bdac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:53.986275 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dd33af9-7773-4d15-8fa9-200e1a85bdac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:53.987074 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dd33af9-7773-4d15-8fa9-200e1a85bdac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:53.988304 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dd33af9-7773-4d15-8fa9-200e1a85bdac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:54.029839 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6dd33af9-7773-4d15-8fa9-200e1a85bdac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 06 16:41:54.167006 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6dd33af9-7773-4d15-8fa9-200e1a85bdac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 204 len: 0 microversion: 2.1 time: 0.204223 Apr 06 16:41:54.169094 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 234/483] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 16:41:53 2022] DELETE /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 06 16:41:54.179229 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d5f666e5-364f-4c92-86d0-03aa4d1b3a72 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:54.179612 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d5f666e5-364f-4c92-86d0-03aa4d1b3a72 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:54.186651 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5f666e5-364f-4c92-86d0-03aa4d1b3a72 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:54.187379 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5f666e5-364f-4c92-86d0-03aa4d1b3a72 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:54.188625 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5f666e5-364f-4c92-86d0-03aa4d1b3a72 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:54.188983 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5f666e5-364f-4c92-86d0-03aa4d1b3a72 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:54.291588 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5be8597c-f40f-4b35-a973-2af9b488c7fb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:54.292376 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5be8597c-f40f-4b35-a973-2af9b488c7fb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:54.307323 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be8597c-f40f-4b35-a973-2af9b488c7fb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:54.307893 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be8597c-f40f-4b35-a973-2af9b488c7fb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:54.311668 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be8597c-f40f-4b35-a973-2af9b488c7fb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:54.312290 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be8597c-f40f-4b35-a973-2af9b488c7fb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:54.392098 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d5f666e5-364f-4c92-86d0-03aa4d1b3a72 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:54.401395 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d5f666e5-364f-4c92-86d0-03aa4d1b3a72 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 200 len: 1681 microversion: 2.1 time: 0.227407 Apr 06 16:41:54.416027 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 250/484] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:54 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 1681 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:54.504470 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5be8597c-f40f-4b35-a973-2af9b488c7fb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:54.512265 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5be8597c-f40f-4b35-a973-2af9b488c7fb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1318 microversion: 2.1 time: 0.225576 Apr 06 16:41:54.513215 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 235/485] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:54 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:54.760935 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7a4f62bb-ea45-4032-b2c4-e0aff5687ce8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:54.761558 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7a4f62bb-ea45-4032-b2c4-e0aff5687ce8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:54.769913 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a4f62bb-ea45-4032-b2c4-e0aff5687ce8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:54.770787 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a4f62bb-ea45-4032-b2c4-e0aff5687ce8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:54.771792 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a4f62bb-ea45-4032-b2c4-e0aff5687ce8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:54.772221 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a4f62bb-ea45-4032-b2c4-e0aff5687ce8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:54.833734 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-70aed929-a593-4365-accc-fed009069173 req-b147d4b1-2d76-45fa-b66a-175f5f5fa6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce", "name": "network-vif-plugged", "status": "completed", "tag": "e5eff3a1-0302-4963-a5c6-4309ac8d884f"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:41:54.847655 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-70aed929-a593-4365-accc-fed009069173 req-b147d4b1-2d76-45fa-b66a-175f5f5fa6d4 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:54.848232 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-70aed929-a593-4365-accc-fed009069173 req-b147d4b1-2d76-45fa-b66a-175f5f5fa6d4 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:54.870954 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-70aed929-a593-4365-accc-fed009069173 req-b147d4b1-2d76-45fa-b66a-175f5f5fa6d4 service nova] Creating event network-vif-plugged:e5eff3a1-0302-4963-a5c6-4309ac8d884f for instance c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce on hv-cinder-83684 Apr 06 16:41:54.879893 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-70aed929-a593-4365-accc-fed009069173 req-b147d4b1-2d76-45fa-b66a-175f5f5fa6d4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050248 Apr 06 16:41:54.880517 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 236/486] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:41:54.964480 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7a4f62bb-ea45-4032-b2c4-e0aff5687ce8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:54.976362 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7a4f62bb-ea45-4032-b2c4-e0aff5687ce8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:54.978176 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7a4f62bb-ea45-4032-b2c4-e0aff5687ce8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:54.979349 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7a4f62bb-ea45-4032-b2c4-e0aff5687ce8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1807 microversion: 2.20 time: 0.222383 Apr 06 16:41:54.985212 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 251/487] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:54 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:55.424745 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6fb12ec8-4b73-4982-b647-546cf86eb5fe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:55.427252 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6fb12ec8-4b73-4982-b647-546cf86eb5fe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:55.437127 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bd9cca30-6008-401f-a4f7-94f2135db34d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Action: 'create', calling method: .version_select at 0x7fa9ca309820>, body: {"keypair": {"name": "tempest-keypair-1137461320"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:41:55.446469 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fb12ec8-4b73-4982-b647-546cf86eb5fe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:55.446919 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fb12ec8-4b73-4982-b647-546cf86eb5fe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:55.447727 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fb12ec8-4b73-4982-b647-546cf86eb5fe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:55.448169 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fb12ec8-4b73-4982-b647-546cf86eb5fe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:55.485203 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-bd9cca30-6008-401f-a4f7-94f2135db34d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Getting quotas for project 98c4762a201e43a1b7a5f755b26e5cf4. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 16:41:55.502483 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-bd9cca30-6008-401f-a4f7-94f2135db34d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Getting quotas for user 2c31bf4706fc42d992d98d9c0da54f3b and project 98c4762a201e43a1b7a5f755b26e5cf4. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 16:41:55.527401 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bd9cca30-6008-401f-a4f7-94f2135db34d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [4acf6183-9936-4fbf-8bc7-28fe24a6e66d] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 06 16:41:55.657778 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6fb12ec8-4b73-4982-b647-546cf86eb5fe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:55.671715 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6fb12ec8-4b73-4982-b647-546cf86eb5fe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 200 len: 1681 microversion: 2.1 time: 0.251682 Apr 06 16:41:55.673067 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 237/488] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:55 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 1681 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:55.680098 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6a9bb8f3-e9d2-43b0-ac5d-95a50f004206 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:55.680996 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6a9bb8f3-e9d2-43b0-ac5d-95a50f004206 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:55.706468 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a9bb8f3-e9d2-43b0-ac5d-95a50f004206 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:55.707212 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a9bb8f3-e9d2-43b0-ac5d-95a50f004206 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:55.708248 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a9bb8f3-e9d2-43b0-ac5d-95a50f004206 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:55.708708 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a9bb8f3-e9d2-43b0-ac5d-95a50f004206 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:55.886980 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6a9bb8f3-e9d2-43b0-ac5d-95a50f004206 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:55.895563 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6a9bb8f3-e9d2-43b0-ac5d-95a50f004206 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1318 microversion: 2.1 time: 0.219117 Apr 06 16:41:55.896762 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 238/489] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:55 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:55.998816 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-835be045-8f4c-4446-90aa-8829f584a0a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:55.999787 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-835be045-8f4c-4446-90aa-8829f584a0a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:56.009930 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-835be045-8f4c-4446-90aa-8829f584a0a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:56.010874 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-835be045-8f4c-4446-90aa-8829f584a0a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:56.011894 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-835be045-8f4c-4446-90aa-8829f584a0a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:56.012334 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-835be045-8f4c-4446-90aa-8829f584a0a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:56.171674 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-835be045-8f4c-4446-90aa-8829f584a0a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:56.181265 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-835be045-8f4c-4446-90aa-8829f584a0a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:56.182792 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-835be045-8f4c-4446-90aa-8829f584a0a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:56.184020 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-835be045-8f4c-4446-90aa-8829f584a0a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1807 microversion: 2.20 time: 0.189226 Apr 06 16:41:56.184448 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 239/490] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:55 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:56.243540 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8da8462b-8da5-44e3-9a68-6dcab5a5c53a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Action: 'create', calling method: .version_select at 0x7fa9ca18bb80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1725512260"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:41:56.257840 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-8da8462b-8da5-44e3-9a68-6dcab5a5c53a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Getting quotas for project 80e12968decb4d9794bb483bf8fdeb84. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 16:41:56.261540 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-8da8462b-8da5-44e3-9a68-6dcab5a5c53a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Getting quotas for user 59a97efc44004b35a934adac1dded824 and project 80e12968decb4d9794bb483bf8fdeb84. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 16:41:56.396252 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-8da8462b-8da5-44e3-9a68-6dcab5a5c53a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Getting quotas for project 80e12968decb4d9794bb483bf8fdeb84. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 16:41:56.400051 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-8da8462b-8da5-44e3-9a68-6dcab5a5c53a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Getting quotas for user 59a97efc44004b35a934adac1dded824 and project 80e12968decb4d9794bb483bf8fdeb84. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 16:41:56.413418 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8da8462b-8da5-44e3-9a68-6dcab5a5c53a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.174214 Apr 06 16:41:56.416610 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 240/491] 10.222.0.64 () {60 vars in 1157 bytes} [Wed Apr 6 16:41:56 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:41:56.523994 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8e7b3302-7676-4ed3-8900-f68fa60674fa tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1001657965", "imageRef": "8909d788-8952-4a13-9397-e14be03df478", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1725512260", "networks": [{"uuid": "b584b7b1-8e27-407d-b617-42bb17633643"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:41:56.535299 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [None req-bd9cca30-6008-401f-a4f7-94f2135db34d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [4acf6183-9936-4fbf-8bc7-28fe24a6e66d] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 55928. Apr 06 16:41:56.577266 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-8e7b3302-7676-4ed3-8900-f68fa60674fa tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] validate_networks() for [('b584b7b1-8e27-407d-b617-42bb17633643', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 06 16:41:56.682900 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-bd9cca30-6008-401f-a4f7-94f2135db34d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Getting quotas for project 98c4762a201e43a1b7a5f755b26e5cf4. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 16:41:56.687541 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-bd9cca30-6008-401f-a4f7-94f2135db34d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Getting quotas for user 2c31bf4706fc42d992d98d9c0da54f3b and project 98c4762a201e43a1b7a5f755b26e5cf4. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 16:41:56.703013 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bd9cca30-6008-401f-a4f7-94f2135db34d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.270074 Apr 06 16:41:56.704041 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 252/492] 10.222.0.64 () {60 vars in 1157 bytes} [Wed Apr 6 16:41:55 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:56.708502 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8ed0b16c-a07c-44a7-ae8e-065ea9f20b16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:56.709131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8ed0b16c-a07c-44a7-ae8e-065ea9f20b16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:56.716638 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ed0b16c-a07c-44a7-ae8e-065ea9f20b16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:56.717376 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ed0b16c-a07c-44a7-ae8e-065ea9f20b16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:56.718421 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ed0b16c-a07c-44a7-ae8e-065ea9f20b16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:56.719251 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ed0b16c-a07c-44a7-ae8e-065ea9f20b16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:56.920671 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8ed0b16c-a07c-44a7-ae8e-065ea9f20b16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:56.929505 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8ed0b16c-a07c-44a7-ae8e-065ea9f20b16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 200 len: 1681 microversion: 2.1 time: 0.224532 Apr 06 16:41:56.937904 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 253/493] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:56 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 1681 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:56.937904 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5ac5caa6-453a-40da-8875-5cf2af178402 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:56.937904 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5ac5caa6-453a-40da-8875-5cf2af178402 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:56.944645 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ac5caa6-453a-40da-8875-5cf2af178402 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:56.945199 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ac5caa6-453a-40da-8875-5cf2af178402 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:56.946040 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ac5caa6-453a-40da-8875-5cf2af178402 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:56.946403 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ac5caa6-453a-40da-8875-5cf2af178402 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:57.144511 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5ac5caa6-453a-40da-8875-5cf2af178402 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:57.155052 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5ac5caa6-453a-40da-8875-5cf2af178402 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1318 microversion: 2.1 time: 0.222965 Apr 06 16:41:57.164514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 254/494] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:56 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:57.209454 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cd89ff67-0b06-49b3-8605-f2c1becbecd0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:57.211939 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cd89ff67-0b06-49b3-8605-f2c1becbecd0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:57.221480 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd89ff67-0b06-49b3-8605-f2c1becbecd0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:57.222516 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd89ff67-0b06-49b3-8605-f2c1becbecd0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:57.223597 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd89ff67-0b06-49b3-8605-f2c1becbecd0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:57.224302 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd89ff67-0b06-49b3-8605-f2c1becbecd0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:57.384761 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-8e7b3302-7676-4ed3-8900-f68fa60674fa tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 06 16:41:57.385414 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-8e7b3302-7676-4ed3-8900-f68fa60674fa tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 06 16:41:57.386151 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-8e7b3302-7676-4ed3-8900-f68fa60674fa tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 06 16:41:57.387074 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-8e7b3302-7676-4ed3-8900-f68fa60674fa tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 06 16:41:57.387820 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-8e7b3302-7676-4ed3-8900-f68fa60674fa tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 06 16:41:57.397889 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e7b3302-7676-4ed3-8900-f68fa60674fa tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:57.398580 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e7b3302-7676-4ed3-8900-f68fa60674fa tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:57.399478 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e7b3302-7676-4ed3-8900-f68fa60674fa tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:57.400221 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e7b3302-7676-4ed3-8900-f68fa60674fa tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:57.426409 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-8e7b3302-7676-4ed3-8900-f68fa60674fa tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Getting quotas for project 80e12968decb4d9794bb483bf8fdeb84. Resources: {'instances', 'cores', 'ram'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 16:41:57.431610 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-8e7b3302-7676-4ed3-8900-f68fa60674fa tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Getting quotas for user 59a97efc44004b35a934adac1dded824 and project 80e12968decb4d9794bb483bf8fdeb84. Resources: {'instances', 'cores', 'ram'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 16:41:57.439344 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-cd89ff67-0b06-49b3-8605-f2c1becbecd0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:57.448138 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-cd89ff67-0b06-49b3-8605-f2c1becbecd0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:57.449673 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-cd89ff67-0b06-49b3-8605-f2c1becbecd0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:57.449944 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8e7b3302-7676-4ed3-8900-f68fa60674fa tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 06 16:41:57.450939 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cd89ff67-0b06-49b3-8605-f2c1becbecd0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1807 microversion: 2.20 time: 0.252411 Apr 06 16:41:57.453302 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8e7b3302-7676-4ed3-8900-f68fa60674fa tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8909d788-8952-4a13-9397-e14be03df478',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 06 16:41:57.464397 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 255/495] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:57 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1807 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:41:57.517569 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8e7b3302-7676-4ed3-8900-f68fa60674fa tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.997555 Apr 06 16:41:57.518995 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 241/496] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Apr 6 16:41:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 06 16:41:57.532819 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fd3afdeb-5d3f-460d-b1ca-fd4cc8984bd1 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:57.544544 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fd3afdeb-5d3f-460d-b1ca-fd4cc8984bd1 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:57.616610 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fd3afdeb-5d3f-460d-b1ca-fd4cc8984bd1 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:57.627255 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fd3afdeb-5d3f-460d-b1ca-fd4cc8984bd1 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1259 microversion: 2.1 time: 0.099126 Apr 06 16:41:57.627846 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 256/497] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:57 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1259 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:41:57.951512 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e409f1dc-cff7-4a58-83b8-43c3751902d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:57.953003 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e409f1dc-cff7-4a58-83b8-43c3751902d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:57.964028 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e409f1dc-cff7-4a58-83b8-43c3751902d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:57.964866 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e409f1dc-cff7-4a58-83b8-43c3751902d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:57.965796 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e409f1dc-cff7-4a58-83b8-43c3751902d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:57.966679 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e409f1dc-cff7-4a58-83b8-43c3751902d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:58.171561 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-15c2d24c-fc37-4455-ab91-be4dc5c4d292 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:58.172391 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-15c2d24c-fc37-4455-ab91-be4dc5c4d292 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:58.181772 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15c2d24c-fc37-4455-ab91-be4dc5c4d292 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:58.182546 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15c2d24c-fc37-4455-ab91-be4dc5c4d292 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:58.183913 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15c2d24c-fc37-4455-ab91-be4dc5c4d292 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:58.184654 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15c2d24c-fc37-4455-ab91-be4dc5c4d292 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:58.330755 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-15c2d24c-fc37-4455-ab91-be4dc5c4d292 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:58.339290 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-15c2d24c-fc37-4455-ab91-be4dc5c4d292 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1318 microversion: 2.1 time: 0.171682 Apr 06 16:41:58.339954 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 257/498] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:58 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:58.366911 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e409f1dc-cff7-4a58-83b8-43c3751902d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:58.375520 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e409f1dc-cff7-4a58-83b8-43c3751902d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 200 len: 1681 microversion: 2.1 time: 0.428912 Apr 06 16:41:58.376374 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 242/499] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:57 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 1681 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:58.476767 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-841e8bff-cfd5-4d25-ac0c-033e010b7998 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:58.477438 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-841e8bff-cfd5-4d25-ac0c-033e010b7998 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:58.486095 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-841e8bff-cfd5-4d25-ac0c-033e010b7998 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:58.486538 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-841e8bff-cfd5-4d25-ac0c-033e010b7998 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:58.487390 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-841e8bff-cfd5-4d25-ac0c-033e010b7998 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:58.488168 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-841e8bff-cfd5-4d25-ac0c-033e010b7998 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:58.646579 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bd6932fa-d8b5-4cab-bb85-c09b66eb6e0a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:58.647558 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bd6932fa-d8b5-4cab-bb85-c09b66eb6e0a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:58.654568 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd6932fa-d8b5-4cab-bb85-c09b66eb6e0a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:58.655690 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd6932fa-d8b5-4cab-bb85-c09b66eb6e0a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:58.657137 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd6932fa-d8b5-4cab-bb85-c09b66eb6e0a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:58.657931 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd6932fa-d8b5-4cab-bb85-c09b66eb6e0a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:58.679552 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-841e8bff-cfd5-4d25-ac0c-033e010b7998 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:58.691183 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-841e8bff-cfd5-4d25-ac0c-033e010b7998 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:58.692721 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-841e8bff-cfd5-4d25-ac0c-033e010b7998 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:58.693926 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-841e8bff-cfd5-4d25-ac0c-033e010b7998 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1794 microversion: 2.20 time: 0.228082 Apr 06 16:41:58.694491 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 258/500] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:41:58 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1794 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:41:58.743077 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-bd6932fa-d8b5-4cab-bb85-c09b66eb6e0a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:58.753692 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bd6932fa-d8b5-4cab-bb85-c09b66eb6e0a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1255 microversion: 2.1 time: 0.111447 Apr 06 16:41:58.756648 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 243/501] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:58 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1255 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:41:59.057471 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-03db6d43-1ce1-48f7-a5dd-09457c562ee7 req-a80c0984-6195-4897-b34d-a096097fd636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fd9a412-d36a-4da6-80ce-a49cb771a0af", "name": "network-vif-deleted", "tag": "d00644e8-aa5d-4c9b-babb-b316869af868"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:41:59.069156 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-03db6d43-1ce1-48f7-a5dd-09457c562ee7 req-a80c0984-6195-4897-b34d-a096097fd636 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:59.069156 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-03db6d43-1ce1-48f7-a5dd-09457c562ee7 req-a80c0984-6195-4897-b34d-a096097fd636 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:59.082706 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-03db6d43-1ce1-48f7-a5dd-09457c562ee7 req-a80c0984-6195-4897-b34d-a096097fd636 service nova] Creating event network-vif-deleted:d00644e8-aa5d-4c9b-babb-b316869af868 for instance 1fd9a412-d36a-4da6-80ce-a49cb771a0af on hv-cinder-83684 Apr 06 16:41:59.088506 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-03db6d43-1ce1-48f7-a5dd-09457c562ee7 req-a80c0984-6195-4897-b34d-a096097fd636 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036580 Apr 06 16:41:59.089477 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 259/502] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:41:59.364519 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ff9babd7-9680-4b88-85a1-3fe4e21f9c35 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:59.365842 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ff9babd7-9680-4b88-85a1-3fe4e21f9c35 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:59.369637 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-68fbfec2-f2cf-4f72-9068-53a71a1ae8c2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-164", "imageRef": "c217dd2b-7679-4860-b2e6-01a967f654df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ee1ec51f-03d0-45fe-9943-d45124fcd980"}], "security_groups": [{"name": "tempest-securitygroup--1690163645"}], "key_name": "tempest-keypair-1137461320", "user_data": "}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:41:59.372920 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff9babd7-9680-4b88-85a1-3fe4e21f9c35 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:59.373792 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff9babd7-9680-4b88-85a1-3fe4e21f9c35 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:59.374773 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff9babd7-9680-4b88-85a1-3fe4e21f9c35 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:59.388639 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff9babd7-9680-4b88-85a1-3fe4e21f9c35 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:59.520491 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-68fbfec2-f2cf-4f72-9068-53a71a1ae8c2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] validate_networks() for [('ee1ec51f-03d0-45fe-9943-d45124fcd980', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 06 16:41:59.574306 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ff9babd7-9680-4b88-85a1-3fe4e21f9c35 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:59.582630 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ff9babd7-9680-4b88-85a1-3fe4e21f9c35 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1508 microversion: 2.1 time: 0.230955 Apr 06 16:41:59.583227 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 244/503] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:59 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1508 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:59.588713 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f412ca8a-d566-4293-bb40-cf9b1877db38 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:41:59.589325 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f412ca8a-d566-4293-bb40-cf9b1877db38 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:59.596608 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f412ca8a-d566-4293-bb40-cf9b1877db38 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:59.597082 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f412ca8a-d566-4293-bb40-cf9b1877db38 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:59.598086 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f412ca8a-d566-4293-bb40-cf9b1877db38 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:59.598665 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f412ca8a-d566-4293-bb40-cf9b1877db38 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:59.632627 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f412ca8a-d566-4293-bb40-cf9b1877db38 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:59.633389 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f412ca8a-d566-4293-bb40-cf9b1877db38 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:59.634222 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-f412ca8a-d566-4293-bb40-cf9b1877db38 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lazy-loading 'fault' on Instance uuid 1fd9a412-d36a-4da6-80ce-a49cb771a0af {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 06 16:41:59.678774 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f412ca8a-d566-4293-bb40-cf9b1877db38 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:41:59.686418 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f412ca8a-d566-4293-bb40-cf9b1877db38 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 200 len: 1330 microversion: 2.1 time: 0.102132 Apr 06 16:41:59.687006 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 245/504] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:41:59 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 1330 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:41:59.700793 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3e6d1c0c-3c8b-4b3d-85f1-e478c7b5e9da tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42f3998f-930f-4f06-9e3a-0d0607de9bea", "device": "/dev/sdb"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:41:59.702556 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3e6d1c0c-3c8b-4b3d-85f1-e478c7b5e9da tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:41:59.710642 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e6d1c0c-3c8b-4b3d-85f1-e478c7b5e9da tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:59.712483 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e6d1c0c-3c8b-4b3d-85f1-e478c7b5e9da tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:59.717118 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e6d1c0c-3c8b-4b3d-85f1-e478c7b5e9da tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:41:59.717869 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e6d1c0c-3c8b-4b3d-85f1-e478c7b5e9da tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:41:59.986727 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-68fbfec2-f2cf-4f72-9068-53a71a1ae8c2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 06 16:41:59.988192 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-68fbfec2-f2cf-4f72-9068-53a71a1ae8c2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 06 16:41:59.989072 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-68fbfec2-f2cf-4f72-9068-53a71a1ae8c2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 06 16:41:59.989650 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-68fbfec2-f2cf-4f72-9068-53a71a1ae8c2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 06 16:41:59.990212 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-68fbfec2-f2cf-4f72-9068-53a71a1ae8c2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 06 16:42:00.000172 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68fbfec2-f2cf-4f72-9068-53a71a1ae8c2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:00.000628 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68fbfec2-f2cf-4f72-9068-53a71a1ae8c2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:00.001459 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68fbfec2-f2cf-4f72-9068-53a71a1ae8c2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:00.001932 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68fbfec2-f2cf-4f72-9068-53a71a1ae8c2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:00.020212 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-68fbfec2-f2cf-4f72-9068-53a71a1ae8c2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Getting quotas for project 98c4762a201e43a1b7a5f755b26e5cf4. Resources: {'instances', 'cores', 'ram'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 16:42:00.025114 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-68fbfec2-f2cf-4f72-9068-53a71a1ae8c2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Getting quotas for user 2c31bf4706fc42d992d98d9c0da54f3b and project 98c4762a201e43a1b7a5f755b26e5cf4. Resources: {'instances', 'cores', 'ram'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 16:42:00.039252 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-68fbfec2-f2cf-4f72-9068-53a71a1ae8c2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 06 16:42:00.041876 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-68fbfec2-f2cf-4f72-9068-53a71a1ae8c2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c217dd2b-7679-4860-b2e6-01a967f654df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 06 16:42:00.095089 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-68fbfec2-f2cf-4f72-9068-53a71a1ae8c2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.731907 Apr 06 16:42:00.095745 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 260/505] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Apr 6 16:41:59 2022] POST /compute/v2.1/servers => generated 409 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 06 16:42:00.101406 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-97ba18b8-e94d-40f6-af7e-ed39122c314e tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:00.102015 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-97ba18b8-e94d-40f6-af7e-ed39122c314e tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:00.109307 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97ba18b8-e94d-40f6-af7e-ed39122c314e tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:00.110081 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97ba18b8-e94d-40f6-af7e-ed39122c314e tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:00.111170 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97ba18b8-e94d-40f6-af7e-ed39122c314e tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:00.111789 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97ba18b8-e94d-40f6-af7e-ed39122c314e tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:00.186305 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-97ba18b8-e94d-40f6-af7e-ed39122c314e tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:00.197111 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-97ba18b8-e94d-40f6-af7e-ed39122c314e tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1311 microversion: 2.1 time: 0.100037 Apr 06 16:42:00.197716 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 261/506] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:00 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:00.211281 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-34f5812a-bf2f-4fa2-8394-e3993abb1002 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:00.211901 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-34f5812a-bf2f-4fa2-8394-e3993abb1002 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:00.276766 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-34f5812a-bf2f-4fa2-8394-e3993abb1002 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:00.284950 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-34f5812a-bf2f-4fa2-8394-e3993abb1002 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1239 microversion: 2.1 time: 0.086085 Apr 06 16:42:00.286213 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 262/507] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:00 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1239 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:00.608085 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3e6d1c0c-3c8b-4b3d-85f1-e478c7b5e9da tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "POST /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.916734 Apr 06 16:42:00.609632 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 246/508] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Apr 6 16:41:59 2022] POST /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce/os-volume_attachments => generated 194 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:00.703890 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5a7c21dd-d218-480d-9b93-e01442d1459c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:00.704365 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5a7c21dd-d218-480d-9b93-e01442d1459c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:00.718021 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a7c21dd-d218-480d-9b93-e01442d1459c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:00.718585 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a7c21dd-d218-480d-9b93-e01442d1459c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:00.719569 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a7c21dd-d218-480d-9b93-e01442d1459c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:00.720116 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a7c21dd-d218-480d-9b93-e01442d1459c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:00.740766 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-5a7c21dd-d218-480d-9b93-e01442d1459c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] HTTP exception thrown: Instance 1fd9a412-d36a-4da6-80ce-a49cb771a0af could not be found. Apr 06 16:42:00.741327 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5a7c21dd-d218-480d-9b93-e01442d1459c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Returning 404 to user: Instance 1fd9a412-d36a-4da6-80ce-a49cb771a0af could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 16:42:00.742333 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5a7c21dd-d218-480d-9b93-e01442d1459c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 404 len: 111 microversion: 2.1 time: 0.042654 Apr 06 16:42:00.743375 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 263/509] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:00 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 16:42:00.754183 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3219de6e-54b8-4d7a-a86a-3b256e88a7cd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '.version_select at 0x7fa9ca18b310>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:00.790058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3219de6e-54b8-4d7a-a86a-3b256e88a7cd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-266657953" status: 202 len: 0 microversion: 2.1 time: 0.041622 Apr 06 16:42:00.793379 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 247/510] 10.222.0.64 () {58 vars in 1217 bytes} [Wed Apr 6 16:42:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-266657953 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 06 16:42:01.223577 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9b39f601-ccda-44cc-860c-d1791ce254fe tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:01.224197 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9b39f601-ccda-44cc-860c-d1791ce254fe tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:01.239914 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b39f601-ccda-44cc-860c-d1791ce254fe tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:01.241168 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b39f601-ccda-44cc-860c-d1791ce254fe tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:01.245433 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b39f601-ccda-44cc-860c-d1791ce254fe tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:01.246469 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b39f601-ccda-44cc-860c-d1791ce254fe tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:01.303763 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2c0d7a8c-4a11-4a31-9523-e30380ca4505 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:01.309917 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2c0d7a8c-4a11-4a31-9523-e30380ca4505 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:01.319789 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c0d7a8c-4a11-4a31-9523-e30380ca4505 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:01.320523 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c0d7a8c-4a11-4a31-9523-e30380ca4505 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:01.322038 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c0d7a8c-4a11-4a31-9523-e30380ca4505 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:01.322769 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c0d7a8c-4a11-4a31-9523-e30380ca4505 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:01.431511 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9b39f601-ccda-44cc-860c-d1791ce254fe tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:01.442958 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9b39f601-ccda-44cc-860c-d1791ce254fe tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1317 microversion: 2.1 time: 0.231380 Apr 06 16:42:01.445383 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 264/511] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:01 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:01.456136 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-03acd7bd-87a5-40f9-b5ce-52d91ac96b8b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:01.458541 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-03acd7bd-87a5-40f9-b5ce-52d91ac96b8b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:01.478173 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03acd7bd-87a5-40f9-b5ce-52d91ac96b8b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:01.478913 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03acd7bd-87a5-40f9-b5ce-52d91ac96b8b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:01.480380 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03acd7bd-87a5-40f9-b5ce-52d91ac96b8b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:01.481008 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03acd7bd-87a5-40f9-b5ce-52d91ac96b8b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:01.518328 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2c0d7a8c-4a11-4a31-9523-e30380ca4505 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:01.532282 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2c0d7a8c-4a11-4a31-9523-e30380ca4505 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1291 microversion: 2.1 time: 0.232672 Apr 06 16:42:01.535836 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 248/512] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:01 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1291 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:42:01.688544 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-03acd7bd-87a5-40f9-b5ce-52d91ac96b8b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lazy-loading 'services' on Instance uuid bab853ba-a3d5-4828-baf6-1088f936bc96 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 06 16:42:01.826695 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-03acd7bd-87a5-40f9-b5ce-52d91ac96b8b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "DELETE /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments/4a3fb170-2d65-4fae-b533-0a5d5815f26a" status: 202 len: 0 microversion: 2.1 time: 0.379528 Apr 06 16:42:01.827213 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 265/513] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Apr 6 16:42:01 2022] DELETE /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments/4a3fb170-2d65-4fae-b533-0a5d5815f26a => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 06 16:42:02.395612 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7cc536c3-b224-40f0-ba55-5f95bf347e8e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:02.397222 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7cc536c3-b224-40f0-ba55-5f95bf347e8e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:02.409703 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cc536c3-b224-40f0-ba55-5f95bf347e8e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:02.410155 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cc536c3-b224-40f0-ba55-5f95bf347e8e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:02.411066 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cc536c3-b224-40f0-ba55-5f95bf347e8e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:02.411652 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cc536c3-b224-40f0-ba55-5f95bf347e8e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:02.464765 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-59ecbca4-d076-4286-9e3c-aa7376fd63b6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:02.466362 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-59ecbca4-d076-4286-9e3c-aa7376fd63b6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:02.478797 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59ecbca4-d076-4286-9e3c-aa7376fd63b6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:02.479606 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59ecbca4-d076-4286-9e3c-aa7376fd63b6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:02.480724 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59ecbca4-d076-4286-9e3c-aa7376fd63b6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:02.481313 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59ecbca4-d076-4286-9e3c-aa7376fd63b6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:02.587058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-7cc536c3-b224-40f0-ba55-5f95bf347e8e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lazy-loading 'services' on Instance uuid 6b9f9e64-72fd-4e62-bde6-4e44f737c02c {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 06 16:42:02.728421 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-59ecbca4-d076-4286-9e3c-aa7376fd63b6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:02.740625 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-59ecbca4-d076-4286-9e3c-aa7376fd63b6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.280647 Apr 06 16:42:02.741612 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 266/514] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:02 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:42:02.747435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-68bd1850-7626-465a-a8f9-ad0c009abf3b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:02.748356 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-68bd1850-7626-465a-a8f9-ad0c009abf3b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:02.758904 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7cc536c3-b224-40f0-ba55-5f95bf347e8e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments/ca2405d2-66cf-4677-a783-e9aee0215127" status: 202 len: 0 microversion: 2.1 time: 0.367632 Apr 06 16:42:02.761275 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 249/515] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Apr 6 16:42:02 2022] DELETE /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments/ca2405d2-66cf-4677-a783-e9aee0215127 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 06 16:42:02.776854 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d6989e26-8374-49b4-9040-bb4d3a028217 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:02.779201 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68bd1850-7626-465a-a8f9-ad0c009abf3b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:02.780194 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68bd1850-7626-465a-a8f9-ad0c009abf3b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:02.781291 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68bd1850-7626-465a-a8f9-ad0c009abf3b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:02.781941 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68bd1850-7626-465a-a8f9-ad0c009abf3b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:02.782073 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d6989e26-8374-49b4-9040-bb4d3a028217 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:02.797836 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6989e26-8374-49b4-9040-bb4d3a028217 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:02.800245 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6989e26-8374-49b4-9040-bb4d3a028217 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:02.801236 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6989e26-8374-49b4-9040-bb4d3a028217 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:02.809067 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6989e26-8374-49b4-9040-bb4d3a028217 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:02.858402 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d6989e26-8374-49b4-9040-bb4d3a028217 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092128 Apr 06 16:42:02.863188 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 250/516] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:02 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:42:02.893505 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-68bd1850-7626-465a-a8f9-ad0c009abf3b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:02.915540 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-68bd1850-7626-465a-a8f9-ad0c009abf3b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1291 microversion: 2.1 time: 0.172646 Apr 06 16:42:02.917074 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 267/517] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:02 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1291 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:03.762544 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-82a876b6-79c2-43f3-a3d6-10b29d80a2e7 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:03.763937 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-82a876b6-79c2-43f3-a3d6-10b29d80a2e7 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:03.771448 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82a876b6-79c2-43f3-a3d6-10b29d80a2e7 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:03.771994 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82a876b6-79c2-43f3-a3d6-10b29d80a2e7 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:03.772905 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82a876b6-79c2-43f3-a3d6-10b29d80a2e7 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:03.773405 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82a876b6-79c2-43f3-a3d6-10b29d80a2e7 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:03.876547 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7dfb5af7-2974-4ff7-b2a2-9d1e77c008f2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:03.878436 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7dfb5af7-2974-4ff7-b2a2-9d1e77c008f2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:03.887638 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dfb5af7-2974-4ff7-b2a2-9d1e77c008f2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:03.888124 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dfb5af7-2974-4ff7-b2a2-9d1e77c008f2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:03.888933 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dfb5af7-2974-4ff7-b2a2-9d1e77c008f2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:03.889554 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dfb5af7-2974-4ff7-b2a2-9d1e77c008f2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:03.926949 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7dfb5af7-2974-4ff7-b2a2-9d1e77c008f2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059310 Apr 06 16:42:03.931064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 268/518] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:03 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:03.936172 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ee4bbd26-9c89-4668-860f-ba879d8256c1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:03.936811 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ee4bbd26-9c89-4668-860f-ba879d8256c1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:03.946859 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee4bbd26-9c89-4668-860f-ba879d8256c1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:03.947557 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee4bbd26-9c89-4668-860f-ba879d8256c1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:03.948508 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee4bbd26-9c89-4668-860f-ba879d8256c1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:03.949131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee4bbd26-9c89-4668-860f-ba879d8256c1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:03.966319 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-82a876b6-79c2-43f3-a3d6-10b29d80a2e7 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:03.974865 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-82a876b6-79c2-43f3-a3d6-10b29d80a2e7 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.216564 Apr 06 16:42:03.975466 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 251/519] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:03 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:04.047536 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ee4bbd26-9c89-4668-860f-ba879d8256c1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:04.057257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ee4bbd26-9c89-4668-860f-ba879d8256c1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1291 microversion: 2.1 time: 0.124795 Apr 06 16:42:04.059393 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 269/520] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:03 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1291 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:04.939500 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-750fe2d7-d25c-440e-873c-c438747a0369 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:04.940625 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-750fe2d7-d25c-440e-873c-c438747a0369 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:04.948094 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-750fe2d7-d25c-440e-873c-c438747a0369 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:04.948702 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-750fe2d7-d25c-440e-873c-c438747a0369 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:04.949594 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-750fe2d7-d25c-440e-873c-c438747a0369 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:04.950155 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-750fe2d7-d25c-440e-873c-c438747a0369 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:04.984782 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-750fe2d7-d25c-440e-873c-c438747a0369 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049946 Apr 06 16:42:04.985414 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 252/521] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:04 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:04.996860 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2ce764e9-6690-45e3-9a62-57b1b9b8ce49 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:04.997508 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2ce764e9-6690-45e3-9a62-57b1b9b8ce49 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:05.005616 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ce764e9-6690-45e3-9a62-57b1b9b8ce49 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:05.007138 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ce764e9-6690-45e3-9a62-57b1b9b8ce49 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:05.008130 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ce764e9-6690-45e3-9a62-57b1b9b8ce49 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:05.008805 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ce764e9-6690-45e3-9a62-57b1b9b8ce49 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:05.076376 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6236aadd-221d-4e5c-8dd4-b185fd3586c9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:05.077180 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6236aadd-221d-4e5c-8dd4-b185fd3586c9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:05.090896 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6236aadd-221d-4e5c-8dd4-b185fd3586c9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:05.090896 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6236aadd-221d-4e5c-8dd4-b185fd3586c9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:05.091205 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6236aadd-221d-4e5c-8dd4-b185fd3586c9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:05.093726 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6236aadd-221d-4e5c-8dd4-b185fd3586c9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:05.174231 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6236aadd-221d-4e5c-8dd4-b185fd3586c9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:05.184781 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6236aadd-221d-4e5c-8dd4-b185fd3586c9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1291 microversion: 2.1 time: 0.112875 Apr 06 16:42:05.185695 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 253/522] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:05 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1291 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:42:05.225374 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2ce764e9-6690-45e3-9a62-57b1b9b8ce49 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:05.234414 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2ce764e9-6690-45e3-9a62-57b1b9b8ce49 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.242116 Apr 06 16:42:05.235596 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 270/523] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:04 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:05.998847 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-84a49408-3e10-4721-bb49-a313dd7cc775 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:06.000547 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-84a49408-3e10-4721-bb49-a313dd7cc775 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:06.007408 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84a49408-3e10-4721-bb49-a313dd7cc775 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:06.007858 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84a49408-3e10-4721-bb49-a313dd7cc775 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:06.008651 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84a49408-3e10-4721-bb49-a313dd7cc775 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:06.009123 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84a49408-3e10-4721-bb49-a313dd7cc775 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:06.046942 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-84a49408-3e10-4721-bb49-a313dd7cc775 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054531 Apr 06 16:42:06.051524 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 254/524] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:05 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:06.206425 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-85a987e3-6461-48bd-a166-cc4e6e91e198 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:06.207238 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-85a987e3-6461-48bd-a166-cc4e6e91e198 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:06.214076 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85a987e3-6461-48bd-a166-cc4e6e91e198 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:06.214932 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85a987e3-6461-48bd-a166-cc4e6e91e198 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:06.215855 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85a987e3-6461-48bd-a166-cc4e6e91e198 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:06.216428 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85a987e3-6461-48bd-a166-cc4e6e91e198 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:06.257050 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4038353f-b59f-476f-b33b-7fa0fe42f99b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:06.257967 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4038353f-b59f-476f-b33b-7fa0fe42f99b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:06.265123 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4038353f-b59f-476f-b33b-7fa0fe42f99b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:06.265735 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4038353f-b59f-476f-b33b-7fa0fe42f99b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:06.267491 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4038353f-b59f-476f-b33b-7fa0fe42f99b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:06.267491 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4038353f-b59f-476f-b33b-7fa0fe42f99b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:06.284875 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-85a987e3-6461-48bd-a166-cc4e6e91e198 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:06.293252 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-85a987e3-6461-48bd-a166-cc4e6e91e198 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1291 microversion: 2.1 time: 0.093488 Apr 06 16:42:06.301130 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 271/525] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:06 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1291 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:06.435652 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4038353f-b59f-476f-b33b-7fa0fe42f99b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:06.443614 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4038353f-b59f-476f-b33b-7fa0fe42f99b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.194691 Apr 06 16:42:06.444303 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 255/526] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:06 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:42:07.059721 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9fddb805-9b7e-48b3-8ec1-6e43b5d8b40d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:07.060949 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9fddb805-9b7e-48b3-8ec1-6e43b5d8b40d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:07.068288 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fddb805-9b7e-48b3-8ec1-6e43b5d8b40d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:07.069012 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fddb805-9b7e-48b3-8ec1-6e43b5d8b40d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:07.069817 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fddb805-9b7e-48b3-8ec1-6e43b5d8b40d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:07.070276 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fddb805-9b7e-48b3-8ec1-6e43b5d8b40d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:07.106553 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9fddb805-9b7e-48b3-8ec1-6e43b5d8b40d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050807 Apr 06 16:42:07.107253 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 272/527] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:07 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:07.319173 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2e871353-a22d-4ef9-829e-da9694396982 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:07.319767 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2e871353-a22d-4ef9-829e-da9694396982 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:07.327307 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e871353-a22d-4ef9-829e-da9694396982 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:07.327736 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e871353-a22d-4ef9-829e-da9694396982 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:07.328877 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e871353-a22d-4ef9-829e-da9694396982 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:07.329310 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e871353-a22d-4ef9-829e-da9694396982 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:07.410805 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2e871353-a22d-4ef9-829e-da9694396982 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:07.419252 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2e871353-a22d-4ef9-829e-da9694396982 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1291 microversion: 2.1 time: 0.104085 Apr 06 16:42:07.420190 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 256/528] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:07 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1291 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:07.460610 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a9e6d59f-5f5d-47e7-bea6-d498b8488d55 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:07.461266 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a9e6d59f-5f5d-47e7-bea6-d498b8488d55 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:07.473560 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9e6d59f-5f5d-47e7-bea6-d498b8488d55 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:07.474401 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9e6d59f-5f5d-47e7-bea6-d498b8488d55 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:07.475454 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9e6d59f-5f5d-47e7-bea6-d498b8488d55 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:07.475885 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9e6d59f-5f5d-47e7-bea6-d498b8488d55 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:07.622609 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a9e6d59f-5f5d-47e7-bea6-d498b8488d55 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:07.632036 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a9e6d59f-5f5d-47e7-bea6-d498b8488d55 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.173972 Apr 06 16:42:07.632870 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 273/529] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:07 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:08.120437 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-704d079b-a723-4962-9cb8-e6ec409b0887 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:08.121829 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-704d079b-a723-4962-9cb8-e6ec409b0887 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:08.128661 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-704d079b-a723-4962-9cb8-e6ec409b0887 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:08.129151 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-704d079b-a723-4962-9cb8-e6ec409b0887 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:08.129961 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-704d079b-a723-4962-9cb8-e6ec409b0887 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:08.130390 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-704d079b-a723-4962-9cb8-e6ec409b0887 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:08.162381 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-704d079b-a723-4962-9cb8-e6ec409b0887 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046544 Apr 06 16:42:08.163074 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 257/530] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:08 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:08.441141 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aabcfb1c-8ba2-4473-bcd9-25512b748edc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:08.441870 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aabcfb1c-8ba2-4473-bcd9-25512b748edc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:08.448458 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aabcfb1c-8ba2-4473-bcd9-25512b748edc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:08.448936 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aabcfb1c-8ba2-4473-bcd9-25512b748edc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:08.449728 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aabcfb1c-8ba2-4473-bcd9-25512b748edc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:08.450161 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aabcfb1c-8ba2-4473-bcd9-25512b748edc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:08.517139 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-aabcfb1c-8ba2-4473-bcd9-25512b748edc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:08.525323 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aabcfb1c-8ba2-4473-bcd9-25512b748edc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1291 microversion: 2.1 time: 0.091143 Apr 06 16:42:08.525918 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 274/531] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:08 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1291 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:08.650160 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b8094d86-9219-46f5-b8d9-ddf05d0c73cd tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:08.650738 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b8094d86-9219-46f5-b8d9-ddf05d0c73cd tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:08.659936 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8094d86-9219-46f5-b8d9-ddf05d0c73cd tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:08.660609 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8094d86-9219-46f5-b8d9-ddf05d0c73cd tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:08.662189 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8094d86-9219-46f5-b8d9-ddf05d0c73cd tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:08.663130 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8094d86-9219-46f5-b8d9-ddf05d0c73cd tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:08.856085 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b8094d86-9219-46f5-b8d9-ddf05d0c73cd tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:08.867897 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b8094d86-9219-46f5-b8d9-ddf05d0c73cd tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.221224 Apr 06 16:42:08.868621 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 258/532] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:08 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:09.178947 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-88e74617-7db6-4d9c-b856-01d4a2da03cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:09.180351 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-88e74617-7db6-4d9c-b856-01d4a2da03cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:09.192571 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88e74617-7db6-4d9c-b856-01d4a2da03cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:09.193146 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88e74617-7db6-4d9c-b856-01d4a2da03cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:09.194019 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88e74617-7db6-4d9c-b856-01d4a2da03cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:09.194502 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88e74617-7db6-4d9c-b856-01d4a2da03cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:09.229154 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-88e74617-7db6-4d9c-b856-01d4a2da03cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057076 Apr 06 16:42:09.229954 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 275/533] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:09 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:09.545256 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-46ffa753-3b99-4195-94b5-014254b91524 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:09.545873 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-46ffa753-3b99-4195-94b5-014254b91524 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:09.558188 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46ffa753-3b99-4195-94b5-014254b91524 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:09.559478 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46ffa753-3b99-4195-94b5-014254b91524 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:09.561420 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46ffa753-3b99-4195-94b5-014254b91524 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:09.562467 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46ffa753-3b99-4195-94b5-014254b91524 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:09.646972 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-46ffa753-3b99-4195-94b5-014254b91524 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:09.654919 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-46ffa753-3b99-4195-94b5-014254b91524 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1291 microversion: 2.1 time: 0.114637 Apr 06 16:42:09.655586 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 259/534] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:09 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1291 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:09.888601 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d0a05b3c-0c50-49cc-a754-96f412af49b3 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:09.889760 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d0a05b3c-0c50-49cc-a754-96f412af49b3 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:09.897484 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0a05b3c-0c50-49cc-a754-96f412af49b3 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:09.897958 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0a05b3c-0c50-49cc-a754-96f412af49b3 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:09.898728 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0a05b3c-0c50-49cc-a754-96f412af49b3 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:09.899158 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0a05b3c-0c50-49cc-a754-96f412af49b3 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:10.047447 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d0a05b3c-0c50-49cc-a754-96f412af49b3 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:10.057233 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d0a05b3c-0c50-49cc-a754-96f412af49b3 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.175163 Apr 06 16:42:10.058108 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 276/535] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:09 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:10.241796 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cfc90a37-beab-45f2-b4bf-4ee44587df37 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:10.243052 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cfc90a37-beab-45f2-b4bf-4ee44587df37 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:10.250031 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfc90a37-beab-45f2-b4bf-4ee44587df37 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:10.251078 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfc90a37-beab-45f2-b4bf-4ee44587df37 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:10.251841 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfc90a37-beab-45f2-b4bf-4ee44587df37 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:10.252275 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfc90a37-beab-45f2-b4bf-4ee44587df37 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:10.284709 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cfc90a37-beab-45f2-b4bf-4ee44587df37 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047150 Apr 06 16:42:10.285486 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 260/536] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:10 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:10.672120 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f5e24923-7501-470d-b5dc-6eb6b5ac7832 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:10.672870 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f5e24923-7501-470d-b5dc-6eb6b5ac7832 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:10.680895 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5e24923-7501-470d-b5dc-6eb6b5ac7832 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:10.681628 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5e24923-7501-470d-b5dc-6eb6b5ac7832 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:10.682692 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5e24923-7501-470d-b5dc-6eb6b5ac7832 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:10.683132 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5e24923-7501-470d-b5dc-6eb6b5ac7832 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:10.757939 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f5e24923-7501-470d-b5dc-6eb6b5ac7832 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:10.767058 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f5e24923-7501-470d-b5dc-6eb6b5ac7832 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1309 microversion: 2.1 time: 0.098746 Apr 06 16:42:10.767664 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 277/537] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:10 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:10.962730 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-5ce16a31-8a54-4a1f-987f-dea3277cb5d1 req-50282943-e300-4630-b3b8-6430bff6b950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0cb1d38-bd60-4b01-9c35-d2a181ced275", "tag": "c3626722-fde1-4b09-b90d-77925245b539"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:42:10.975555 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5ce16a31-8a54-4a1f-987f-dea3277cb5d1 req-50282943-e300-4630-b3b8-6430bff6b950 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:10.976007 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5ce16a31-8a54-4a1f-987f-dea3277cb5d1 req-50282943-e300-4630-b3b8-6430bff6b950 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:10.990302 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-5ce16a31-8a54-4a1f-987f-dea3277cb5d1 req-50282943-e300-4630-b3b8-6430bff6b950 service nova] Creating event network-changed:c3626722-fde1-4b09-b90d-77925245b539 for instance b0cb1d38-bd60-4b01-9c35-d2a181ced275 on hv-cinder-83684 Apr 06 16:42:10.996470 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-5ce16a31-8a54-4a1f-987f-dea3277cb5d1 req-50282943-e300-4630-b3b8-6430bff6b950 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037779 Apr 06 16:42:10.997413 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 261/538] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:11.075724 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-76c37663-549c-4212-8a8b-ae8bb74e8030 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:11.076329 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-76c37663-549c-4212-8a8b-ae8bb74e8030 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:11.083448 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76c37663-549c-4212-8a8b-ae8bb74e8030 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:11.083902 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76c37663-549c-4212-8a8b-ae8bb74e8030 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:11.084712 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76c37663-549c-4212-8a8b-ae8bb74e8030 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:11.085163 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76c37663-549c-4212-8a8b-ae8bb74e8030 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:11.296482 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ccf09870-84c3-4717-a1dc-d15472b98ccb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:11.297985 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ccf09870-84c3-4717-a1dc-d15472b98ccb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:11.306032 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccf09870-84c3-4717-a1dc-d15472b98ccb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:11.306479 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccf09870-84c3-4717-a1dc-d15472b98ccb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:11.307271 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccf09870-84c3-4717-a1dc-d15472b98ccb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:11.307708 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccf09870-84c3-4717-a1dc-d15472b98ccb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:11.360604 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ccf09870-84c3-4717-a1dc-d15472b98ccb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068371 Apr 06 16:42:11.361240 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 262/539] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:11 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:11.425388 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-76c37663-549c-4212-8a8b-ae8bb74e8030 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:11.435326 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-76c37663-549c-4212-8a8b-ae8bb74e8030 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.363475 Apr 06 16:42:11.436089 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 278/540] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:11 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:11.788365 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bb392e62-ff76-4363-8f0c-850faff3dce4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:11.789598 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bb392e62-ff76-4363-8f0c-850faff3dce4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:11.795725 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb392e62-ff76-4363-8f0c-850faff3dce4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:11.796207 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb392e62-ff76-4363-8f0c-850faff3dce4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:11.797166 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb392e62-ff76-4363-8f0c-850faff3dce4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:11.797615 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb392e62-ff76-4363-8f0c-850faff3dce4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:11.954679 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-bb392e62-ff76-4363-8f0c-850faff3dce4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:11.962838 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bb392e62-ff76-4363-8f0c-850faff3dce4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.182151 Apr 06 16:42:11.963614 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 263/541] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:11 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:12.374954 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b0fd66f5-4ed4-4da8-ad15-ca90a45b289a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:12.376033 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b0fd66f5-4ed4-4da8-ad15-ca90a45b289a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:12.382842 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0fd66f5-4ed4-4da8-ad15-ca90a45b289a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:12.383403 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0fd66f5-4ed4-4da8-ad15-ca90a45b289a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:12.384182 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0fd66f5-4ed4-4da8-ad15-ca90a45b289a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:12.384725 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0fd66f5-4ed4-4da8-ad15-ca90a45b289a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:12.415942 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b0fd66f5-4ed4-4da8-ad15-ca90a45b289a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045637 Apr 06 16:42:12.416747 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 279/542] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:12 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:12.454984 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-51a19fb7-5294-4266-9bbb-de6156362d82 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:12.455597 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-51a19fb7-5294-4266-9bbb-de6156362d82 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:12.462883 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51a19fb7-5294-4266-9bbb-de6156362d82 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:12.463337 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51a19fb7-5294-4266-9bbb-de6156362d82 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:12.464129 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51a19fb7-5294-4266-9bbb-de6156362d82 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:12.464575 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51a19fb7-5294-4266-9bbb-de6156362d82 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:12.606884 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-51a19fb7-5294-4266-9bbb-de6156362d82 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:12.616707 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-51a19fb7-5294-4266-9bbb-de6156362d82 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.164244 Apr 06 16:42:12.616707 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 264/543] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:12 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:12.981651 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c658f64f-b988-42cc-9f9a-2952e60e47a5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:12.982250 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c658f64f-b988-42cc-9f9a-2952e60e47a5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:12.990333 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c658f64f-b988-42cc-9f9a-2952e60e47a5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:12.990780 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c658f64f-b988-42cc-9f9a-2952e60e47a5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:12.991556 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c658f64f-b988-42cc-9f9a-2952e60e47a5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:12.991990 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c658f64f-b988-42cc-9f9a-2952e60e47a5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:13.140841 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c658f64f-b988-42cc-9f9a-2952e60e47a5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:13.149154 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c658f64f-b988-42cc-9f9a-2952e60e47a5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.171421 Apr 06 16:42:13.149739 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 280/544] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:12 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:13.428039 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5dbdd29b-3665-4d59-a149-277ef1bf4641 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:13.428989 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5dbdd29b-3665-4d59-a149-277ef1bf4641 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:13.435599 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5dbdd29b-3665-4d59-a149-277ef1bf4641 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:13.436042 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5dbdd29b-3665-4d59-a149-277ef1bf4641 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:13.436852 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5dbdd29b-3665-4d59-a149-277ef1bf4641 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:13.437381 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5dbdd29b-3665-4d59-a149-277ef1bf4641 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:13.470397 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5dbdd29b-3665-4d59-a149-277ef1bf4641 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045821 Apr 06 16:42:13.471290 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 265/545] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:13 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:13.633852 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9cec2966-d732-41fa-9a11-00fcdf9b7629 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:13.634476 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9cec2966-d732-41fa-9a11-00fcdf9b7629 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:13.641089 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cec2966-d732-41fa-9a11-00fcdf9b7629 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:13.641537 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cec2966-d732-41fa-9a11-00fcdf9b7629 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:13.642331 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cec2966-d732-41fa-9a11-00fcdf9b7629 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:13.642765 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cec2966-d732-41fa-9a11-00fcdf9b7629 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:13.784210 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9cec2966-d732-41fa-9a11-00fcdf9b7629 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:13.792196 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9cec2966-d732-41fa-9a11-00fcdf9b7629 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.163532 Apr 06 16:42:13.792798 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 281/546] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:13 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:14.167893 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fabb94f9-b9c1-488e-9071-5cb856854057 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:14.168566 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fabb94f9-b9c1-488e-9071-5cb856854057 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:14.176965 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fabb94f9-b9c1-488e-9071-5cb856854057 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:14.177731 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fabb94f9-b9c1-488e-9071-5cb856854057 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:14.179025 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fabb94f9-b9c1-488e-9071-5cb856854057 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:14.179439 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fabb94f9-b9c1-488e-9071-5cb856854057 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:14.332477 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fabb94f9-b9c1-488e-9071-5cb856854057 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:14.340507 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fabb94f9-b9c1-488e-9071-5cb856854057 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.177150 Apr 06 16:42:14.341113 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 266/547] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:14 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:14.484148 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bb01086f-be72-41c4-91a8-0ffddcbd98f2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:14.485071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bb01086f-be72-41c4-91a8-0ffddcbd98f2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:14.492078 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb01086f-be72-41c4-91a8-0ffddcbd98f2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:14.492913 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb01086f-be72-41c4-91a8-0ffddcbd98f2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:14.493715 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb01086f-be72-41c4-91a8-0ffddcbd98f2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:14.494148 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb01086f-be72-41c4-91a8-0ffddcbd98f2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:14.525538 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bb01086f-be72-41c4-91a8-0ffddcbd98f2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045504 Apr 06 16:42:14.526287 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 282/548] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:14 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:14.812216 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6d719960-db00-4e95-b26b-4997fcc120e5 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:14.813024 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6d719960-db00-4e95-b26b-4997fcc120e5 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:14.823068 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d719960-db00-4e95-b26b-4997fcc120e5 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:14.823516 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d719960-db00-4e95-b26b-4997fcc120e5 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:14.824290 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d719960-db00-4e95-b26b-4997fcc120e5 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:14.824719 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d719960-db00-4e95-b26b-4997fcc120e5 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:14.966774 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6d719960-db00-4e95-b26b-4997fcc120e5 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:14.976764 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6d719960-db00-4e95-b26b-4997fcc120e5 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.169488 Apr 06 16:42:14.977771 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 267/549] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:14 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:15.357571 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b46f0400-9658-41fc-bb3e-972269289d94 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:15.358188 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b46f0400-9658-41fc-bb3e-972269289d94 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:15.364852 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b46f0400-9658-41fc-bb3e-972269289d94 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:15.365305 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b46f0400-9658-41fc-bb3e-972269289d94 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:15.366080 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b46f0400-9658-41fc-bb3e-972269289d94 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:15.366514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b46f0400-9658-41fc-bb3e-972269289d94 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:15.508899 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b46f0400-9658-41fc-bb3e-972269289d94 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:15.517391 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b46f0400-9658-41fc-bb3e-972269289d94 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.163799 Apr 06 16:42:15.517963 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 283/550] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:15 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:15.537908 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e1a344d9-a02d-4d3a-9dc0-1a41e3e8317b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:15.538832 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e1a344d9-a02d-4d3a-9dc0-1a41e3e8317b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:15.545039 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1a344d9-a02d-4d3a-9dc0-1a41e3e8317b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:15.545483 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1a344d9-a02d-4d3a-9dc0-1a41e3e8317b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:15.546245 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1a344d9-a02d-4d3a-9dc0-1a41e3e8317b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:15.547212 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1a344d9-a02d-4d3a-9dc0-1a41e3e8317b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:15.579031 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e1a344d9-a02d-4d3a-9dc0-1a41e3e8317b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044760 Apr 06 16:42:15.579714 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 268/551] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:15 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:42:15.997780 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5cab6086-7047-4458-8368-ff10d8f97249 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:15.998378 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5cab6086-7047-4458-8368-ff10d8f97249 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:16.008461 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cab6086-7047-4458-8368-ff10d8f97249 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:16.009130 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cab6086-7047-4458-8368-ff10d8f97249 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:16.010387 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cab6086-7047-4458-8368-ff10d8f97249 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:16.010848 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5cab6086-7047-4458-8368-ff10d8f97249 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:16.164761 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5cab6086-7047-4458-8368-ff10d8f97249 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:16.173005 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5cab6086-7047-4458-8368-ff10d8f97249 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.179188 Apr 06 16:42:16.173599 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 284/552] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:15 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:16.535252 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-afc3d8a5-5d02-4277-b2fe-6504989a23a3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:16.535881 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-afc3d8a5-5d02-4277-b2fe-6504989a23a3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:16.542817 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afc3d8a5-5d02-4277-b2fe-6504989a23a3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:16.543263 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afc3d8a5-5d02-4277-b2fe-6504989a23a3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:16.544041 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afc3d8a5-5d02-4277-b2fe-6504989a23a3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:16.544473 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afc3d8a5-5d02-4277-b2fe-6504989a23a3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:16.591599 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c8034ef3-9788-4474-afd4-e5d6d39cdf3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:16.592469 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c8034ef3-9788-4474-afd4-e5d6d39cdf3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:16.602399 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8034ef3-9788-4474-afd4-e5d6d39cdf3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:16.602843 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8034ef3-9788-4474-afd4-e5d6d39cdf3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:16.603630 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8034ef3-9788-4474-afd4-e5d6d39cdf3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:16.604065 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8034ef3-9788-4474-afd4-e5d6d39cdf3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:16.645528 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c8034ef3-9788-4474-afd4-e5d6d39cdf3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057971 Apr 06 16:42:16.646136 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 285/553] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:16 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:42:16.700805 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-afc3d8a5-5d02-4277-b2fe-6504989a23a3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:16.709701 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-afc3d8a5-5d02-4277-b2fe-6504989a23a3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.178850 Apr 06 16:42:16.710258 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 269/554] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:16 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:17.191572 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7a496c70-96fb-4063-ab88-155bec7ba7ae tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:17.192180 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7a496c70-96fb-4063-ab88-155bec7ba7ae tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:17.198727 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a496c70-96fb-4063-ab88-155bec7ba7ae tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:17.199176 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a496c70-96fb-4063-ab88-155bec7ba7ae tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:17.199966 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a496c70-96fb-4063-ab88-155bec7ba7ae tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:17.200393 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a496c70-96fb-4063-ab88-155bec7ba7ae tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:17.349720 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7a496c70-96fb-4063-ab88-155bec7ba7ae tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:17.358772 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7a496c70-96fb-4063-ab88-155bec7ba7ae tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.171098 Apr 06 16:42:17.359527 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 286/555] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:17 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:17.662116 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c723bbac-cf65-41b4-baaf-e62496cae651 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:17.663345 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c723bbac-cf65-41b4-baaf-e62496cae651 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:17.676016 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c723bbac-cf65-41b4-baaf-e62496cae651 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:17.676466 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c723bbac-cf65-41b4-baaf-e62496cae651 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:17.677321 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c723bbac-cf65-41b4-baaf-e62496cae651 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:17.677751 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c723bbac-cf65-41b4-baaf-e62496cae651 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:17.717277 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c723bbac-cf65-41b4-baaf-e62496cae651 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062136 Apr 06 16:42:17.717856 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 270/556] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:17 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:17.731611 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-25d61721-c16e-43b9-b913-8f331a16ea53 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:17.732206 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-25d61721-c16e-43b9-b913-8f331a16ea53 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:17.739081 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25d61721-c16e-43b9-b913-8f331a16ea53 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:17.739527 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25d61721-c16e-43b9-b913-8f331a16ea53 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:17.740289 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25d61721-c16e-43b9-b913-8f331a16ea53 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:17.740704 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25d61721-c16e-43b9-b913-8f331a16ea53 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:17.891760 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-25d61721-c16e-43b9-b913-8f331a16ea53 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:17.899394 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-25d61721-c16e-43b9-b913-8f331a16ea53 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.171632 Apr 06 16:42:17.899960 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 287/557] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:17 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:18.377164 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-35a221e6-8cde-428b-8552-7960d30a9603 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:18.377775 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-35a221e6-8cde-428b-8552-7960d30a9603 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:18.384444 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35a221e6-8cde-428b-8552-7960d30a9603 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:18.384916 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35a221e6-8cde-428b-8552-7960d30a9603 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:18.385726 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35a221e6-8cde-428b-8552-7960d30a9603 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:18.386155 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35a221e6-8cde-428b-8552-7960d30a9603 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:18.542079 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-35a221e6-8cde-428b-8552-7960d30a9603 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:18.550567 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-35a221e6-8cde-428b-8552-7960d30a9603 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.177340 Apr 06 16:42:18.551173 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 271/558] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:18 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:18.731753 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-be5bb328-5920-4776-886a-1a49f0624e8e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:18.732674 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-be5bb328-5920-4776-886a-1a49f0624e8e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:18.739356 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be5bb328-5920-4776-886a-1a49f0624e8e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:18.739792 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be5bb328-5920-4776-886a-1a49f0624e8e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:18.740537 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be5bb328-5920-4776-886a-1a49f0624e8e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:18.741017 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be5bb328-5920-4776-886a-1a49f0624e8e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:18.771456 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-be5bb328-5920-4776-886a-1a49f0624e8e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044336 Apr 06 16:42:18.771997 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 288/559] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:18 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:18.916750 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d9c68f6c-3cf1-431c-a63d-f20ad5f38ef7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:18.917411 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d9c68f6c-3cf1-431c-a63d-f20ad5f38ef7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:18.925862 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9c68f6c-3cf1-431c-a63d-f20ad5f38ef7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:18.926326 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9c68f6c-3cf1-431c-a63d-f20ad5f38ef7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:18.927092 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9c68f6c-3cf1-431c-a63d-f20ad5f38ef7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:18.927519 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9c68f6c-3cf1-431c-a63d-f20ad5f38ef7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:19.069454 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d9c68f6c-3cf1-431c-a63d-f20ad5f38ef7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:19.077923 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d9c68f6c-3cf1-431c-a63d-f20ad5f38ef7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.164928 Apr 06 16:42:19.078864 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 272/560] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:18 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:19.569493 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c7ac8566-21ca-43f2-a7c6-ad210eccf94b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:19.570116 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c7ac8566-21ca-43f2-a7c6-ad210eccf94b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:19.576908 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7ac8566-21ca-43f2-a7c6-ad210eccf94b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:19.577387 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7ac8566-21ca-43f2-a7c6-ad210eccf94b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:19.578312 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7ac8566-21ca-43f2-a7c6-ad210eccf94b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:19.578748 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7ac8566-21ca-43f2-a7c6-ad210eccf94b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:19.718602 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c7ac8566-21ca-43f2-a7c6-ad210eccf94b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:19.728281 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c7ac8566-21ca-43f2-a7c6-ad210eccf94b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.162646 Apr 06 16:42:19.728955 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 289/561] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:19 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:19.786321 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4581fe13-9bcc-48f6-bb36-b7b552beed34 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:19.787865 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4581fe13-9bcc-48f6-bb36-b7b552beed34 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:19.797225 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4581fe13-9bcc-48f6-bb36-b7b552beed34 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:19.797676 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4581fe13-9bcc-48f6-bb36-b7b552beed34 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:19.798475 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4581fe13-9bcc-48f6-bb36-b7b552beed34 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:19.798910 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4581fe13-9bcc-48f6-bb36-b7b552beed34 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:19.829517 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4581fe13-9bcc-48f6-bb36-b7b552beed34 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049890 Apr 06 16:42:19.830097 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 273/562] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:19 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:20.097234 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-70fc044a-066f-4ce3-9e37-8a1d0b070fe3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:20.097862 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-70fc044a-066f-4ce3-9e37-8a1d0b070fe3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:20.104176 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70fc044a-066f-4ce3-9e37-8a1d0b070fe3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:20.104627 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70fc044a-066f-4ce3-9e37-8a1d0b070fe3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:20.105426 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70fc044a-066f-4ce3-9e37-8a1d0b070fe3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:20.105861 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70fc044a-066f-4ce3-9e37-8a1d0b070fe3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:20.253806 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-70fc044a-066f-4ce3-9e37-8a1d0b070fe3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:20.264322 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-70fc044a-066f-4ce3-9e37-8a1d0b070fe3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.172503 Apr 06 16:42:20.264960 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 290/563] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:20 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:20.748547 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-31df5b6b-b244-4785-a3f8-89825748fa7f tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:20.749226 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-31df5b6b-b244-4785-a3f8-89825748fa7f tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:20.756580 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31df5b6b-b244-4785-a3f8-89825748fa7f tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:20.757057 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31df5b6b-b244-4785-a3f8-89825748fa7f tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:20.757823 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31df5b6b-b244-4785-a3f8-89825748fa7f tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:20.758276 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31df5b6b-b244-4785-a3f8-89825748fa7f tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:20.841028 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9a7a2365-edb0-4622-9c99-0bcf0a81a831 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:20.841976 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9a7a2365-edb0-4622-9c99-0bcf0a81a831 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:20.848232 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a7a2365-edb0-4622-9c99-0bcf0a81a831 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:20.848695 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a7a2365-edb0-4622-9c99-0bcf0a81a831 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:20.849495 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a7a2365-edb0-4622-9c99-0bcf0a81a831 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:20.849894 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a7a2365-edb0-4622-9c99-0bcf0a81a831 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:20.884061 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9a7a2365-edb0-4622-9c99-0bcf0a81a831 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047046 Apr 06 16:42:20.884963 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 291/564] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:20 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:42:20.907053 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-31df5b6b-b244-4785-a3f8-89825748fa7f tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:20.916449 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-31df5b6b-b244-4785-a3f8-89825748fa7f tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.173613 Apr 06 16:42:20.917060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 274/565] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:20 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:21.282960 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-37b6ec5e-0c28-4427-8ca4-abd3ddd8846c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:21.283606 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-37b6ec5e-0c28-4427-8ca4-abd3ddd8846c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:21.290866 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37b6ec5e-0c28-4427-8ca4-abd3ddd8846c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:21.291424 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37b6ec5e-0c28-4427-8ca4-abd3ddd8846c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:21.292481 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37b6ec5e-0c28-4427-8ca4-abd3ddd8846c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:21.292982 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37b6ec5e-0c28-4427-8ca4-abd3ddd8846c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:21.437602 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-37b6ec5e-0c28-4427-8ca4-abd3ddd8846c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:21.445759 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-37b6ec5e-0c28-4427-8ca4-abd3ddd8846c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.167271 Apr 06 16:42:21.455671 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 292/566] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:21 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:21.897161 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b2ce7f1c-55af-4b11-b470-206fc094c1ce tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:21.898099 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b2ce7f1c-55af-4b11-b470-206fc094c1ce tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:21.906841 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2ce7f1c-55af-4b11-b470-206fc094c1ce tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:21.907293 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2ce7f1c-55af-4b11-b470-206fc094c1ce tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:21.908080 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2ce7f1c-55af-4b11-b470-206fc094c1ce tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:21.908510 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2ce7f1c-55af-4b11-b470-206fc094c1ce tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:21.934912 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4014ed9f-2ea4-43aa-b7c6-b84571da968b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:21.935548 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4014ed9f-2ea4-43aa-b7c6-b84571da968b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:21.939778 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b2ce7f1c-55af-4b11-b470-206fc094c1ce tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047181 Apr 06 16:42:21.940423 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 275/567] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:21 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:21.942024 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4014ed9f-2ea4-43aa-b7c6-b84571da968b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:21.942472 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4014ed9f-2ea4-43aa-b7c6-b84571da968b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:21.943250 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4014ed9f-2ea4-43aa-b7c6-b84571da968b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:21.943680 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4014ed9f-2ea4-43aa-b7c6-b84571da968b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:22.081419 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4014ed9f-2ea4-43aa-b7c6-b84571da968b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:22.089357 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4014ed9f-2ea4-43aa-b7c6-b84571da968b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.158304 Apr 06 16:42:22.089938 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 293/568] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:21 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:22.463490 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d1d549f6-8a66-4f03-a634-77af97a796bd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:22.464154 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d1d549f6-8a66-4f03-a634-77af97a796bd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:22.472271 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1d549f6-8a66-4f03-a634-77af97a796bd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:22.472974 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1d549f6-8a66-4f03-a634-77af97a796bd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:22.474170 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1d549f6-8a66-4f03-a634-77af97a796bd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:22.474642 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1d549f6-8a66-4f03-a634-77af97a796bd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:22.614389 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d1d549f6-8a66-4f03-a634-77af97a796bd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:22.622913 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d1d549f6-8a66-4f03-a634-77af97a796bd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.163072 Apr 06 16:42:22.623674 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 276/569] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:22 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:22.951364 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8c2c238a-a576-4573-8453-e109dc734aea tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:22.952288 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8c2c238a-a576-4573-8453-e109dc734aea tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:22.959018 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c2c238a-a576-4573-8453-e109dc734aea tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:22.959470 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c2c238a-a576-4573-8453-e109dc734aea tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:22.960246 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c2c238a-a576-4573-8453-e109dc734aea tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:22.960662 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c2c238a-a576-4573-8453-e109dc734aea tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:22.992276 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8c2c238a-a576-4573-8453-e109dc734aea tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044946 Apr 06 16:42:22.993260 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 294/570] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:22 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:23.111771 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b83e71c6-4979-4c55-a484-be722d50e943 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:23.112400 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b83e71c6-4979-4c55-a484-be722d50e943 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:23.124195 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b83e71c6-4979-4c55-a484-be722d50e943 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:23.125061 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b83e71c6-4979-4c55-a484-be722d50e943 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:23.125864 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b83e71c6-4979-4c55-a484-be722d50e943 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:23.126300 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b83e71c6-4979-4c55-a484-be722d50e943 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:23.268447 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b83e71c6-4979-4c55-a484-be722d50e943 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:23.276458 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b83e71c6-4979-4c55-a484-be722d50e943 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.168724 Apr 06 16:42:23.277083 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 277/571] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:23 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:23.639733 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9c9a88e1-e18c-44d2-816b-064714ddbf6a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:23.640391 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9c9a88e1-e18c-44d2-816b-064714ddbf6a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:23.647299 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c9a88e1-e18c-44d2-816b-064714ddbf6a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:23.647749 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c9a88e1-e18c-44d2-816b-064714ddbf6a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:23.648533 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c9a88e1-e18c-44d2-816b-064714ddbf6a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:23.648999 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c9a88e1-e18c-44d2-816b-064714ddbf6a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:23.796711 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9c9a88e1-e18c-44d2-816b-064714ddbf6a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:23.806556 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9c9a88e1-e18c-44d2-816b-064714ddbf6a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.170696 Apr 06 16:42:23.807123 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 295/572] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:23 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:24.006054 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-905f8edc-ae2d-4548-8565-e92a3eab11df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:24.006898 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-905f8edc-ae2d-4548-8565-e92a3eab11df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:24.013660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-905f8edc-ae2d-4548-8565-e92a3eab11df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:24.014398 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-905f8edc-ae2d-4548-8565-e92a3eab11df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:24.014868 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-905f8edc-ae2d-4548-8565-e92a3eab11df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:24.015336 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-905f8edc-ae2d-4548-8565-e92a3eab11df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:24.051244 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-905f8edc-ae2d-4548-8565-e92a3eab11df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049264 Apr 06 16:42:24.051823 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 278/573] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:24 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:24.294086 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0d77bb24-f222-4c95-9d0a-aa86a1acbb58 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:24.294668 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0d77bb24-f222-4c95-9d0a-aa86a1acbb58 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:24.300978 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d77bb24-f222-4c95-9d0a-aa86a1acbb58 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:24.301425 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d77bb24-f222-4c95-9d0a-aa86a1acbb58 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:24.302191 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d77bb24-f222-4c95-9d0a-aa86a1acbb58 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:24.302619 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d77bb24-f222-4c95-9d0a-aa86a1acbb58 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:24.441954 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0d77bb24-f222-4c95-9d0a-aa86a1acbb58 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:24.450319 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0d77bb24-f222-4c95-9d0a-aa86a1acbb58 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.160146 Apr 06 16:42:24.450906 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 296/574] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:24 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:24.823875 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9f15dc62-be7e-4825-bf5d-6fd69c2f0db2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:24.824528 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9f15dc62-be7e-4825-bf5d-6fd69c2f0db2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:24.831771 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f15dc62-be7e-4825-bf5d-6fd69c2f0db2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:24.832227 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f15dc62-be7e-4825-bf5d-6fd69c2f0db2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:24.833016 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f15dc62-be7e-4825-bf5d-6fd69c2f0db2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:24.833548 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f15dc62-be7e-4825-bf5d-6fd69c2f0db2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:25.064621 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f40a2876-3753-43a6-841d-388ac1600791 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:25.067333 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f40a2876-3753-43a6-841d-388ac1600791 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:25.075649 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f40a2876-3753-43a6-841d-388ac1600791 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:25.076001 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f40a2876-3753-43a6-841d-388ac1600791 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:25.076820 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f40a2876-3753-43a6-841d-388ac1600791 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:25.077290 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f40a2876-3753-43a6-841d-388ac1600791 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:25.115427 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f40a2876-3753-43a6-841d-388ac1600791 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056108 Apr 06 16:42:25.116024 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 297/575] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:25 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:25.245962 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9f15dc62-be7e-4825-bf5d-6fd69c2f0db2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:25.254494 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9f15dc62-be7e-4825-bf5d-6fd69c2f0db2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.434499 Apr 06 16:42:25.255120 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 279/576] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:24 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:25.468131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-88a787ba-2861-475c-a52c-6195f2e48fc7 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:25.468834 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-88a787ba-2861-475c-a52c-6195f2e48fc7 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:25.475293 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88a787ba-2861-475c-a52c-6195f2e48fc7 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:25.475740 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88a787ba-2861-475c-a52c-6195f2e48fc7 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:25.476501 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88a787ba-2861-475c-a52c-6195f2e48fc7 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:25.476950 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88a787ba-2861-475c-a52c-6195f2e48fc7 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:25.619994 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-88a787ba-2861-475c-a52c-6195f2e48fc7 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:25.628108 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-88a787ba-2861-475c-a52c-6195f2e48fc7 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.163900 Apr 06 16:42:25.628701 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 298/577] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:25 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:26.127953 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-368ec4ae-d3cf-40cf-8608-ae8f7bec3310 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:26.128934 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-368ec4ae-d3cf-40cf-8608-ae8f7bec3310 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:26.135717 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-368ec4ae-d3cf-40cf-8608-ae8f7bec3310 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:26.136171 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-368ec4ae-d3cf-40cf-8608-ae8f7bec3310 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:26.137003 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-368ec4ae-d3cf-40cf-8608-ae8f7bec3310 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:26.137440 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-368ec4ae-d3cf-40cf-8608-ae8f7bec3310 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:26.168257 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-368ec4ae-d3cf-40cf-8608-ae8f7bec3310 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044326 Apr 06 16:42:26.168868 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 280/578] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:26 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:26.272137 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-418479e6-2331-4a07-a184-63e53b393a67 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:26.272798 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-418479e6-2331-4a07-a184-63e53b393a67 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:26.279348 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-418479e6-2331-4a07-a184-63e53b393a67 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:26.279803 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-418479e6-2331-4a07-a184-63e53b393a67 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:26.280573 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-418479e6-2331-4a07-a184-63e53b393a67 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:26.281123 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-418479e6-2331-4a07-a184-63e53b393a67 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:26.432929 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-418479e6-2331-4a07-a184-63e53b393a67 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:26.441181 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-418479e6-2331-4a07-a184-63e53b393a67 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.172992 Apr 06 16:42:26.441802 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 299/579] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:26 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:26.647171 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3f6bc825-52b6-40cc-944d-9fde83a50f8a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:26.647777 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3f6bc825-52b6-40cc-944d-9fde83a50f8a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:26.655942 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f6bc825-52b6-40cc-944d-9fde83a50f8a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:26.656528 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f6bc825-52b6-40cc-944d-9fde83a50f8a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:26.657398 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f6bc825-52b6-40cc-944d-9fde83a50f8a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:26.657836 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f6bc825-52b6-40cc-944d-9fde83a50f8a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:26.797785 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3f6bc825-52b6-40cc-944d-9fde83a50f8a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:26.805988 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3f6bc825-52b6-40cc-944d-9fde83a50f8a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.162873 Apr 06 16:42:26.806539 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 281/580] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:26 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:27.183747 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d6597e56-72b2-4ca7-a29e-e125bc602cfc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:27.185186 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d6597e56-72b2-4ca7-a29e-e125bc602cfc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:27.193548 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6597e56-72b2-4ca7-a29e-e125bc602cfc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:27.193995 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6597e56-72b2-4ca7-a29e-e125bc602cfc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:27.194778 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6597e56-72b2-4ca7-a29e-e125bc602cfc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:27.195238 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6597e56-72b2-4ca7-a29e-e125bc602cfc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:27.233498 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d6597e56-72b2-4ca7-a29e-e125bc602cfc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057232 Apr 06 16:42:27.234545 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 300/581] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:27 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:27.458869 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-85ff2947-e82a-45ec-800d-d843f186bcc0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:27.459456 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-85ff2947-e82a-45ec-800d-d843f186bcc0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:27.465967 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85ff2947-e82a-45ec-800d-d843f186bcc0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:27.466411 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85ff2947-e82a-45ec-800d-d843f186bcc0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:27.467176 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85ff2947-e82a-45ec-800d-d843f186bcc0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:27.467600 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85ff2947-e82a-45ec-800d-d843f186bcc0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:27.618931 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-85ff2947-e82a-45ec-800d-d843f186bcc0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:27.627875 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-85ff2947-e82a-45ec-800d-d843f186bcc0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.172868 Apr 06 16:42:27.628467 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 282/582] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:27 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:27.826048 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0b2b0aca-d691-41d6-9f49-c4d759413cec tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:27.826558 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0b2b0aca-d691-41d6-9f49-c4d759413cec tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:27.833305 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b2b0aca-d691-41d6-9f49-c4d759413cec tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:27.833755 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b2b0aca-d691-41d6-9f49-c4d759413cec tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:27.834535 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b2b0aca-d691-41d6-9f49-c4d759413cec tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:27.834978 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b2b0aca-d691-41d6-9f49-c4d759413cec tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:27.977295 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0b2b0aca-d691-41d6-9f49-c4d759413cec tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:27.986055 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0b2b0aca-d691-41d6-9f49-c4d759413cec tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.165470 Apr 06 16:42:27.986637 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 301/583] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:27 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:28.246662 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-58d5d4a4-739c-4a6a-b301-b73512add9d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:28.247585 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-58d5d4a4-739c-4a6a-b301-b73512add9d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:28.254643 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58d5d4a4-739c-4a6a-b301-b73512add9d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:28.255090 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58d5d4a4-739c-4a6a-b301-b73512add9d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:28.255860 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58d5d4a4-739c-4a6a-b301-b73512add9d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:28.256289 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58d5d4a4-739c-4a6a-b301-b73512add9d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:28.288730 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-58d5d4a4-739c-4a6a-b301-b73512add9d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046361 Apr 06 16:42:28.289289 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 283/584] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:28 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:28.647003 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3944a789-d713-48ce-8cc8-20dfd76b83a7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:28.647620 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3944a789-d713-48ce-8cc8-20dfd76b83a7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:28.656825 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3944a789-d713-48ce-8cc8-20dfd76b83a7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:28.657274 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3944a789-d713-48ce-8cc8-20dfd76b83a7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:28.658053 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3944a789-d713-48ce-8cc8-20dfd76b83a7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:28.658484 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3944a789-d713-48ce-8cc8-20dfd76b83a7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:28.801877 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3944a789-d713-48ce-8cc8-20dfd76b83a7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:28.809998 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3944a789-d713-48ce-8cc8-20dfd76b83a7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.166884 Apr 06 16:42:28.810589 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 302/585] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:28 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:29.004832 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a55c8bcf-2aba-4362-a2d9-285b13454c57 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:29.005683 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a55c8bcf-2aba-4362-a2d9-285b13454c57 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:29.013045 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a55c8bcf-2aba-4362-a2d9-285b13454c57 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:29.013493 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a55c8bcf-2aba-4362-a2d9-285b13454c57 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:29.014276 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a55c8bcf-2aba-4362-a2d9-285b13454c57 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:29.014710 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a55c8bcf-2aba-4362-a2d9-285b13454c57 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:29.164315 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a55c8bcf-2aba-4362-a2d9-285b13454c57 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:29.174508 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a55c8bcf-2aba-4362-a2d9-285b13454c57 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.174218 Apr 06 16:42:29.175129 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 284/586] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:28 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:29.307433 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-89277fb3-5383-4ae2-8bbd-ade2b28525f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:29.308407 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-89277fb3-5383-4ae2-8bbd-ade2b28525f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:29.316037 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89277fb3-5383-4ae2-8bbd-ade2b28525f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:29.316463 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89277fb3-5383-4ae2-8bbd-ade2b28525f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:29.317403 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89277fb3-5383-4ae2-8bbd-ade2b28525f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:29.317847 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89277fb3-5383-4ae2-8bbd-ade2b28525f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:29.349336 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-89277fb3-5383-4ae2-8bbd-ade2b28525f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049486 Apr 06 16:42:29.349919 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 303/587] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:29 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:29.827959 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-94b863d5-3dc4-4aec-af36-be7864a02e7f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:29.828706 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-94b863d5-3dc4-4aec-af36-be7864a02e7f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:29.835407 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94b863d5-3dc4-4aec-af36-be7864a02e7f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:29.835843 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94b863d5-3dc4-4aec-af36-be7864a02e7f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:29.836623 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94b863d5-3dc4-4aec-af36-be7864a02e7f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:29.837090 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94b863d5-3dc4-4aec-af36-be7864a02e7f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:29.986505 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-94b863d5-3dc4-4aec-af36-be7864a02e7f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:29.994584 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-94b863d5-3dc4-4aec-af36-be7864a02e7f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.170700 Apr 06 16:42:29.995162 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 285/588] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:29 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:30.195251 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-52098399-667d-4035-875d-2a05fc235ab7 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:30.195971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-52098399-667d-4035-875d-2a05fc235ab7 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:30.202995 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52098399-667d-4035-875d-2a05fc235ab7 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:30.203487 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52098399-667d-4035-875d-2a05fc235ab7 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:30.204226 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52098399-667d-4035-875d-2a05fc235ab7 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:30.205405 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52098399-667d-4035-875d-2a05fc235ab7 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:30.352327 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-52098399-667d-4035-875d-2a05fc235ab7 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:30.362009 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e25a8f61-7c4f-4a3b-8119-6e04d782793e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:30.362971 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e25a8f61-7c4f-4a3b-8119-6e04d782793e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:30.365013 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-52098399-667d-4035-875d-2a05fc235ab7 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.173555 Apr 06 16:42:30.365615 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 304/589] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:30 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:30.369989 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e25a8f61-7c4f-4a3b-8119-6e04d782793e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:30.370431 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e25a8f61-7c4f-4a3b-8119-6e04d782793e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:30.371209 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e25a8f61-7c4f-4a3b-8119-6e04d782793e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:30.371636 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e25a8f61-7c4f-4a3b-8119-6e04d782793e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:30.402128 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e25a8f61-7c4f-4a3b-8119-6e04d782793e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044729 Apr 06 16:42:30.402691 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 286/590] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:30 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:42:31.012275 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a0861521-5c46-4869-8c52-b359dfa739b6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:31.012975 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a0861521-5c46-4869-8c52-b359dfa739b6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:31.019857 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0861521-5c46-4869-8c52-b359dfa739b6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:31.020309 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0861521-5c46-4869-8c52-b359dfa739b6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:31.021134 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0861521-5c46-4869-8c52-b359dfa739b6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:31.021568 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0861521-5c46-4869-8c52-b359dfa739b6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:31.183872 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a0861521-5c46-4869-8c52-b359dfa739b6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:31.191902 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a0861521-5c46-4869-8c52-b359dfa739b6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.183513 Apr 06 16:42:31.192488 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 305/591] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:31 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:31.383142 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f02408d1-d63b-4300-9c0c-eccd7f6278c5 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:31.383727 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f02408d1-d63b-4300-9c0c-eccd7f6278c5 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:31.391111 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f02408d1-d63b-4300-9c0c-eccd7f6278c5 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:31.391565 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f02408d1-d63b-4300-9c0c-eccd7f6278c5 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:31.392350 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f02408d1-d63b-4300-9c0c-eccd7f6278c5 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:31.392819 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f02408d1-d63b-4300-9c0c-eccd7f6278c5 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:31.414989 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-77b9e5fd-b936-4b46-9247-8ad07c63131e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:31.416075 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-77b9e5fd-b936-4b46-9247-8ad07c63131e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:31.423011 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77b9e5fd-b936-4b46-9247-8ad07c63131e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:31.423518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77b9e5fd-b936-4b46-9247-8ad07c63131e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:31.424377 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77b9e5fd-b936-4b46-9247-8ad07c63131e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:31.424855 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77b9e5fd-b936-4b46-9247-8ad07c63131e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:31.456497 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-77b9e5fd-b936-4b46-9247-8ad07c63131e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045545 Apr 06 16:42:31.457128 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 306/592] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:31 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:31.536246 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f02408d1-d63b-4300-9c0c-eccd7f6278c5 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:31.543737 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f02408d1-d63b-4300-9c0c-eccd7f6278c5 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.164559 Apr 06 16:42:31.544314 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 287/593] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:31 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:32.209498 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7f93f4cf-aaca-43ec-b338-89bbec04cbdf tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:32.210128 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7f93f4cf-aaca-43ec-b338-89bbec04cbdf tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:32.217337 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f93f4cf-aaca-43ec-b338-89bbec04cbdf tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:32.218153 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f93f4cf-aaca-43ec-b338-89bbec04cbdf tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:32.218992 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f93f4cf-aaca-43ec-b338-89bbec04cbdf tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:32.219422 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7f93f4cf-aaca-43ec-b338-89bbec04cbdf tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:32.363796 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7f93f4cf-aaca-43ec-b338-89bbec04cbdf tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:32.372051 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7f93f4cf-aaca-43ec-b338-89bbec04cbdf tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.166643 Apr 06 16:42:32.372638 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 307/594] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:32 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:32.468452 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6f61a894-2034-4a70-8fb2-9221f0bf61b2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:32.469335 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6f61a894-2034-4a70-8fb2-9221f0bf61b2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:32.476213 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f61a894-2034-4a70-8fb2-9221f0bf61b2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:32.476835 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f61a894-2034-4a70-8fb2-9221f0bf61b2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:32.477629 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f61a894-2034-4a70-8fb2-9221f0bf61b2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:32.478062 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f61a894-2034-4a70-8fb2-9221f0bf61b2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:32.509486 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6f61a894-2034-4a70-8fb2-9221f0bf61b2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045436 Apr 06 16:42:32.510076 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 288/595] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:32 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:32.563914 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-63ac396e-edb9-4a59-954f-ad00d436128b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:32.564887 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-63ac396e-edb9-4a59-954f-ad00d436128b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:32.574764 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63ac396e-edb9-4a59-954f-ad00d436128b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:32.575345 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63ac396e-edb9-4a59-954f-ad00d436128b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:32.576499 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63ac396e-edb9-4a59-954f-ad00d436128b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:32.577065 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63ac396e-edb9-4a59-954f-ad00d436128b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:32.731321 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-63ac396e-edb9-4a59-954f-ad00d436128b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:32.740524 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-63ac396e-edb9-4a59-954f-ad00d436128b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.183058 Apr 06 16:42:32.741144 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 308/596] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:32 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:33.390078 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-76b3b779-4e7c-4cbe-a537-a9d21125a852 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:33.390949 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-76b3b779-4e7c-4cbe-a537-a9d21125a852 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:33.397633 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76b3b779-4e7c-4cbe-a537-a9d21125a852 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:33.398087 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76b3b779-4e7c-4cbe-a537-a9d21125a852 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:33.398898 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76b3b779-4e7c-4cbe-a537-a9d21125a852 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:33.399313 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76b3b779-4e7c-4cbe-a537-a9d21125a852 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:33.521824 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9d38b42f-eb61-4f5a-b1a9-bbc191710929 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:33.522768 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9d38b42f-eb61-4f5a-b1a9-bbc191710929 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:33.529302 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d38b42f-eb61-4f5a-b1a9-bbc191710929 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:33.529746 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d38b42f-eb61-4f5a-b1a9-bbc191710929 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:33.530672 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d38b42f-eb61-4f5a-b1a9-bbc191710929 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:33.531277 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d38b42f-eb61-4f5a-b1a9-bbc191710929 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:33.558398 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-76b3b779-4e7c-4cbe-a537-a9d21125a852 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:33.563066 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9d38b42f-eb61-4f5a-b1a9-bbc191710929 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045202 Apr 06 16:42:33.563934 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 309/597] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:33 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:33.567008 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-76b3b779-4e7c-4cbe-a537-a9d21125a852 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.181029 Apr 06 16:42:33.567556 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 289/598] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:33 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:33.757670 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7a513132-2575-4871-ae2a-9ae612407b43 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:33.758432 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7a513132-2575-4871-ae2a-9ae612407b43 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:33.764050 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a513132-2575-4871-ae2a-9ae612407b43 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:33.764489 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a513132-2575-4871-ae2a-9ae612407b43 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:33.765424 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a513132-2575-4871-ae2a-9ae612407b43 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:33.765847 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a513132-2575-4871-ae2a-9ae612407b43 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:33.909044 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7a513132-2575-4871-ae2a-9ae612407b43 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:33.916818 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7a513132-2575-4871-ae2a-9ae612407b43 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.162915 Apr 06 16:42:33.917388 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 310/599] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:33 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:34.575268 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-14f611a1-6389-4851-b0e2-80096b2c2e35 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:34.576101 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-14f611a1-6389-4851-b0e2-80096b2c2e35 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:34.583381 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14f611a1-6389-4851-b0e2-80096b2c2e35 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:34.583591 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5933f65f-e92f-4465-ae0d-c221b7d39752 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:34.583823 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14f611a1-6389-4851-b0e2-80096b2c2e35 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:34.584018 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5933f65f-e92f-4465-ae0d-c221b7d39752 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:34.584595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14f611a1-6389-4851-b0e2-80096b2c2e35 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:34.585064 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14f611a1-6389-4851-b0e2-80096b2c2e35 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:34.590734 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5933f65f-e92f-4465-ae0d-c221b7d39752 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:34.591184 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5933f65f-e92f-4465-ae0d-c221b7d39752 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:34.591965 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5933f65f-e92f-4465-ae0d-c221b7d39752 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:34.592445 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5933f65f-e92f-4465-ae0d-c221b7d39752 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:34.616447 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-14f611a1-6389-4851-b0e2-80096b2c2e35 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045229 Apr 06 16:42:34.617065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 290/600] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:34 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:34.739044 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5933f65f-e92f-4465-ae0d-c221b7d39752 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:34.749828 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5933f65f-e92f-4465-ae0d-c221b7d39752 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.169754 Apr 06 16:42:34.750555 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 311/601] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:34 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:34.934927 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2614b922-9c79-47ab-8138-c1beaaf19189 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:34.935536 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2614b922-9c79-47ab-8138-c1beaaf19189 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:34.942747 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2614b922-9c79-47ab-8138-c1beaaf19189 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:34.943206 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2614b922-9c79-47ab-8138-c1beaaf19189 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:34.944013 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2614b922-9c79-47ab-8138-c1beaaf19189 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:34.944450 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2614b922-9c79-47ab-8138-c1beaaf19189 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:35.092302 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2614b922-9c79-47ab-8138-c1beaaf19189 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:35.100037 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2614b922-9c79-47ab-8138-c1beaaf19189 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.169060 Apr 06 16:42:35.100610 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 291/602] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:34 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:35.629612 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-40c0d2e3-cd74-48da-b70b-1cb40ca4a8ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:35.630569 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-40c0d2e3-cd74-48da-b70b-1cb40ca4a8ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:35.637255 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40c0d2e3-cd74-48da-b70b-1cb40ca4a8ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:35.637698 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40c0d2e3-cd74-48da-b70b-1cb40ca4a8ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:35.638472 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40c0d2e3-cd74-48da-b70b-1cb40ca4a8ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:35.638897 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40c0d2e3-cd74-48da-b70b-1cb40ca4a8ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:35.676070 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-40c0d2e3-cd74-48da-b70b-1cb40ca4a8ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050798 Apr 06 16:42:35.676629 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 312/603] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:35 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:35.769165 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4ef2df90-5846-4b08-8c85-0725deada07c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:35.769796 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4ef2df90-5846-4b08-8c85-0725deada07c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:35.776601 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ef2df90-5846-4b08-8c85-0725deada07c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:35.777078 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ef2df90-5846-4b08-8c85-0725deada07c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:35.777850 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ef2df90-5846-4b08-8c85-0725deada07c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:35.778277 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ef2df90-5846-4b08-8c85-0725deada07c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:35.922257 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4ef2df90-5846-4b08-8c85-0725deada07c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:35.930125 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4ef2df90-5846-4b08-8c85-0725deada07c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.164962 Apr 06 16:42:35.930705 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 292/604] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:35 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:36.117248 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fdd3a264-0792-4982-86d0-a9ba0721f051 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:36.118221 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fdd3a264-0792-4982-86d0-a9ba0721f051 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:36.125732 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdd3a264-0792-4982-86d0-a9ba0721f051 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:36.126289 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdd3a264-0792-4982-86d0-a9ba0721f051 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:36.127076 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdd3a264-0792-4982-86d0-a9ba0721f051 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:36.127494 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdd3a264-0792-4982-86d0-a9ba0721f051 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:36.268741 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fdd3a264-0792-4982-86d0-a9ba0721f051 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:36.276531 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fdd3a264-0792-4982-86d0-a9ba0721f051 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.163261 Apr 06 16:42:36.277161 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 313/605] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:36 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:36.688120 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cb73ecf6-95df-4da8-94b5-d9e0168b816a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:36.689092 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cb73ecf6-95df-4da8-94b5-d9e0168b816a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:36.695625 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb73ecf6-95df-4da8-94b5-d9e0168b816a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:36.696071 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb73ecf6-95df-4da8-94b5-d9e0168b816a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:36.696865 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb73ecf6-95df-4da8-94b5-d9e0168b816a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:36.697293 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb73ecf6-95df-4da8-94b5-d9e0168b816a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:36.727987 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cb73ecf6-95df-4da8-94b5-d9e0168b816a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043957 Apr 06 16:42:36.728570 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 293/606] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:36 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:36.947499 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e7529e1b-587b-48bb-8afb-822e8078e60f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:36.948055 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e7529e1b-587b-48bb-8afb-822e8078e60f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:36.954406 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7529e1b-587b-48bb-8afb-822e8078e60f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:36.954855 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7529e1b-587b-48bb-8afb-822e8078e60f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:36.955624 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7529e1b-587b-48bb-8afb-822e8078e60f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:36.956055 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7529e1b-587b-48bb-8afb-822e8078e60f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:37.098330 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e7529e1b-587b-48bb-8afb-822e8078e60f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:37.106370 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e7529e1b-587b-48bb-8afb-822e8078e60f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.162822 Apr 06 16:42:37.106950 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 314/607] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:36 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:37.293962 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2cc94dd1-5454-4f20-8be0-622c29aeaf2d tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:37.294547 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2cc94dd1-5454-4f20-8be0-622c29aeaf2d tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:37.301505 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cc94dd1-5454-4f20-8be0-622c29aeaf2d tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:37.301950 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cc94dd1-5454-4f20-8be0-622c29aeaf2d tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:37.302718 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cc94dd1-5454-4f20-8be0-622c29aeaf2d tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:37.303151 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cc94dd1-5454-4f20-8be0-622c29aeaf2d tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:37.448113 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2cc94dd1-5454-4f20-8be0-622c29aeaf2d tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:37.456343 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2cc94dd1-5454-4f20-8be0-622c29aeaf2d tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.166327 Apr 06 16:42:37.456979 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 294/608] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:37 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:37.740885 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-91b699b1-5572-43bc-8caa-ce71179adf03 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:37.741801 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-91b699b1-5572-43bc-8caa-ce71179adf03 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:37.748728 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91b699b1-5572-43bc-8caa-ce71179adf03 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:37.749192 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91b699b1-5572-43bc-8caa-ce71179adf03 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:37.749942 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91b699b1-5572-43bc-8caa-ce71179adf03 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:37.750369 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-91b699b1-5572-43bc-8caa-ce71179adf03 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:37.786581 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-91b699b1-5572-43bc-8caa-ce71179adf03 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049721 Apr 06 16:42:37.787164 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 315/609] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:37 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:38.124883 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1649cc1f-2953-4cfc-95c0-525fffbab521 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:38.125485 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1649cc1f-2953-4cfc-95c0-525fffbab521 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:38.131814 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1649cc1f-2953-4cfc-95c0-525fffbab521 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:38.132260 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1649cc1f-2953-4cfc-95c0-525fffbab521 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:38.133062 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1649cc1f-2953-4cfc-95c0-525fffbab521 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:38.133490 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1649cc1f-2953-4cfc-95c0-525fffbab521 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:38.278825 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1649cc1f-2953-4cfc-95c0-525fffbab521 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:38.288296 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1649cc1f-2953-4cfc-95c0-525fffbab521 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.167361 Apr 06 16:42:38.288883 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 295/610] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:38 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:42:38.474490 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3c983c87-575a-411f-8717-075f201f1162 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:38.475076 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3c983c87-575a-411f-8717-075f201f1162 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:38.482623 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c983c87-575a-411f-8717-075f201f1162 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:38.483098 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c983c87-575a-411f-8717-075f201f1162 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:38.484352 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c983c87-575a-411f-8717-075f201f1162 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:38.490412 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c983c87-575a-411f-8717-075f201f1162 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:38.633992 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3c983c87-575a-411f-8717-075f201f1162 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:38.645042 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3c983c87-575a-411f-8717-075f201f1162 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.174546 Apr 06 16:42:38.645625 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 316/611] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:38 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:38.799527 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1c9d2195-21e8-4fa9-a56b-87504fe39067 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:38.800485 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1c9d2195-21e8-4fa9-a56b-87504fe39067 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:38.807325 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c9d2195-21e8-4fa9-a56b-87504fe39067 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:38.807800 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c9d2195-21e8-4fa9-a56b-87504fe39067 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:38.808561 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c9d2195-21e8-4fa9-a56b-87504fe39067 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:38.809183 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c9d2195-21e8-4fa9-a56b-87504fe39067 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:38.843418 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1c9d2195-21e8-4fa9-a56b-87504fe39067 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048155 Apr 06 16:42:38.844276 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 296/612] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:38 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:39.307906 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-56cef017-d898-4336-aa33-068b7d7518ac tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:39.308819 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-56cef017-d898-4336-aa33-068b7d7518ac tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:39.317322 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56cef017-d898-4336-aa33-068b7d7518ac tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:39.318401 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56cef017-d898-4336-aa33-068b7d7518ac tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:39.319792 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56cef017-d898-4336-aa33-068b7d7518ac tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:39.321188 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56cef017-d898-4336-aa33-068b7d7518ac tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:39.472833 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-56cef017-d898-4336-aa33-068b7d7518ac tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:39.480483 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-56cef017-d898-4336-aa33-068b7d7518ac tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.176584 Apr 06 16:42:39.481176 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 317/613] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:39 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:39.663546 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-53bf1ab9-f469-4eb4-872a-df9e86b86dc6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:39.664070 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-53bf1ab9-f469-4eb4-872a-df9e86b86dc6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:39.671984 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53bf1ab9-f469-4eb4-872a-df9e86b86dc6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:39.672435 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53bf1ab9-f469-4eb4-872a-df9e86b86dc6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:39.673457 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53bf1ab9-f469-4eb4-872a-df9e86b86dc6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:39.673904 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53bf1ab9-f469-4eb4-872a-df9e86b86dc6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:39.819254 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-53bf1ab9-f469-4eb4-872a-df9e86b86dc6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:39.827999 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-53bf1ab9-f469-4eb4-872a-df9e86b86dc6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.168246 Apr 06 16:42:39.828896 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 297/614] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:39 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:39.855717 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5248cef7-25e4-408d-8919-d318fcccce5c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:39.856621 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5248cef7-25e4-408d-8919-d318fcccce5c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:39.863437 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5248cef7-25e4-408d-8919-d318fcccce5c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:39.863886 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5248cef7-25e4-408d-8919-d318fcccce5c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:39.864662 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5248cef7-25e4-408d-8919-d318fcccce5c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:39.865128 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5248cef7-25e4-408d-8919-d318fcccce5c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:39.896089 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5248cef7-25e4-408d-8919-d318fcccce5c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044309 Apr 06 16:42:39.896643 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 318/615] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:39 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:40.083085 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-949c2637-043a-4293-aae0-64846c6b9b04 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:40.083484 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-949c2637-043a-4293-aae0-64846c6b9b04 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:40.090226 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-949c2637-043a-4293-aae0-64846c6b9b04 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:40.090675 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-949c2637-043a-4293-aae0-64846c6b9b04 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:40.091455 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-949c2637-043a-4293-aae0-64846c6b9b04 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:40.091890 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-949c2637-043a-4293-aae0-64846c6b9b04 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:40.126845 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-949c2637-043a-4293-aae0-64846c6b9b04 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments/9410269a-3541-47f1-938f-5b827c7e11ae" status: 200 len: 194 microversion: 2.20 time: 0.048742 Apr 06 16:42:40.127461 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 298/616] 10.222.0.64 () {60 vars in 1453 bytes} [Wed Apr 6 16:42:40 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments/9410269a-3541-47f1-938f-5b827c7e11ae => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:42:40.190254 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7bdcad63-1059-43b8-8083-8aee2631d142 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:40.190737 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7bdcad63-1059-43b8-8083-8aee2631d142 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:40.197315 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bdcad63-1059-43b8-8083-8aee2631d142 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:40.197754 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bdcad63-1059-43b8-8083-8aee2631d142 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:40.198518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bdcad63-1059-43b8-8083-8aee2631d142 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:40.198947 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bdcad63-1059-43b8-8083-8aee2631d142 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:40.283405 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-7bdcad63-1059-43b8-8083-8aee2631d142 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lazy-loading 'services' on Instance uuid 330d17b1-0d7d-4519-8dc3-3210eb25aa3c {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 06 16:42:40.359819 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7bdcad63-1059-43b8-8083-8aee2631d142 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "DELETE /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments/9410269a-3541-47f1-938f-5b827c7e11ae" status: 202 len: 0 microversion: 2.20 time: 0.173463 Apr 06 16:42:40.360467 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 319/617] 10.222.0.64 () {60 vars in 1456 bytes} [Wed Apr 6 16:42:40 2022] DELETE /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments/9410269a-3541-47f1-938f-5b827c7e11ae => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 06 16:42:40.369699 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d1c0ef10-be42-4e19-8473-0d8b97024a83 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:40.370705 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d1c0ef10-be42-4e19-8473-0d8b97024a83 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:40.377388 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1c0ef10-be42-4e19-8473-0d8b97024a83 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:40.377847 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1c0ef10-be42-4e19-8473-0d8b97024a83 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:40.378626 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1c0ef10-be42-4e19-8473-0d8b97024a83 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:40.379061 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1c0ef10-be42-4e19-8473-0d8b97024a83 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:40.408339 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d1c0ef10-be42-4e19-8473-0d8b97024a83 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043101 Apr 06 16:42:40.408978 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 299/618] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:42:40 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:42:40.502210 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0797ab7f-6eb9-4f2f-b916-4a2634e0e738 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:40.503057 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0797ab7f-6eb9-4f2f-b916-4a2634e0e738 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:40.509944 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0797ab7f-6eb9-4f2f-b916-4a2634e0e738 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:40.510380 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0797ab7f-6eb9-4f2f-b916-4a2634e0e738 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:40.511147 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0797ab7f-6eb9-4f2f-b916-4a2634e0e738 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:40.511570 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0797ab7f-6eb9-4f2f-b916-4a2634e0e738 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:40.655537 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0797ab7f-6eb9-4f2f-b916-4a2634e0e738 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:40.663251 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0797ab7f-6eb9-4f2f-b916-4a2634e0e738 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.165421 Apr 06 16:42:40.663827 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 320/619] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:40 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:40.846448 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0cbda74c-4c8b-4786-a44b-2c2784f07618 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:40.847070 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0cbda74c-4c8b-4786-a44b-2c2784f07618 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:40.854213 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0cbda74c-4c8b-4786-a44b-2c2784f07618 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:40.854591 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0cbda74c-4c8b-4786-a44b-2c2784f07618 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:40.855372 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0cbda74c-4c8b-4786-a44b-2c2784f07618 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:40.855808 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0cbda74c-4c8b-4786-a44b-2c2784f07618 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:40.908542 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-50f06d51-ea50-4a25-a9c0-4e32cabfa52a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:40.909552 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-50f06d51-ea50-4a25-a9c0-4e32cabfa52a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:40.916112 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50f06d51-ea50-4a25-a9c0-4e32cabfa52a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:40.916563 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50f06d51-ea50-4a25-a9c0-4e32cabfa52a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:40.917427 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50f06d51-ea50-4a25-a9c0-4e32cabfa52a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:40.917859 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50f06d51-ea50-4a25-a9c0-4e32cabfa52a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:40.948836 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-50f06d51-ea50-4a25-a9c0-4e32cabfa52a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044563 Apr 06 16:42:40.949435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 321/620] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:40 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:40.996368 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0cbda74c-4c8b-4786-a44b-2c2784f07618 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:41.005744 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0cbda74c-4c8b-4786-a44b-2c2784f07618 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.163171 Apr 06 16:42:41.006316 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 300/621] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:40 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:41.420362 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-802d3754-c93c-4207-bd38-b0e7c9ad109d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:41.421518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-802d3754-c93c-4207-bd38-b0e7c9ad109d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:41.428191 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-802d3754-c93c-4207-bd38-b0e7c9ad109d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:41.428638 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-802d3754-c93c-4207-bd38-b0e7c9ad109d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:41.429464 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-802d3754-c93c-4207-bd38-b0e7c9ad109d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:41.429865 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-802d3754-c93c-4207-bd38-b0e7c9ad109d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:41.462401 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-802d3754-c93c-4207-bd38-b0e7c9ad109d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046158 Apr 06 16:42:41.462989 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 322/622] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:42:41 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:42:41.682171 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-31095992-23b2-4f69-9ff6-2422d4086894 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:41.682684 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-31095992-23b2-4f69-9ff6-2422d4086894 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:41.690688 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31095992-23b2-4f69-9ff6-2422d4086894 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:41.691185 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31095992-23b2-4f69-9ff6-2422d4086894 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:41.692263 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31095992-23b2-4f69-9ff6-2422d4086894 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:41.692728 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31095992-23b2-4f69-9ff6-2422d4086894 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:41.840002 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-31095992-23b2-4f69-9ff6-2422d4086894 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:41.848181 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-31095992-23b2-4f69-9ff6-2422d4086894 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.170045 Apr 06 16:42:41.848907 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 301/623] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:41 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:41.960064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fce2606e-2564-4d14-89d2-0f957d170ed5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:41.960937 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fce2606e-2564-4d14-89d2-0f957d170ed5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:41.967661 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fce2606e-2564-4d14-89d2-0f957d170ed5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:41.968928 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fce2606e-2564-4d14-89d2-0f957d170ed5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:41.969248 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fce2606e-2564-4d14-89d2-0f957d170ed5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:41.969706 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fce2606e-2564-4d14-89d2-0f957d170ed5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:42.000677 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fce2606e-2564-4d14-89d2-0f957d170ed5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044645 Apr 06 16:42:42.001284 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 323/624] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:41 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:42.024788 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b072079e-7ab2-4cc7-96bb-a8db1d6e4d9e tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:42.025404 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b072079e-7ab2-4cc7-96bb-a8db1d6e4d9e tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:42.032140 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b072079e-7ab2-4cc7-96bb-a8db1d6e4d9e tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:42.032600 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b072079e-7ab2-4cc7-96bb-a8db1d6e4d9e tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:42.033429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b072079e-7ab2-4cc7-96bb-a8db1d6e4d9e tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:42.033867 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b072079e-7ab2-4cc7-96bb-a8db1d6e4d9e tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:42.184253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b072079e-7ab2-4cc7-96bb-a8db1d6e4d9e tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:42.192617 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b072079e-7ab2-4cc7-96bb-a8db1d6e4d9e tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.171725 Apr 06 16:42:42.193240 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 302/625] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:42 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:42.475075 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b35f59a3-b2f1-4033-b8c5-cdc19a35f058 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:42.475908 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b35f59a3-b2f1-4033-b8c5-cdc19a35f058 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:42.486481 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b35f59a3-b2f1-4033-b8c5-cdc19a35f058 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:42.486933 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b35f59a3-b2f1-4033-b8c5-cdc19a35f058 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:42.487712 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b35f59a3-b2f1-4033-b8c5-cdc19a35f058 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:42.488148 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b35f59a3-b2f1-4033-b8c5-cdc19a35f058 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:42.519232 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b35f59a3-b2f1-4033-b8c5-cdc19a35f058 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048329 Apr 06 16:42:42.519847 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 324/626] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:42:42 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:42:42.868914 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c556df05-154b-465c-b7bb-334b355d823f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:42.869517 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c556df05-154b-465c-b7bb-334b355d823f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:42.876569 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c556df05-154b-465c-b7bb-334b355d823f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:42.877065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c556df05-154b-465c-b7bb-334b355d823f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:42.877852 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c556df05-154b-465c-b7bb-334b355d823f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:42.878286 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c556df05-154b-465c-b7bb-334b355d823f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:43.013417 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b9287eb7-5aed-4ef8-b43c-f3c6737c526f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:43.014349 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b9287eb7-5aed-4ef8-b43c-f3c6737c526f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:43.020996 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9287eb7-5aed-4ef8-b43c-f3c6737c526f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:43.021448 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9287eb7-5aed-4ef8-b43c-f3c6737c526f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:43.022200 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9287eb7-5aed-4ef8-b43c-f3c6737c526f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:43.022390 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c556df05-154b-465c-b7bb-334b355d823f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:43.022605 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9287eb7-5aed-4ef8-b43c-f3c6737c526f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:43.030467 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c556df05-154b-465c-b7bb-334b355d823f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.167058 Apr 06 16:42:43.031117 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 303/627] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:42 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:43.053333 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b9287eb7-5aed-4ef8-b43c-f3c6737c526f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044099 Apr 06 16:42:43.053914 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 325/628] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:43 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:43.214249 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fa7d06eb-90d3-43a1-95a3-d5636ac6d1d0 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:43.214927 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fa7d06eb-90d3-43a1-95a3-d5636ac6d1d0 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:43.225085 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa7d06eb-90d3-43a1-95a3-d5636ac6d1d0 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:43.225738 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa7d06eb-90d3-43a1-95a3-d5636ac6d1d0 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:43.226924 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa7d06eb-90d3-43a1-95a3-d5636ac6d1d0 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:43.227573 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa7d06eb-90d3-43a1-95a3-d5636ac6d1d0 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:43.390405 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fa7d06eb-90d3-43a1-95a3-d5636ac6d1d0 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:43.398130 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fa7d06eb-90d3-43a1-95a3-d5636ac6d1d0 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.190123 Apr 06 16:42:43.398677 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 304/629] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:43 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:43.531565 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e4316ba3-054b-4b00-a144-6ba4c3977940 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:43.532418 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e4316ba3-054b-4b00-a144-6ba4c3977940 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:43.539036 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4316ba3-054b-4b00-a144-6ba4c3977940 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:43.539542 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4316ba3-054b-4b00-a144-6ba4c3977940 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:43.540298 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4316ba3-054b-4b00-a144-6ba4c3977940 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:43.540729 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4316ba3-054b-4b00-a144-6ba4c3977940 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:43.574151 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e4316ba3-054b-4b00-a144-6ba4c3977940 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047472 Apr 06 16:42:43.574742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 326/630] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:42:43 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:42:44.048610 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-10b6061f-f21f-4bd1-8133-e8706606b261 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:44.049573 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-10b6061f-f21f-4bd1-8133-e8706606b261 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:44.059386 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10b6061f-f21f-4bd1-8133-e8706606b261 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:44.060143 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10b6061f-f21f-4bd1-8133-e8706606b261 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:44.061674 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10b6061f-f21f-4bd1-8133-e8706606b261 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:44.062485 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10b6061f-f21f-4bd1-8133-e8706606b261 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:44.069293 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5b823903-d47b-4adf-94c7-4588557ec964 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:44.070969 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5b823903-d47b-4adf-94c7-4588557ec964 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:44.079797 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b823903-d47b-4adf-94c7-4588557ec964 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:44.080246 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b823903-d47b-4adf-94c7-4588557ec964 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:44.081064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b823903-d47b-4adf-94c7-4588557ec964 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:44.081496 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b823903-d47b-4adf-94c7-4588557ec964 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:44.114505 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5b823903-d47b-4adf-94c7-4588557ec964 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052042 Apr 06 16:42:44.115399 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 327/631] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:44 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:44.209323 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-10b6061f-f21f-4bd1-8133-e8706606b261 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:44.217097 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-10b6061f-f21f-4bd1-8133-e8706606b261 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.173354 Apr 06 16:42:44.217751 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 305/632] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:44 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:44.415730 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ab79282b-2466-4e7f-b04e-114909f708f8 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:44.416358 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ab79282b-2466-4e7f-b04e-114909f708f8 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:44.423153 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab79282b-2466-4e7f-b04e-114909f708f8 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:44.423632 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab79282b-2466-4e7f-b04e-114909f708f8 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:44.424412 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab79282b-2466-4e7f-b04e-114909f708f8 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:44.424887 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab79282b-2466-4e7f-b04e-114909f708f8 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:44.574817 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ab79282b-2466-4e7f-b04e-114909f708f8 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:44.583765 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ab79282b-2466-4e7f-b04e-114909f708f8 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.171792 Apr 06 16:42:44.584257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 328/633] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:44 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:44.585549 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-71471322-0895-4911-a380-f98db2cd9ac5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:44.587771 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-71471322-0895-4911-a380-f98db2cd9ac5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:44.593118 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71471322-0895-4911-a380-f98db2cd9ac5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:44.593573 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71471322-0895-4911-a380-f98db2cd9ac5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:44.594362 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71471322-0895-4911-a380-f98db2cd9ac5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:44.594791 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71471322-0895-4911-a380-f98db2cd9ac5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:44.628770 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-71471322-0895-4911-a380-f98db2cd9ac5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047153 Apr 06 16:42:44.629343 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 306/634] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:42:44 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 06 16:42:45.128187 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a6589f3f-8a48-476c-9a6a-29bbfa2c27d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:45.129835 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a6589f3f-8a48-476c-9a6a-29bbfa2c27d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:45.139612 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6589f3f-8a48-476c-9a6a-29bbfa2c27d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:45.140311 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6589f3f-8a48-476c-9a6a-29bbfa2c27d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:45.141198 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6589f3f-8a48-476c-9a6a-29bbfa2c27d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:45.141629 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6589f3f-8a48-476c-9a6a-29bbfa2c27d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:45.177138 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a6589f3f-8a48-476c-9a6a-29bbfa2c27d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053930 Apr 06 16:42:45.177725 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 329/635] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:45 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:45.236342 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dd15fd77-492a-4c2b-b7cd-b71bb6f15ab4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:45.237007 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dd15fd77-492a-4c2b-b7cd-b71bb6f15ab4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:45.245111 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd15fd77-492a-4c2b-b7cd-b71bb6f15ab4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:45.245559 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd15fd77-492a-4c2b-b7cd-b71bb6f15ab4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:45.246342 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd15fd77-492a-4c2b-b7cd-b71bb6f15ab4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:45.246773 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd15fd77-492a-4c2b-b7cd-b71bb6f15ab4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:45.400597 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-dd15fd77-492a-4c2b-b7cd-b71bb6f15ab4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:45.408461 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dd15fd77-492a-4c2b-b7cd-b71bb6f15ab4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.177314 Apr 06 16:42:45.409086 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 307/636] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:45 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:45.601581 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-047c38b7-f561-4002-997e-6f530918a345 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:45.602176 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-047c38b7-f561-4002-997e-6f530918a345 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:45.609104 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-047c38b7-f561-4002-997e-6f530918a345 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:45.609555 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-047c38b7-f561-4002-997e-6f530918a345 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:45.610371 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-047c38b7-f561-4002-997e-6f530918a345 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:45.610805 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-047c38b7-f561-4002-997e-6f530918a345 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:45.640747 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-31b4d732-9e9f-4ea3-857c-665095d2f686 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:45.641565 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-31b4d732-9e9f-4ea3-857c-665095d2f686 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:45.648442 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31b4d732-9e9f-4ea3-857c-665095d2f686 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:45.648916 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31b4d732-9e9f-4ea3-857c-665095d2f686 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:45.649706 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31b4d732-9e9f-4ea3-857c-665095d2f686 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:45.650158 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31b4d732-9e9f-4ea3-857c-665095d2f686 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:45.685128 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-31b4d732-9e9f-4ea3-857c-665095d2f686 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048514 Apr 06 16:42:45.685728 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 308/637] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:42:45 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:42:45.759640 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-047c38b7-f561-4002-997e-6f530918a345 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:45.769372 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-047c38b7-f561-4002-997e-6f530918a345 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.171020 Apr 06 16:42:45.770811 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 330/638] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:45 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:46.189817 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bb3a999c-6e6d-4790-aea5-49f788f3d690 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:46.191200 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bb3a999c-6e6d-4790-aea5-49f788f3d690 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:46.200443 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb3a999c-6e6d-4790-aea5-49f788f3d690 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:46.201196 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb3a999c-6e6d-4790-aea5-49f788f3d690 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:46.202255 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb3a999c-6e6d-4790-aea5-49f788f3d690 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:46.202916 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb3a999c-6e6d-4790-aea5-49f788f3d690 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:46.234400 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bb3a999c-6e6d-4790-aea5-49f788f3d690 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048934 Apr 06 16:42:46.234957 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 309/639] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:46 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:46.426424 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-79534507-302b-438b-ae12-27fd5e3e6e1d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:46.427062 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-79534507-302b-438b-ae12-27fd5e3e6e1d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:46.433882 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79534507-302b-438b-ae12-27fd5e3e6e1d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:46.434329 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79534507-302b-438b-ae12-27fd5e3e6e1d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:46.435265 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79534507-302b-438b-ae12-27fd5e3e6e1d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:46.435984 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79534507-302b-438b-ae12-27fd5e3e6e1d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:46.579874 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-79534507-302b-438b-ae12-27fd5e3e6e1d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:46.587482 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-79534507-302b-438b-ae12-27fd5e3e6e1d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.165181 Apr 06 16:42:46.588065 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 331/640] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:46 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:46.698381 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d3783ddb-7200-4c30-965b-98cb526b73ba tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:46.699201 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d3783ddb-7200-4c30-965b-98cb526b73ba tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:46.705927 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3783ddb-7200-4c30-965b-98cb526b73ba tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:46.706398 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3783ddb-7200-4c30-965b-98cb526b73ba tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:46.707165 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3783ddb-7200-4c30-965b-98cb526b73ba tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:46.707584 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3783ddb-7200-4c30-965b-98cb526b73ba tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:46.736931 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d3783ddb-7200-4c30-965b-98cb526b73ba tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042564 Apr 06 16:42:46.737496 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 310/641] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:42:46 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:42:46.786647 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-117e24a1-b8e5-4ec9-acd5-09773645dfb4 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:46.787235 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-117e24a1-b8e5-4ec9-acd5-09773645dfb4 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:46.793667 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-117e24a1-b8e5-4ec9-acd5-09773645dfb4 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:46.794099 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-117e24a1-b8e5-4ec9-acd5-09773645dfb4 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:46.794853 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-117e24a1-b8e5-4ec9-acd5-09773645dfb4 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:46.795275 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-117e24a1-b8e5-4ec9-acd5-09773645dfb4 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:46.939538 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-117e24a1-b8e5-4ec9-acd5-09773645dfb4 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:46.947787 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-117e24a1-b8e5-4ec9-acd5-09773645dfb4 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.164996 Apr 06 16:42:46.948448 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 332/642] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:46 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:47.247338 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-136352fa-c4cf-4a6b-9aa1-295baa486ec9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:47.248211 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-136352fa-c4cf-4a6b-9aa1-295baa486ec9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:47.254944 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-136352fa-c4cf-4a6b-9aa1-295baa486ec9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:47.255393 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-136352fa-c4cf-4a6b-9aa1-295baa486ec9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:47.256174 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-136352fa-c4cf-4a6b-9aa1-295baa486ec9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:47.256615 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-136352fa-c4cf-4a6b-9aa1-295baa486ec9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:47.287744 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-136352fa-c4cf-4a6b-9aa1-295baa486ec9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044974 Apr 06 16:42:47.288325 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 311/643] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:47 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:47.606518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8a578fa8-cd10-4edf-ab19-b2ff3fc5f0c0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:47.607144 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8a578fa8-cd10-4edf-ab19-b2ff3fc5f0c0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:47.614078 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a578fa8-cd10-4edf-ab19-b2ff3fc5f0c0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:47.614529 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a578fa8-cd10-4edf-ab19-b2ff3fc5f0c0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:47.615307 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a578fa8-cd10-4edf-ab19-b2ff3fc5f0c0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:47.615742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a578fa8-cd10-4edf-ab19-b2ff3fc5f0c0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:47.749748 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-48195907-61e6-4a39-8ad8-e39fef1e5d5e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:47.750802 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-48195907-61e6-4a39-8ad8-e39fef1e5d5e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:47.757472 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48195907-61e6-4a39-8ad8-e39fef1e5d5e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:47.757916 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48195907-61e6-4a39-8ad8-e39fef1e5d5e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:47.758687 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48195907-61e6-4a39-8ad8-e39fef1e5d5e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:47.759114 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48195907-61e6-4a39-8ad8-e39fef1e5d5e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:47.769661 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8a578fa8-cd10-4edf-ab19-b2ff3fc5f0c0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:47.777607 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8a578fa8-cd10-4edf-ab19-b2ff3fc5f0c0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.174995 Apr 06 16:42:47.778197 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 333/644] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:47 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:47.792023 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-48195907-61e6-4a39-8ad8-e39fef1e5d5e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046577 Apr 06 16:42:47.792621 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 312/645] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:42:47 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 06 16:42:47.966420 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a12b2bb1-e248-4cf3-abfa-da07cfef3fc8 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:47.967021 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a12b2bb1-e248-4cf3-abfa-da07cfef3fc8 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:47.973795 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a12b2bb1-e248-4cf3-abfa-da07cfef3fc8 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:47.974228 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a12b2bb1-e248-4cf3-abfa-da07cfef3fc8 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:47.974994 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a12b2bb1-e248-4cf3-abfa-da07cfef3fc8 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:47.975417 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a12b2bb1-e248-4cf3-abfa-da07cfef3fc8 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:48.127159 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a12b2bb1-e248-4cf3-abfa-da07cfef3fc8 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:48.134900 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a12b2bb1-e248-4cf3-abfa-da07cfef3fc8 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.172511 Apr 06 16:42:48.135447 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 334/646] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:47 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:48.300195 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f111dba3-e923-41de-824e-add6801fe14a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:48.301189 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f111dba3-e923-41de-824e-add6801fe14a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:48.307916 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f111dba3-e923-41de-824e-add6801fe14a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:48.308387 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f111dba3-e923-41de-824e-add6801fe14a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:48.309211 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f111dba3-e923-41de-824e-add6801fe14a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:48.309646 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f111dba3-e923-41de-824e-add6801fe14a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:48.341684 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f111dba3-e923-41de-824e-add6801fe14a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045592 Apr 06 16:42:48.342255 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 313/647] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:48 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:48.795051 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-95b4031a-2aca-4955-a448-8028bdebb0e9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:48.795768 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-95b4031a-2aca-4955-a448-8028bdebb0e9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:48.803518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95b4031a-2aca-4955-a448-8028bdebb0e9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:48.803964 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95b4031a-2aca-4955-a448-8028bdebb0e9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:48.804772 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95b4031a-2aca-4955-a448-8028bdebb0e9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:48.805186 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95b4031a-2aca-4955-a448-8028bdebb0e9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:48.807021 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e512dcc3-3fe4-46d7-93fc-0aaac4fd3b28 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:48.808600 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e512dcc3-3fe4-46d7-93fc-0aaac4fd3b28 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:48.815455 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e512dcc3-3fe4-46d7-93fc-0aaac4fd3b28 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:48.815904 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e512dcc3-3fe4-46d7-93fc-0aaac4fd3b28 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:48.816706 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e512dcc3-3fe4-46d7-93fc-0aaac4fd3b28 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:48.817154 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e512dcc3-3fe4-46d7-93fc-0aaac4fd3b28 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:48.849882 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e512dcc3-3fe4-46d7-93fc-0aaac4fd3b28 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047681 Apr 06 16:42:48.850400 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 314/648] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:42:48 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:42:48.955586 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-95b4031a-2aca-4955-a448-8028bdebb0e9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:48.964151 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-95b4031a-2aca-4955-a448-8028bdebb0e9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.173117 Apr 06 16:42:48.964730 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 335/649] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:48 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:49.153329 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6cba52a0-96d8-4f46-a37b-c0064c48ab02 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:49.154295 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6cba52a0-96d8-4f46-a37b-c0064c48ab02 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:49.161607 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cba52a0-96d8-4f46-a37b-c0064c48ab02 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:49.162056 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cba52a0-96d8-4f46-a37b-c0064c48ab02 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:49.162841 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cba52a0-96d8-4f46-a37b-c0064c48ab02 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:49.163275 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cba52a0-96d8-4f46-a37b-c0064c48ab02 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:49.314734 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6cba52a0-96d8-4f46-a37b-c0064c48ab02 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:49.323178 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6cba52a0-96d8-4f46-a37b-c0064c48ab02 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.174212 Apr 06 16:42:49.323731 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 315/650] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:49 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:49.354090 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5db00452-8930-4e1d-bfad-b3f64a1d830e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:49.355015 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5db00452-8930-4e1d-bfad-b3f64a1d830e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:49.361424 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5db00452-8930-4e1d-bfad-b3f64a1d830e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:49.361867 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5db00452-8930-4e1d-bfad-b3f64a1d830e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:49.362649 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5db00452-8930-4e1d-bfad-b3f64a1d830e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:49.363076 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5db00452-8930-4e1d-bfad-b3f64a1d830e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:49.394548 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5db00452-8930-4e1d-bfad-b3f64a1d830e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044178 Apr 06 16:42:49.395595 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 336/651] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:49 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:42:49.861756 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-884104bd-d1be-467b-b91f-4d7fecd9e14e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:49.862734 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-884104bd-d1be-467b-b91f-4d7fecd9e14e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:49.870198 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-884104bd-d1be-467b-b91f-4d7fecd9e14e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:49.870651 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-884104bd-d1be-467b-b91f-4d7fecd9e14e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:49.871436 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-884104bd-d1be-467b-b91f-4d7fecd9e14e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:49.871869 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-884104bd-d1be-467b-b91f-4d7fecd9e14e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:49.902050 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-884104bd-d1be-467b-b91f-4d7fecd9e14e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044630 Apr 06 16:42:49.902606 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 316/652] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:42:49 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:42:49.982007 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3d1b4533-d52a-4ef2-995d-e62fffeeb54c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:49.982617 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3d1b4533-d52a-4ef2-995d-e62fffeeb54c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:49.989363 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d1b4533-d52a-4ef2-995d-e62fffeeb54c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:49.989804 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d1b4533-d52a-4ef2-995d-e62fffeeb54c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:49.990570 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d1b4533-d52a-4ef2-995d-e62fffeeb54c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:49.990994 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d1b4533-d52a-4ef2-995d-e62fffeeb54c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:50.137274 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3d1b4533-d52a-4ef2-995d-e62fffeeb54c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:50.145964 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3d1b4533-d52a-4ef2-995d-e62fffeeb54c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.167886 Apr 06 16:42:50.146525 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 337/653] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:49 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:50.341311 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-348802b8-d5e7-4e52-833f-c5f3d9b01cc4 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:50.341895 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-348802b8-d5e7-4e52-833f-c5f3d9b01cc4 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:50.348627 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-348802b8-d5e7-4e52-833f-c5f3d9b01cc4 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:50.349121 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-348802b8-d5e7-4e52-833f-c5f3d9b01cc4 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:50.350266 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-348802b8-d5e7-4e52-833f-c5f3d9b01cc4 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:50.350266 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-348802b8-d5e7-4e52-833f-c5f3d9b01cc4 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:50.407260 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7382cf54-00be-446d-9f08-e440f8728adb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:50.408161 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7382cf54-00be-446d-9f08-e440f8728adb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:50.414696 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7382cf54-00be-446d-9f08-e440f8728adb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:50.415135 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7382cf54-00be-446d-9f08-e440f8728adb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:50.416008 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7382cf54-00be-446d-9f08-e440f8728adb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:50.416621 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7382cf54-00be-446d-9f08-e440f8728adb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:50.447535 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7382cf54-00be-446d-9f08-e440f8728adb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044436 Apr 06 16:42:50.451543 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 338/654] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:50 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:42:50.497088 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-348802b8-d5e7-4e52-833f-c5f3d9b01cc4 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:50.504945 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-348802b8-d5e7-4e52-833f-c5f3d9b01cc4 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.167421 Apr 06 16:42:50.505523 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 317/655] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:50 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:50.914451 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1fa1f7bf-4c1b-4dfe-9cc9-a7c1a3cc2a70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:50.915397 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1fa1f7bf-4c1b-4dfe-9cc9-a7c1a3cc2a70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:50.922340 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1fa1f7bf-4c1b-4dfe-9cc9-a7c1a3cc2a70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:50.922708 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1fa1f7bf-4c1b-4dfe-9cc9-a7c1a3cc2a70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:50.923487 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1fa1f7bf-4c1b-4dfe-9cc9-a7c1a3cc2a70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:50.923923 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1fa1f7bf-4c1b-4dfe-9cc9-a7c1a3cc2a70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:50.954689 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1fa1f7bf-4c1b-4dfe-9cc9-a7c1a3cc2a70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044240 Apr 06 16:42:50.955239 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 339/656] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:42:50 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:42:51.163347 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-17787ba7-0e07-4c77-9dd9-d6e763df9053 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:51.164125 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-17787ba7-0e07-4c77-9dd9-d6e763df9053 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:51.172598 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17787ba7-0e07-4c77-9dd9-d6e763df9053 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:51.173206 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17787ba7-0e07-4c77-9dd9-d6e763df9053 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:51.174176 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17787ba7-0e07-4c77-9dd9-d6e763df9053 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:51.174607 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17787ba7-0e07-4c77-9dd9-d6e763df9053 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:51.326291 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-17787ba7-0e07-4c77-9dd9-d6e763df9053 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:51.334800 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-17787ba7-0e07-4c77-9dd9-d6e763df9053 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.175210 Apr 06 16:42:51.335387 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 318/657] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:51 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:51.460073 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0258f7a7-2374-46b6-8129-bd3381851923 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:51.461103 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0258f7a7-2374-46b6-8129-bd3381851923 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:51.467975 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0258f7a7-2374-46b6-8129-bd3381851923 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:51.468428 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0258f7a7-2374-46b6-8129-bd3381851923 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:51.469236 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0258f7a7-2374-46b6-8129-bd3381851923 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:51.469668 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0258f7a7-2374-46b6-8129-bd3381851923 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:51.501404 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0258f7a7-2374-46b6-8129-bd3381851923 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045331 Apr 06 16:42:51.501998 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 340/658] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:51 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:51.523420 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-23496140-ec36-4e33-b624-ea58cd49f653 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:51.524033 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-23496140-ec36-4e33-b624-ea58cd49f653 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:51.530749 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23496140-ec36-4e33-b624-ea58cd49f653 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:51.531425 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23496140-ec36-4e33-b624-ea58cd49f653 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:51.532215 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23496140-ec36-4e33-b624-ea58cd49f653 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:51.532657 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23496140-ec36-4e33-b624-ea58cd49f653 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:51.678816 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-23496140-ec36-4e33-b624-ea58cd49f653 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:51.686964 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-23496140-ec36-4e33-b624-ea58cd49f653 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.169131 Apr 06 16:42:51.687556 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 319/659] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:51 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:51.968746 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4f12220c-7715-4f8b-b530-10173a19e877 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:51.969688 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4f12220c-7715-4f8b-b530-10173a19e877 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:51.976474 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f12220c-7715-4f8b-b530-10173a19e877 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:51.977030 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f12220c-7715-4f8b-b530-10173a19e877 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:51.978265 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f12220c-7715-4f8b-b530-10173a19e877 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:51.978944 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f12220c-7715-4f8b-b530-10173a19e877 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:52.009622 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4f12220c-7715-4f8b-b530-10173a19e877 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046431 Apr 06 16:42:52.010199 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 341/660] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:42:51 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:42:52.351734 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-86459617-5033-4841-9e83-1d650f73aa57 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:52.352376 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-86459617-5033-4841-9e83-1d650f73aa57 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:52.359466 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86459617-5033-4841-9e83-1d650f73aa57 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:52.359930 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86459617-5033-4841-9e83-1d650f73aa57 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:52.360715 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86459617-5033-4841-9e83-1d650f73aa57 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:52.361196 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86459617-5033-4841-9e83-1d650f73aa57 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:52.508012 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-86459617-5033-4841-9e83-1d650f73aa57 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:52.513438 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b73a75ce-f605-4eab-8a23-3a3a037d222b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:52.514350 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b73a75ce-f605-4eab-8a23-3a3a037d222b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:52.517079 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-86459617-5033-4841-9e83-1d650f73aa57 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.169080 Apr 06 16:42:52.517998 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 320/661] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:52 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:52.522728 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b73a75ce-f605-4eab-8a23-3a3a037d222b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:52.523375 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b73a75ce-f605-4eab-8a23-3a3a037d222b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:52.524159 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b73a75ce-f605-4eab-8a23-3a3a037d222b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:52.524594 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b73a75ce-f605-4eab-8a23-3a3a037d222b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:52.554048 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b73a75ce-f605-4eab-8a23-3a3a037d222b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044459 Apr 06 16:42:52.554619 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 342/662] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:52 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:52.705258 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-658873a3-b17b-4461-a9a7-1f12d1c9567b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:52.705866 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-658873a3-b17b-4461-a9a7-1f12d1c9567b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:52.712504 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-658873a3-b17b-4461-a9a7-1f12d1c9567b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:52.713007 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-658873a3-b17b-4461-a9a7-1f12d1c9567b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:52.713790 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-658873a3-b17b-4461-a9a7-1f12d1c9567b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:52.714221 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-658873a3-b17b-4461-a9a7-1f12d1c9567b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:52.862498 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-658873a3-b17b-4461-a9a7-1f12d1c9567b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:52.870309 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-658873a3-b17b-4461-a9a7-1f12d1c9567b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.169660 Apr 06 16:42:52.870879 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 321/663] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:52 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:53.023195 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-db47ab47-8b27-46d8-b5cf-2d06eaf37fde tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:53.024373 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-db47ab47-8b27-46d8-b5cf-2d06eaf37fde tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:53.031223 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db47ab47-8b27-46d8-b5cf-2d06eaf37fde tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:53.031676 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db47ab47-8b27-46d8-b5cf-2d06eaf37fde tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:53.032627 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db47ab47-8b27-46d8-b5cf-2d06eaf37fde tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:53.033108 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db47ab47-8b27-46d8-b5cf-2d06eaf37fde tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:53.066364 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-db47ab47-8b27-46d8-b5cf-2d06eaf37fde tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048393 Apr 06 16:42:53.066944 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 343/664] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:42:53 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:42:53.538286 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dc2a3479-d4f7-4652-bafb-5959c49e8216 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:53.539226 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dc2a3479-d4f7-4652-bafb-5959c49e8216 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:53.548393 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc2a3479-d4f7-4652-bafb-5959c49e8216 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:53.549514 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc2a3479-d4f7-4652-bafb-5959c49e8216 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:53.550335 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc2a3479-d4f7-4652-bafb-5959c49e8216 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:53.550764 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc2a3479-d4f7-4652-bafb-5959c49e8216 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:53.566210 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d8b288d8-e4c8-4d7e-8fd6-b7e44f7e9f0e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:53.567350 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d8b288d8-e4c8-4d7e-8fd6-b7e44f7e9f0e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:53.575580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8b288d8-e4c8-4d7e-8fd6-b7e44f7e9f0e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:53.576027 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8b288d8-e4c8-4d7e-8fd6-b7e44f7e9f0e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:53.577029 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8b288d8-e4c8-4d7e-8fd6-b7e44f7e9f0e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:53.577467 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8b288d8-e4c8-4d7e-8fd6-b7e44f7e9f0e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:53.610041 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d8b288d8-e4c8-4d7e-8fd6-b7e44f7e9f0e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047671 Apr 06 16:42:53.610714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 344/665] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:53 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:53.693432 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-dc2a3479-d4f7-4652-bafb-5959c49e8216 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:53.704583 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dc2a3479-d4f7-4652-bafb-5959c49e8216 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.172421 Apr 06 16:42:53.705439 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 322/666] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:53 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:53.887604 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aaaa7026-bbf9-41ba-9f74-9e9c34f1782a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:53.888061 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aaaa7026-bbf9-41ba-9f74-9e9c34f1782a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:53.894599 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aaaa7026-bbf9-41ba-9f74-9e9c34f1782a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:53.895035 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aaaa7026-bbf9-41ba-9f74-9e9c34f1782a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:53.895976 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aaaa7026-bbf9-41ba-9f74-9e9c34f1782a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:53.896397 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aaaa7026-bbf9-41ba-9f74-9e9c34f1782a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:54.038828 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-aaaa7026-bbf9-41ba-9f74-9e9c34f1782a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:54.047394 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aaaa7026-bbf9-41ba-9f74-9e9c34f1782a tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.163675 Apr 06 16:42:54.048003 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 345/667] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:53 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:54.078764 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1c433ab9-7206-4e4c-bfb4-afb49fea0c12 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:54.079692 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1c433ab9-7206-4e4c-bfb4-afb49fea0c12 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:54.085940 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c433ab9-7206-4e4c-bfb4-afb49fea0c12 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:54.086393 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c433ab9-7206-4e4c-bfb4-afb49fea0c12 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:54.087202 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c433ab9-7206-4e4c-bfb4-afb49fea0c12 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:54.087633 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c433ab9-7206-4e4c-bfb4-afb49fea0c12 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:54.119344 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1c433ab9-7206-4e4c-bfb4-afb49fea0c12 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044763 Apr 06 16:42:54.119860 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 323/668] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:42:54 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:42:54.622577 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ee4dff7f-f65d-4bcb-88e6-9de4f3a00e08 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:54.623524 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ee4dff7f-f65d-4bcb-88e6-9de4f3a00e08 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:54.630502 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee4dff7f-f65d-4bcb-88e6-9de4f3a00e08 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:54.630962 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee4dff7f-f65d-4bcb-88e6-9de4f3a00e08 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:54.631740 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee4dff7f-f65d-4bcb-88e6-9de4f3a00e08 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:54.632166 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee4dff7f-f65d-4bcb-88e6-9de4f3a00e08 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:54.663913 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ee4dff7f-f65d-4bcb-88e6-9de4f3a00e08 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045460 Apr 06 16:42:54.664496 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 346/669] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:54 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:54.722537 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c7b4a1cb-2a03-48e7-8dfd-2bb965b6b3d2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:54.723361 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c7b4a1cb-2a03-48e7-8dfd-2bb965b6b3d2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:54.731601 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7b4a1cb-2a03-48e7-8dfd-2bb965b6b3d2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:54.732063 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7b4a1cb-2a03-48e7-8dfd-2bb965b6b3d2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:54.732957 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7b4a1cb-2a03-48e7-8dfd-2bb965b6b3d2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:54.734131 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7b4a1cb-2a03-48e7-8dfd-2bb965b6b3d2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:54.878555 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c7b4a1cb-2a03-48e7-8dfd-2bb965b6b3d2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:54.886671 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c7b4a1cb-2a03-48e7-8dfd-2bb965b6b3d2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.168277 Apr 06 16:42:54.887252 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 324/670] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:54 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:55.064409 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9d4dbee4-6393-43cf-ae56-eb24cdc44376 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:55.065038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9d4dbee4-6393-43cf-ae56-eb24cdc44376 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:55.071973 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d4dbee4-6393-43cf-ae56-eb24cdc44376 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:55.072420 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d4dbee4-6393-43cf-ae56-eb24cdc44376 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:55.073238 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d4dbee4-6393-43cf-ae56-eb24cdc44376 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:55.073671 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d4dbee4-6393-43cf-ae56-eb24cdc44376 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:55.131636 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4ee4b07b-ca02-490f-a555-c99f0fcf6ab9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:55.132484 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4ee4b07b-ca02-490f-a555-c99f0fcf6ab9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:55.138998 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ee4b07b-ca02-490f-a555-c99f0fcf6ab9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:55.139560 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ee4b07b-ca02-490f-a555-c99f0fcf6ab9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:55.140320 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ee4b07b-ca02-490f-a555-c99f0fcf6ab9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:55.140891 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ee4b07b-ca02-490f-a555-c99f0fcf6ab9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:55.177701 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4ee4b07b-ca02-490f-a555-c99f0fcf6ab9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050164 Apr 06 16:42:55.178272 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 325/671] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:42:55 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:42:55.231379 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9d4dbee4-6393-43cf-ae56-eb24cdc44376 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:55.239596 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9d4dbee4-6393-43cf-ae56-eb24cdc44376 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.179033 Apr 06 16:42:55.240200 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 347/672] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:55 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:55.676145 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8108b80b-becb-4c6a-83a8-7322ab4ebe65 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:55.677137 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8108b80b-becb-4c6a-83a8-7322ab4ebe65 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:55.684379 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8108b80b-becb-4c6a-83a8-7322ab4ebe65 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:55.685204 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8108b80b-becb-4c6a-83a8-7322ab4ebe65 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:55.686473 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8108b80b-becb-4c6a-83a8-7322ab4ebe65 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:55.686891 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8108b80b-becb-4c6a-83a8-7322ab4ebe65 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:55.717525 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8108b80b-becb-4c6a-83a8-7322ab4ebe65 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045733 Apr 06 16:42:55.718259 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 326/673] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:55 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:55.904167 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9182645b-bc8c-41bc-a889-4adbdc49fb4e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:55.904849 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9182645b-bc8c-41bc-a889-4adbdc49fb4e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:55.911666 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9182645b-bc8c-41bc-a889-4adbdc49fb4e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:55.912141 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9182645b-bc8c-41bc-a889-4adbdc49fb4e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:55.912958 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9182645b-bc8c-41bc-a889-4adbdc49fb4e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:55.913520 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9182645b-bc8c-41bc-a889-4adbdc49fb4e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:56.055940 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9182645b-bc8c-41bc-a889-4adbdc49fb4e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:56.065288 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9182645b-bc8c-41bc-a889-4adbdc49fb4e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.165025 Apr 06 16:42:56.065839 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 348/674] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:55 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:56.192617 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5bb07aae-b17f-4e43-ab91-caeae89e4aea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:56.193478 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5bb07aae-b17f-4e43-ab91-caeae89e4aea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:56.200284 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5bb07aae-b17f-4e43-ab91-caeae89e4aea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:56.200773 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5bb07aae-b17f-4e43-ab91-caeae89e4aea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:56.201535 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5bb07aae-b17f-4e43-ab91-caeae89e4aea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:56.202218 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5bb07aae-b17f-4e43-ab91-caeae89e4aea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:56.237032 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5bb07aae-b17f-4e43-ab91-caeae89e4aea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048528 Apr 06 16:42:56.237593 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 327/675] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:42:56 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:42:56.258657 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a4dc1a43-0900-4caf-813a-f90f143ab7a5 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:56.259262 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a4dc1a43-0900-4caf-813a-f90f143ab7a5 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:56.265715 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4dc1a43-0900-4caf-813a-f90f143ab7a5 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:56.266160 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4dc1a43-0900-4caf-813a-f90f143ab7a5 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:56.266938 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4dc1a43-0900-4caf-813a-f90f143ab7a5 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:56.267371 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4dc1a43-0900-4caf-813a-f90f143ab7a5 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:56.401834 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a4dc1a43-0900-4caf-813a-f90f143ab7a5 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:56.409400 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a4dc1a43-0900-4caf-813a-f90f143ab7a5 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.154711 Apr 06 16:42:56.409984 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 349/676] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:56 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:56.731564 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-742d2770-2771-46dd-ae0c-a27e7be2260a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:56.733380 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-742d2770-2771-46dd-ae0c-a27e7be2260a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:56.739875 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-742d2770-2771-46dd-ae0c-a27e7be2260a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:56.740319 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-742d2770-2771-46dd-ae0c-a27e7be2260a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:56.741127 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-742d2770-2771-46dd-ae0c-a27e7be2260a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:56.741556 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-742d2770-2771-46dd-ae0c-a27e7be2260a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:56.773473 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-742d2770-2771-46dd-ae0c-a27e7be2260a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046907 Apr 06 16:42:56.774041 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 328/677] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:56 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:42:57.082663 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9f97fe3e-cae7-4f97-85c0-438ef4e6a4a1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:57.083228 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9f97fe3e-cae7-4f97-85c0-438ef4e6a4a1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:57.089664 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f97fe3e-cae7-4f97-85c0-438ef4e6a4a1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:57.090110 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f97fe3e-cae7-4f97-85c0-438ef4e6a4a1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:57.090863 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f97fe3e-cae7-4f97-85c0-438ef4e6a4a1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:57.091311 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f97fe3e-cae7-4f97-85c0-438ef4e6a4a1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:57.245408 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9f97fe3e-cae7-4f97-85c0-438ef4e6a4a1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:57.249945 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0c63ed5b-fcc4-479c-91f5-72c66f6d539f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:57.251078 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0c63ed5b-fcc4-479c-91f5-72c66f6d539f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:57.253937 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9f97fe3e-cae7-4f97-85c0-438ef4e6a4a1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.175161 Apr 06 16:42:57.254544 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 350/678] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:57 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:57.259663 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c63ed5b-fcc4-479c-91f5-72c66f6d539f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:57.260225 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c63ed5b-fcc4-479c-91f5-72c66f6d539f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:57.261341 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c63ed5b-fcc4-479c-91f5-72c66f6d539f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:57.261991 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c63ed5b-fcc4-479c-91f5-72c66f6d539f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:57.293091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0c63ed5b-fcc4-479c-91f5-72c66f6d539f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047510 Apr 06 16:42:57.293653 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 329/679] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:42:57 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:42:57.430834 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e72fdb03-c4c0-4d43-a0b1-0ce0028425f3 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:57.431828 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e72fdb03-c4c0-4d43-a0b1-0ce0028425f3 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:57.442119 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e72fdb03-c4c0-4d43-a0b1-0ce0028425f3 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:57.442863 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e72fdb03-c4c0-4d43-a0b1-0ce0028425f3 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:57.444133 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e72fdb03-c4c0-4d43-a0b1-0ce0028425f3 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:57.444898 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e72fdb03-c4c0-4d43-a0b1-0ce0028425f3 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:57.591254 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e72fdb03-c4c0-4d43-a0b1-0ce0028425f3 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:57.600526 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e72fdb03-c4c0-4d43-a0b1-0ce0028425f3 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.176239 Apr 06 16:42:57.601136 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 351/680] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:57 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:57.788864 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e9a003aa-a9a8-4a86-8ad2-480ba4163721 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:57.790101 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e9a003aa-a9a8-4a86-8ad2-480ba4163721 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:57.799978 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9a003aa-a9a8-4a86-8ad2-480ba4163721 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:57.800486 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9a003aa-a9a8-4a86-8ad2-480ba4163721 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:57.801600 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9a003aa-a9a8-4a86-8ad2-480ba4163721 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:57.802173 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9a003aa-a9a8-4a86-8ad2-480ba4163721 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:57.833697 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e9a003aa-a9a8-4a86-8ad2-480ba4163721 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051437 Apr 06 16:42:57.834252 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 330/681] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:57 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:58.279163 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3def9481-c3e4-400d-a503-c3027a71c717 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:58.280146 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3def9481-c3e4-400d-a503-c3027a71c717 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:58.290474 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3def9481-c3e4-400d-a503-c3027a71c717 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:58.291222 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3def9481-c3e4-400d-a503-c3027a71c717 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:58.292492 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3def9481-c3e4-400d-a503-c3027a71c717 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:58.293261 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3def9481-c3e4-400d-a503-c3027a71c717 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:58.305804 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-edb58edc-c232-4d49-8b8b-7cba47531de9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:58.306746 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-edb58edc-c232-4d49-8b8b-7cba47531de9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:58.314471 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edb58edc-c232-4d49-8b8b-7cba47531de9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:58.314822 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edb58edc-c232-4d49-8b8b-7cba47531de9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:58.315603 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edb58edc-c232-4d49-8b8b-7cba47531de9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:58.316029 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edb58edc-c232-4d49-8b8b-7cba47531de9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:58.345725 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-edb58edc-c232-4d49-8b8b-7cba47531de9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043922 Apr 06 16:42:58.346298 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 331/682] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:42:58 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:42:58.435275 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3def9481-c3e4-400d-a503-c3027a71c717 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:58.443557 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3def9481-c3e4-400d-a503-c3027a71c717 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.170892 Apr 06 16:42:58.444146 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 352/683] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:58 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:58.628143 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-df9f94d2-506d-49f6-b070-1cadb8007894 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:58.628781 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-df9f94d2-506d-49f6-b070-1cadb8007894 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:58.635033 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df9f94d2-506d-49f6-b070-1cadb8007894 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:58.635486 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df9f94d2-506d-49f6-b070-1cadb8007894 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:58.636260 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df9f94d2-506d-49f6-b070-1cadb8007894 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:58.636725 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df9f94d2-506d-49f6-b070-1cadb8007894 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:58.773662 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-df9f94d2-506d-49f6-b070-1cadb8007894 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:58.781989 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-df9f94d2-506d-49f6-b070-1cadb8007894 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.157709 Apr 06 16:42:58.782566 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 332/684] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:58 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:58.846780 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b1104947-3462-4fa0-9e73-2a6e6ad3acf0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:58.847718 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b1104947-3462-4fa0-9e73-2a6e6ad3acf0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:58.855838 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1104947-3462-4fa0-9e73-2a6e6ad3acf0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:58.856287 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1104947-3462-4fa0-9e73-2a6e6ad3acf0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:58.857301 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1104947-3462-4fa0-9e73-2a6e6ad3acf0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:58.857914 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1104947-3462-4fa0-9e73-2a6e6ad3acf0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:58.891337 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b1104947-3462-4fa0-9e73-2a6e6ad3acf0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048916 Apr 06 16:42:58.891830 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 353/685] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:58 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:42:59.359516 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-29dbffc4-3e98-4549-82d6-42a86c8a3099 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:59.360441 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-29dbffc4-3e98-4549-82d6-42a86c8a3099 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:59.366910 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29dbffc4-3e98-4549-82d6-42a86c8a3099 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:59.367764 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29dbffc4-3e98-4549-82d6-42a86c8a3099 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:59.368539 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29dbffc4-3e98-4549-82d6-42a86c8a3099 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:59.369360 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29dbffc4-3e98-4549-82d6-42a86c8a3099 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:59.398052 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-29dbffc4-3e98-4549-82d6-42a86c8a3099 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043368 Apr 06 16:42:59.398625 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 333/686] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:42:59 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:42:59.464833 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7b44722d-1fdd-4a2b-bbb4-5ea00df8335f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:59.465685 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7b44722d-1fdd-4a2b-bbb4-5ea00df8335f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:59.475924 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b44722d-1fdd-4a2b-bbb4-5ea00df8335f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:59.476662 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b44722d-1fdd-4a2b-bbb4-5ea00df8335f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:59.477953 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b44722d-1fdd-4a2b-bbb4-5ea00df8335f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:59.478660 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b44722d-1fdd-4a2b-bbb4-5ea00df8335f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:59.684801 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7b44722d-1fdd-4a2b-bbb4-5ea00df8335f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:42:59.692317 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7b44722d-1fdd-4a2b-bbb4-5ea00df8335f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.233866 Apr 06 16:42:59.692911 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 354/687] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:59 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:42:59.799886 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f8c6cc3f-9f56-47a8-be93-8e057ad2851d tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:59.800536 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f8c6cc3f-9f56-47a8-be93-8e057ad2851d tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:59.806916 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f8c6cc3f-9f56-47a8-be93-8e057ad2851d tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:59.807590 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f8c6cc3f-9f56-47a8-be93-8e057ad2851d tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:59.808529 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f8c6cc3f-9f56-47a8-be93-8e057ad2851d tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:59.809189 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f8c6cc3f-9f56-47a8-be93-8e057ad2851d tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:59.904197 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0cf2d96d-87a9-40ce-9ebe-901030e57a15 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:42:59.907400 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0cf2d96d-87a9-40ce-9ebe-901030e57a15 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:42:59.914586 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0cf2d96d-87a9-40ce-9ebe-901030e57a15 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:59.915352 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0cf2d96d-87a9-40ce-9ebe-901030e57a15 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:59.916324 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0cf2d96d-87a9-40ce-9ebe-901030e57a15 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:42:59.917198 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0cf2d96d-87a9-40ce-9ebe-901030e57a15 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:42:59.952631 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0cf2d96d-87a9-40ce-9ebe-901030e57a15 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053224 Apr 06 16:42:59.957069 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 355/688] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:42:59 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:43:00.173548 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f8c6cc3f-9f56-47a8-be93-8e057ad2851d tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:43:00.181306 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f8c6cc3f-9f56-47a8-be93-8e057ad2851d tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.385255 Apr 06 16:43:00.181977 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 334/689] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:42:59 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:43:00.330536 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-879df02f-cbab-4f21-b641-647d6772d6a9 req-c4a78d2c-9fe1-4b1c-a178-c528bb2577f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d36d74-5240-44c1-8425-e1dedf7c6718", "tag": "c7da763b-aba6-4b1e-ad62-c32222723c20"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:43:00.339928 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-879df02f-cbab-4f21-b641-647d6772d6a9 req-c4a78d2c-9fe1-4b1c-a178-c528bb2577f8 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:00.340620 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-879df02f-cbab-4f21-b641-647d6772d6a9 req-c4a78d2c-9fe1-4b1c-a178-c528bb2577f8 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:00.359363 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-879df02f-cbab-4f21-b641-647d6772d6a9 req-c4a78d2c-9fe1-4b1c-a178-c528bb2577f8 service nova] Creating event network-changed:c7da763b-aba6-4b1e-ad62-c32222723c20 for instance d5d36d74-5240-44c1-8425-e1dedf7c6718 on hv-cinder-83684 Apr 06 16:43:00.366223 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-879df02f-cbab-4f21-b641-647d6772d6a9 req-c4a78d2c-9fe1-4b1c-a178-c528bb2577f8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039520 Apr 06 16:43:00.367839 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 356/690] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:00.410566 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5684435e-0a3a-4d4f-9e33-010a1605e12c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:00.413288 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5684435e-0a3a-4d4f-9e33-010a1605e12c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:00.422185 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5684435e-0a3a-4d4f-9e33-010a1605e12c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:00.422835 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5684435e-0a3a-4d4f-9e33-010a1605e12c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:00.423649 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5684435e-0a3a-4d4f-9e33-010a1605e12c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:00.424079 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5684435e-0a3a-4d4f-9e33-010a1605e12c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:00.462356 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5684435e-0a3a-4d4f-9e33-010a1605e12c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056021 Apr 06 16:43:00.466727 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 335/691] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:00 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:00.709927 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-22c82ebd-5724-4e6d-9d79-09cc24d77319 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:00.710634 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-22c82ebd-5724-4e6d-9d79-09cc24d77319 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:00.716818 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22c82ebd-5724-4e6d-9d79-09cc24d77319 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:00.717275 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22c82ebd-5724-4e6d-9d79-09cc24d77319 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:00.718063 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22c82ebd-5724-4e6d-9d79-09cc24d77319 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:00.718573 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22c82ebd-5724-4e6d-9d79-09cc24d77319 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:00.873681 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-22c82ebd-5724-4e6d-9d79-09cc24d77319 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:43:00.882012 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-22c82ebd-5724-4e6d-9d79-09cc24d77319 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.176366 Apr 06 16:43:00.882580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 357/692] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:43:00 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:43:00.969340 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-76108560-6070-42a1-8a5f-e718991e0ff0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:00.970864 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-76108560-6070-42a1-8a5f-e718991e0ff0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:00.981047 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76108560-6070-42a1-8a5f-e718991e0ff0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:00.981777 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76108560-6070-42a1-8a5f-e718991e0ff0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:00.982937 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76108560-6070-42a1-8a5f-e718991e0ff0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:00.983649 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76108560-6070-42a1-8a5f-e718991e0ff0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:01.012869 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-76108560-6070-42a1-8a5f-e718991e0ff0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050735 Apr 06 16:43:01.013415 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 336/693] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:00 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:01.200948 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b0051b39-4948-4db4-8a23-0bc2622e3293 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:01.201750 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b0051b39-4948-4db4-8a23-0bc2622e3293 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:01.208483 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0051b39-4948-4db4-8a23-0bc2622e3293 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:01.208957 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0051b39-4948-4db4-8a23-0bc2622e3293 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:01.209719 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0051b39-4948-4db4-8a23-0bc2622e3293 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:01.210144 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b0051b39-4948-4db4-8a23-0bc2622e3293 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:01.358434 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b0051b39-4948-4db4-8a23-0bc2622e3293 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:43:01.366069 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b0051b39-4948-4db4-8a23-0bc2622e3293 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.171020 Apr 06 16:43:01.366732 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 358/694] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:43:01 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:43:01.475825 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-529580eb-8a02-49e6-9348-9aa91d8864af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:01.476797 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-529580eb-8a02-49e6-9348-9aa91d8864af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:01.484007 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-529580eb-8a02-49e6-9348-9aa91d8864af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:01.484468 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-529580eb-8a02-49e6-9348-9aa91d8864af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:01.485265 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-529580eb-8a02-49e6-9348-9aa91d8864af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:01.485702 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-529580eb-8a02-49e6-9348-9aa91d8864af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:01.515947 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-529580eb-8a02-49e6-9348-9aa91d8864af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044971 Apr 06 16:43:01.516505 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 337/695] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:01 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:01.902406 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a4f51417-2d62-4729-9779-b75c85a80b60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:01.903007 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a4f51417-2d62-4729-9779-b75c85a80b60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:01.910462 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4f51417-2d62-4729-9779-b75c85a80b60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:01.910912 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4f51417-2d62-4729-9779-b75c85a80b60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:01.911679 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4f51417-2d62-4729-9779-b75c85a80b60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:01.912112 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4f51417-2d62-4729-9779-b75c85a80b60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:02.025182 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a7c0815e-d5a0-4e94-a09f-6d28590d9bb5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:02.026310 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a7c0815e-d5a0-4e94-a09f-6d28590d9bb5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:02.032779 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7c0815e-d5a0-4e94-a09f-6d28590d9bb5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:02.033234 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7c0815e-d5a0-4e94-a09f-6d28590d9bb5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:02.034161 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7c0815e-d5a0-4e94-a09f-6d28590d9bb5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:02.034635 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7c0815e-d5a0-4e94-a09f-6d28590d9bb5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:02.059529 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a4f51417-2d62-4729-9779-b75c85a80b60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:43:02.067617 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a7c0815e-d5a0-4e94-a09f-6d28590d9bb5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046398 Apr 06 16:43:02.067875 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a4f51417-2d62-4729-9779-b75c85a80b60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.171627 Apr 06 16:43:02.068227 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 338/696] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:02 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:02.068947 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 359/697] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:43:01 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:43:02.383827 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-22845a5f-9408-444e-b98c-0a88523f9cb6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:02.384441 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-22845a5f-9408-444e-b98c-0a88523f9cb6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:02.391141 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22845a5f-9408-444e-b98c-0a88523f9cb6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:02.391587 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22845a5f-9408-444e-b98c-0a88523f9cb6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:02.392346 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22845a5f-9408-444e-b98c-0a88523f9cb6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:02.392838 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22845a5f-9408-444e-b98c-0a88523f9cb6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:02.527792 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-52c3da49-ddc8-4cdf-94dc-885925e25fbb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:02.528753 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-52c3da49-ddc8-4cdf-94dc-885925e25fbb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:02.535370 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52c3da49-ddc8-4cdf-94dc-885925e25fbb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:02.535822 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52c3da49-ddc8-4cdf-94dc-885925e25fbb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:02.536601 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52c3da49-ddc8-4cdf-94dc-885925e25fbb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:02.537070 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52c3da49-ddc8-4cdf-94dc-885925e25fbb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:02.538287 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-22845a5f-9408-444e-b98c-0a88523f9cb6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:43:02.546166 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-22845a5f-9408-444e-b98c-0a88523f9cb6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.166298 Apr 06 16:43:02.546905 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 339/698] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:43:02 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:43:02.567896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-52c3da49-ddc8-4cdf-94dc-885925e25fbb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043967 Apr 06 16:43:02.568373 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 360/699] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:02 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:03.082337 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-219cc2b4-c1db-4561-9558-2f76c22270f1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:03.083890 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-219cc2b4-c1db-4561-9558-2f76c22270f1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:03.087564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b39d4ede-78ba-498c-8f32-b8042df81b07 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:03.089615 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b39d4ede-78ba-498c-8f32-b8042df81b07 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:03.095065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-219cc2b4-c1db-4561-9558-2f76c22270f1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:03.096115 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-219cc2b4-c1db-4561-9558-2f76c22270f1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:03.097392 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-219cc2b4-c1db-4561-9558-2f76c22270f1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:03.098379 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-219cc2b4-c1db-4561-9558-2f76c22270f1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:03.100529 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b39d4ede-78ba-498c-8f32-b8042df81b07 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:03.101321 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b39d4ede-78ba-498c-8f32-b8042df81b07 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:03.102543 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b39d4ede-78ba-498c-8f32-b8042df81b07 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:03.103247 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b39d4ede-78ba-498c-8f32-b8042df81b07 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:03.182287 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-219cc2b4-c1db-4561-9558-2f76c22270f1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106196 Apr 06 16:43:03.184900 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 340/700] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:03 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:03.310376 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b39d4ede-78ba-498c-8f32-b8042df81b07 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:43:03.318858 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b39d4ede-78ba-498c-8f32-b8042df81b07 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.238195 Apr 06 16:43:03.319491 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 361/701] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:43:03 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:43:03.566648 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-971ec9a5-3523-43b1-ac30-66689e4fde81 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:03.567244 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-971ec9a5-3523-43b1-ac30-66689e4fde81 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:03.574672 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-971ec9a5-3523-43b1-ac30-66689e4fde81 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:03.575121 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-971ec9a5-3523-43b1-ac30-66689e4fde81 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:03.575899 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-971ec9a5-3523-43b1-ac30-66689e4fde81 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:03.576324 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-971ec9a5-3523-43b1-ac30-66689e4fde81 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:03.579915 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2413fa65-7cf0-431c-b778-7044a55debf5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:03.580874 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2413fa65-7cf0-431c-b778-7044a55debf5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:03.587415 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2413fa65-7cf0-431c-b778-7044a55debf5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:03.587779 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2413fa65-7cf0-431c-b778-7044a55debf5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:03.588557 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2413fa65-7cf0-431c-b778-7044a55debf5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:03.589009 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2413fa65-7cf0-431c-b778-7044a55debf5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:03.619816 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2413fa65-7cf0-431c-b778-7044a55debf5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043825 Apr 06 16:43:03.620407 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 362/702] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:03 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:03.765018 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-971ec9a5-3523-43b1-ac30-66689e4fde81 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:43:03.773155 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-971ec9a5-3523-43b1-ac30-66689e4fde81 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.211794 Apr 06 16:43:03.773713 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 341/703] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:43:03 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:43:04.198288 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c2f0f8a1-1faf-4983-bd75-ebf9e9ab0e4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:04.199120 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c2f0f8a1-1faf-4983-bd75-ebf9e9ab0e4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:04.206324 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2f0f8a1-1faf-4983-bd75-ebf9e9ab0e4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:04.206817 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2f0f8a1-1faf-4983-bd75-ebf9e9ab0e4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:04.207610 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2f0f8a1-1faf-4983-bd75-ebf9e9ab0e4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:04.208043 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2f0f8a1-1faf-4983-bd75-ebf9e9ab0e4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:04.240210 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c2f0f8a1-1faf-4983-bd75-ebf9e9ab0e4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045964 Apr 06 16:43:04.240821 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 363/704] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:04 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:04.336751 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e98e03ad-b234-4126-acee-9159fdc21789 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:04.337420 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e98e03ad-b234-4126-acee-9159fdc21789 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:04.344505 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e98e03ad-b234-4126-acee-9159fdc21789 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:04.344984 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e98e03ad-b234-4126-acee-9159fdc21789 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:04.345769 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e98e03ad-b234-4126-acee-9159fdc21789 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:04.346199 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e98e03ad-b234-4126-acee-9159fdc21789 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:04.497467 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e98e03ad-b234-4126-acee-9159fdc21789 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:43:04.506008 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e98e03ad-b234-4126-acee-9159fdc21789 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.173184 Apr 06 16:43:04.506595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 342/705] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:43:04 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:43:04.635592 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3c0e50da-0c01-4feb-80dc-e918cd99cc3d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:04.637075 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3c0e50da-0c01-4feb-80dc-e918cd99cc3d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:04.647236 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c0e50da-0c01-4feb-80dc-e918cd99cc3d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:04.647936 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c0e50da-0c01-4feb-80dc-e918cd99cc3d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:04.649312 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c0e50da-0c01-4feb-80dc-e918cd99cc3d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:04.650007 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c0e50da-0c01-4feb-80dc-e918cd99cc3d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:04.683260 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3c0e50da-0c01-4feb-80dc-e918cd99cc3d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053799 Apr 06 16:43:04.683879 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 364/706] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:04 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:04.791660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-48e6a659-69b5-4e49-9c35-331b1636cc35 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:04.792456 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-48e6a659-69b5-4e49-9c35-331b1636cc35 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:04.799971 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48e6a659-69b5-4e49-9c35-331b1636cc35 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:04.800416 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48e6a659-69b5-4e49-9c35-331b1636cc35 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:04.801260 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48e6a659-69b5-4e49-9c35-331b1636cc35 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:04.802182 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48e6a659-69b5-4e49-9c35-331b1636cc35 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:04.950422 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-48e6a659-69b5-4e49-9c35-331b1636cc35 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:43:04.958480 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-48e6a659-69b5-4e49-9c35-331b1636cc35 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.171346 Apr 06 16:43:04.959098 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 343/707] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:43:04 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:43:05.252502 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-18d951e0-34b1-473a-a332-a7789393203a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:05.253436 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-18d951e0-34b1-473a-a332-a7789393203a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:05.260125 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18d951e0-34b1-473a-a332-a7789393203a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:05.260552 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18d951e0-34b1-473a-a332-a7789393203a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:05.261429 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18d951e0-34b1-473a-a332-a7789393203a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:05.261866 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18d951e0-34b1-473a-a332-a7789393203a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:05.293175 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-18d951e0-34b1-473a-a332-a7789393203a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045263 Apr 06 16:43:05.293769 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 365/708] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:05 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:05.523387 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d160fc59-9e57-4b57-a9ac-c16521b4b8b0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:05.524139 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d160fc59-9e57-4b57-a9ac-c16521b4b8b0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:05.530948 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d160fc59-9e57-4b57-a9ac-c16521b4b8b0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:05.531798 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d160fc59-9e57-4b57-a9ac-c16521b4b8b0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:05.532622 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d160fc59-9e57-4b57-a9ac-c16521b4b8b0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:05.533068 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d160fc59-9e57-4b57-a9ac-c16521b4b8b0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:05.696607 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fde9c605-fa98-4fa7-9004-69dd1675b13c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:05.697794 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fde9c605-fa98-4fa7-9004-69dd1675b13c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:05.706791 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d160fc59-9e57-4b57-a9ac-c16521b4b8b0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:43:05.715052 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d160fc59-9e57-4b57-a9ac-c16521b4b8b0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.195644 Apr 06 16:43:05.715704 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 344/709] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:43:05 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:43:05.720558 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-daf470f8-7e81-4d27-9028-96194252c7ca req-426f2c49-834e-4f37-85a9-da47a215eddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d36d74-5240-44c1-8425-e1dedf7c6718", "name": "network-vif-plugged", "status": "completed", "tag": "c7da763b-aba6-4b1e-ad62-c32222723c20"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:43:05.722119 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fde9c605-fa98-4fa7-9004-69dd1675b13c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:05.722576 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fde9c605-fa98-4fa7-9004-69dd1675b13c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:05.723360 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fde9c605-fa98-4fa7-9004-69dd1675b13c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:05.723918 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fde9c605-fa98-4fa7-9004-69dd1675b13c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:05.735195 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-daf470f8-7e81-4d27-9028-96194252c7ca req-426f2c49-834e-4f37-85a9-da47a215eddb service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:05.735640 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-daf470f8-7e81-4d27-9028-96194252c7ca req-426f2c49-834e-4f37-85a9-da47a215eddb service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:05.752529 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-daf470f8-7e81-4d27-9028-96194252c7ca req-426f2c49-834e-4f37-85a9-da47a215eddb service nova] Creating event network-vif-plugged:c7da763b-aba6-4b1e-ad62-c32222723c20 for instance d5d36d74-5240-44c1-8425-e1dedf7c6718 on hv-cinder-83684 Apr 06 16:43:05.758296 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-daf470f8-7e81-4d27-9028-96194252c7ca req-426f2c49-834e-4f37-85a9-da47a215eddb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041302 Apr 06 16:43:05.759150 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 345/710] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:05.761281 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fde9c605-fa98-4fa7-9004-69dd1675b13c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068425 Apr 06 16:43:05.761281 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 366/711] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:05 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 06 16:43:05.978058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1e2b3ed3-7678-4006-8e07-60ab5c20e9ab tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:05.978757 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1e2b3ed3-7678-4006-8e07-60ab5c20e9ab tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:05.985398 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e2b3ed3-7678-4006-8e07-60ab5c20e9ab tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:05.985830 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e2b3ed3-7678-4006-8e07-60ab5c20e9ab tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:05.986608 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e2b3ed3-7678-4006-8e07-60ab5c20e9ab tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:05.987037 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e2b3ed3-7678-4006-8e07-60ab5c20e9ab tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:06.165134 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1e2b3ed3-7678-4006-8e07-60ab5c20e9ab tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:43:06.175530 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1e2b3ed3-7678-4006-8e07-60ab5c20e9ab tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.202088 Apr 06 16:43:06.180400 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 346/712] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:43:05 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:43:06.306778 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2376e2d7-3aca-4179-a4e8-f6a5d221cff7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:06.307717 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2376e2d7-3aca-4179-a4e8-f6a5d221cff7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:06.315639 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2376e2d7-3aca-4179-a4e8-f6a5d221cff7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:06.316082 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2376e2d7-3aca-4179-a4e8-f6a5d221cff7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:06.317149 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2376e2d7-3aca-4179-a4e8-f6a5d221cff7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:06.317553 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2376e2d7-3aca-4179-a4e8-f6a5d221cff7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:06.349457 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2376e2d7-3aca-4179-a4e8-f6a5d221cff7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047527 Apr 06 16:43:06.350047 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 367/713] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:06 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:06.737412 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3a741a89-3da4-4f5d-a996-7d16ebf8b811 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:06.738652 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3a741a89-3da4-4f5d-a996-7d16ebf8b811 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:06.746116 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a741a89-3da4-4f5d-a996-7d16ebf8b811 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:06.746595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a741a89-3da4-4f5d-a996-7d16ebf8b811 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:06.747385 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a741a89-3da4-4f5d-a996-7d16ebf8b811 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:06.747819 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a741a89-3da4-4f5d-a996-7d16ebf8b811 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:06.771907 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9dd80cae-dd41-44c6-bbd7-6ba8623d725a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:06.772978 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9dd80cae-dd41-44c6-bbd7-6ba8623d725a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:06.779462 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dd80cae-dd41-44c6-bbd7-6ba8623d725a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:06.779899 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dd80cae-dd41-44c6-bbd7-6ba8623d725a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:06.781218 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dd80cae-dd41-44c6-bbd7-6ba8623d725a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:06.781772 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dd80cae-dd41-44c6-bbd7-6ba8623d725a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:06.813988 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9dd80cae-dd41-44c6-bbd7-6ba8623d725a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045671 Apr 06 16:43:06.815010 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 368/714] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:06 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:06.909340 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3a741a89-3da4-4f5d-a996-7d16ebf8b811 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:43:06.917367 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3a741a89-3da4-4f5d-a996-7d16ebf8b811 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1365 microversion: 2.1 time: 0.186912 Apr 06 16:43:06.917951 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 347/715] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:43:06 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:43:07.193278 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8a5bf2e1-7858-462d-acca-da0bbdf1f606 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:07.194198 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8a5bf2e1-7858-462d-acca-da0bbdf1f606 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:07.201168 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a5bf2e1-7858-462d-acca-da0bbdf1f606 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:07.201622 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a5bf2e1-7858-462d-acca-da0bbdf1f606 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:07.202862 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a5bf2e1-7858-462d-acca-da0bbdf1f606 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:07.203300 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a5bf2e1-7858-462d-acca-da0bbdf1f606 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:07.350732 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8a5bf2e1-7858-462d-acca-da0bbdf1f606 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:43:07.359142 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8a5bf2e1-7858-462d-acca-da0bbdf1f606 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.169893 Apr 06 16:43:07.359839 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 369/716] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:43:07 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:43:07.362169 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8a95a525-7e52-448f-8304-de726685beb5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:07.363111 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8a95a525-7e52-448f-8304-de726685beb5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:07.369916 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a95a525-7e52-448f-8304-de726685beb5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:07.370358 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a95a525-7e52-448f-8304-de726685beb5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:07.371131 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a95a525-7e52-448f-8304-de726685beb5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:07.371554 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a95a525-7e52-448f-8304-de726685beb5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:07.401687 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8a95a525-7e52-448f-8304-de726685beb5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044189 Apr 06 16:43:07.402288 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 348/717] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:07 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:43:07.830306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9b1013d7-0c2b-4cda-afa2-ca542224be92 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:07.831388 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9b1013d7-0c2b-4cda-afa2-ca542224be92 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:07.838136 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b1013d7-0c2b-4cda-afa2-ca542224be92 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:07.838580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b1013d7-0c2b-4cda-afa2-ca542224be92 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:07.839357 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b1013d7-0c2b-4cda-afa2-ca542224be92 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:07.840057 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9b1013d7-0c2b-4cda-afa2-ca542224be92 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:07.873559 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9b1013d7-0c2b-4cda-afa2-ca542224be92 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047482 Apr 06 16:43:07.874132 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 370/718] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:07 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:07.905013 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-0c349182-d9f0-4ad0-b635-590c3a8d7ba9 req-b12c079f-a0e8-4d33-8f39-5f969784ca77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0cb1d38-bd60-4b01-9c35-d2a181ced275", "name": "network-vif-plugged", "status": "completed", "tag": "c3626722-fde1-4b09-b90d-77925245b539"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:43:07.914110 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0c349182-d9f0-4ad0-b635-590c3a8d7ba9 req-b12c079f-a0e8-4d33-8f39-5f969784ca77 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:07.914559 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0c349182-d9f0-4ad0-b635-590c3a8d7ba9 req-b12c079f-a0e8-4d33-8f39-5f969784ca77 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:07.926692 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-0c349182-d9f0-4ad0-b635-590c3a8d7ba9 req-b12c079f-a0e8-4d33-8f39-5f969784ca77 service nova] Creating event network-vif-plugged:c3626722-fde1-4b09-b90d-77925245b539 for instance b0cb1d38-bd60-4b01-9c35-d2a181ced275 on hv-cinder-83684 Apr 06 16:43:07.931895 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-0c349182-d9f0-4ad0-b635-590c3a8d7ba9 req-b12c079f-a0e8-4d33-8f39-5f969784ca77 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030574 Apr 06 16:43:07.932498 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 349/719] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:07.935910 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-62c061ff-f8ad-4b44-b0f3-53044e28dc54 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:07.936521 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-62c061ff-f8ad-4b44-b0f3-53044e28dc54 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:07.944470 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62c061ff-f8ad-4b44-b0f3-53044e28dc54 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:07.944943 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62c061ff-f8ad-4b44-b0f3-53044e28dc54 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:07.945716 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62c061ff-f8ad-4b44-b0f3-53044e28dc54 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:07.946148 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62c061ff-f8ad-4b44-b0f3-53044e28dc54 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:08.113027 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-62c061ff-f8ad-4b44-b0f3-53044e28dc54 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:43:08.121599 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-62c061ff-f8ad-4b44-b0f3-53044e28dc54 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1559 microversion: 2.1 time: 0.190172 Apr 06 16:43:08.122193 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 371/720] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:43:07 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:43:08.139083 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b31a369e-2c74-4918-8f11-e514f7584071 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:08.139775 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b31a369e-2c74-4918-8f11-e514f7584071 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:08.146530 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b31a369e-2c74-4918-8f11-e514f7584071 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:08.146981 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b31a369e-2c74-4918-8f11-e514f7584071 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:08.147819 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b31a369e-2c74-4918-8f11-e514f7584071 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:08.148199 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b31a369e-2c74-4918-8f11-e514f7584071 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:08.262619 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b31a369e-2c74-4918-8f11-e514f7584071 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127955 Apr 06 16:43:08.263253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 350/721] 10.222.0.64 () {58 vars in 1274 bytes} [Wed Apr 6 16:43:08 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:08.376630 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1f79add2-d9d2-42d0-9ce7-e3b1167741d9 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:08.377361 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1f79add2-d9d2-42d0-9ce7-e3b1167741d9 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:08.384740 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f79add2-d9d2-42d0-9ce7-e3b1167741d9 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:08.385438 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f79add2-d9d2-42d0-9ce7-e3b1167741d9 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:08.386287 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f79add2-d9d2-42d0-9ce7-e3b1167741d9 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:08.386717 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f79add2-d9d2-42d0-9ce7-e3b1167741d9 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:08.416155 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-efa0c643-017f-4430-b603-fa7ff4c93376 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:08.417073 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-efa0c643-017f-4430-b603-fa7ff4c93376 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:08.423431 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efa0c643-017f-4430-b603-fa7ff4c93376 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:08.423964 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efa0c643-017f-4430-b603-fa7ff4c93376 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:08.424841 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efa0c643-017f-4430-b603-fa7ff4c93376 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:08.425339 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efa0c643-017f-4430-b603-fa7ff4c93376 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:08.462211 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-efa0c643-017f-4430-b603-fa7ff4c93376 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052183 Apr 06 16:43:08.462856 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 351/722] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:08 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:43:08.705962 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1f79add2-d9d2-42d0-9ce7-e3b1167741d9 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:43:08.714785 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1f79add2-d9d2-42d0-9ce7-e3b1167741d9 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.342480 Apr 06 16:43:08.715468 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 372/723] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:43:08 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:43:08.886624 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a99381fc-14e5-4f0b-8cc3-ad6ca04da2cd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:08.887923 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a99381fc-14e5-4f0b-8cc3-ad6ca04da2cd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:08.895028 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a99381fc-14e5-4f0b-8cc3-ad6ca04da2cd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:08.895480 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a99381fc-14e5-4f0b-8cc3-ad6ca04da2cd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:08.896257 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a99381fc-14e5-4f0b-8cc3-ad6ca04da2cd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:08.896707 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a99381fc-14e5-4f0b-8cc3-ad6ca04da2cd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:08.933924 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a99381fc-14e5-4f0b-8cc3-ad6ca04da2cd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051538 Apr 06 16:43:08.934731 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 352/724] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:08 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:09.475875 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-285cd186-e2d8-4a4f-8717-b31c24004687 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:09.476821 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-285cd186-e2d8-4a4f-8717-b31c24004687 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:09.484319 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-285cd186-e2d8-4a4f-8717-b31c24004687 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:09.484818 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-285cd186-e2d8-4a4f-8717-b31c24004687 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:09.485603 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-285cd186-e2d8-4a4f-8717-b31c24004687 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:09.486031 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-285cd186-e2d8-4a4f-8717-b31c24004687 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:09.518872 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-285cd186-e2d8-4a4f-8717-b31c24004687 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047454 Apr 06 16:43:09.519873 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 373/725] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:09 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:09.735518 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-27bb93a3-35fb-42e7-9a2e-283f913f18cd tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:09.736134 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-27bb93a3-35fb-42e7-9a2e-283f913f18cd tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:09.747506 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27bb93a3-35fb-42e7-9a2e-283f913f18cd tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:09.748361 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27bb93a3-35fb-42e7-9a2e-283f913f18cd tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:09.749516 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27bb93a3-35fb-42e7-9a2e-283f913f18cd tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:09.750172 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27bb93a3-35fb-42e7-9a2e-283f913f18cd tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:09.756306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-e3e33dfa-004c-4290-9807-8f92cd73f8cc req-c9990c04-ef65-4c2c-a567-300e21d0b4ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d36d74-5240-44c1-8425-e1dedf7c6718", "tag": "c7da763b-aba6-4b1e-ad62-c32222723c20"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:43:09.775721 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e3e33dfa-004c-4290-9807-8f92cd73f8cc req-c9990c04-ef65-4c2c-a567-300e21d0b4ae service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:09.776550 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e3e33dfa-004c-4290-9807-8f92cd73f8cc req-c9990c04-ef65-4c2c-a567-300e21d0b4ae service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:09.796022 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-e3e33dfa-004c-4290-9807-8f92cd73f8cc req-c9990c04-ef65-4c2c-a567-300e21d0b4ae service nova] Creating event network-changed:c7da763b-aba6-4b1e-ad62-c32222723c20 for instance d5d36d74-5240-44c1-8425-e1dedf7c6718 on hv-cinder-83684 Apr 06 16:43:09.805956 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-e3e33dfa-004c-4290-9807-8f92cd73f8cc req-c9990c04-ef65-4c2c-a567-300e21d0b4ae service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053216 Apr 06 16:43:09.810013 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 374/726] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:09.954773 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-27bb93a3-35fb-42e7-9a2e-283f913f18cd tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:43:09.959497 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e2b94c07-649a-495d-b863-758a117df11b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:09.962498 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e2b94c07-649a-495d-b863-758a117df11b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:09.967855 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-27bb93a3-35fb-42e7-9a2e-283f913f18cd tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1359 microversion: 2.1 time: 0.237371 Apr 06 16:43:09.969136 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 353/727] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:43:09 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1359 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:43:09.976514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2b94c07-649a-495d-b863-758a117df11b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:09.977911 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2b94c07-649a-495d-b863-758a117df11b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:09.979671 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2b94c07-649a-495d-b863-758a117df11b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:09.980670 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2b94c07-649a-495d-b863-758a117df11b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:10.026474 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e2b94c07-649a-495d-b863-758a117df11b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082408 Apr 06 16:43:10.030447 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 375/728] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:09 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:10.531548 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5f7b5c8a-3d1a-4044-abc9-563dbb677980 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:10.532771 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5f7b5c8a-3d1a-4044-abc9-563dbb677980 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:10.540075 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f7b5c8a-3d1a-4044-abc9-563dbb677980 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:10.540644 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f7b5c8a-3d1a-4044-abc9-563dbb677980 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:10.541515 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f7b5c8a-3d1a-4044-abc9-563dbb677980 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:10.542006 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f7b5c8a-3d1a-4044-abc9-563dbb677980 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:10.575359 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5f7b5c8a-3d1a-4044-abc9-563dbb677980 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048170 Apr 06 16:43:10.576190 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 354/729] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:10 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:10.987208 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0e157358-4be8-4de9-b3f3-e7996adc2da9 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:10.987870 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0e157358-4be8-4de9-b3f3-e7996adc2da9 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:10.994294 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e157358-4be8-4de9-b3f3-e7996adc2da9 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:10.994718 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e157358-4be8-4de9-b3f3-e7996adc2da9 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:10.995692 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e157358-4be8-4de9-b3f3-e7996adc2da9 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:10.996122 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e157358-4be8-4de9-b3f3-e7996adc2da9 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:11.038553 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c4d35f3b-2f42-4b4d-aba3-a247073b1d90 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:11.039521 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c4d35f3b-2f42-4b4d-aba3-a247073b1d90 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:11.047558 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4d35f3b-2f42-4b4d-aba3-a247073b1d90 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:11.048158 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4d35f3b-2f42-4b4d-aba3-a247073b1d90 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:11.049083 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4d35f3b-2f42-4b4d-aba3-a247073b1d90 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:11.049609 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4d35f3b-2f42-4b4d-aba3-a247073b1d90 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:11.082329 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c4d35f3b-2f42-4b4d-aba3-a247073b1d90 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048244 Apr 06 16:43:11.082951 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 355/730] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:11 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:11.148004 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0e157358-4be8-4de9-b3f3-e7996adc2da9 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:43:11.156559 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0e157358-4be8-4de9-b3f3-e7996adc2da9 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1549 microversion: 2.1 time: 0.173729 Apr 06 16:43:11.157219 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 376/731] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:43:10 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:43:11.174184 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eef14781-2f85-4201-b74b-496d24b759b0 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:11.174809 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eef14781-2f85-4201-b74b-496d24b759b0 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:11.181388 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eef14781-2f85-4201-b74b-496d24b759b0 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:11.181808 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eef14781-2f85-4201-b74b-496d24b759b0 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:11.182818 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eef14781-2f85-4201-b74b-496d24b759b0 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:11.183285 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eef14781-2f85-4201-b74b-496d24b759b0 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:11.324944 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-eef14781-2f85-4201-b74b-496d24b759b0 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:43:11.333633 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eef14781-2f85-4201-b74b-496d24b759b0 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1549 microversion: 2.1 time: 0.163444 Apr 06 16:43:11.334225 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 356/732] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:43:11 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:43:11.353017 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6a5aa8df-67fe-4e5d-912d-9ad4c5778de6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:11.356401 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6a5aa8df-67fe-4e5d-912d-9ad4c5778de6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:43:11.357093 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6a5aa8df-67fe-4e5d-912d-9ad4c5778de6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Searching by: {'deleted': False, 'project_id': '80e12968decb4d9794bb483bf8fdeb84'} {{(pid=128861) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 06 16:43:11.364595 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6a5aa8df-67fe-4e5d-912d-9ad4c5778de6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:11.365070 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6a5aa8df-67fe-4e5d-912d-9ad4c5778de6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:11.365870 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6a5aa8df-67fe-4e5d-912d-9ad4c5778de6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:11.366299 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6a5aa8df-67fe-4e5d-912d-9ad4c5778de6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:11.459416 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.multi_cell_list [None req-6a5aa8df-67fe-4e5d-912d-9ad4c5778de6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 06 16:43:11.555609 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6a5aa8df-67fe-4e5d-912d-9ad4c5778de6 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.209194 Apr 06 16:43:11.556228 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 377/733] 10.222.0.64 () {58 vars in 1124 bytes} [Wed Apr 6 16:43:11 2022] GET /compute/v2.1/servers => generated 343 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:11.566752 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7ca8e752-8d47-458d-ba0f-aee9dc2c8cf4 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:11.567357 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7ca8e752-8d47-458d-ba0f-aee9dc2c8cf4 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:11.573792 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ca8e752-8d47-458d-ba0f-aee9dc2c8cf4 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:11.574160 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ca8e752-8d47-458d-ba0f-aee9dc2c8cf4 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:11.574933 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ca8e752-8d47-458d-ba0f-aee9dc2c8cf4 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:11.575366 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ca8e752-8d47-458d-ba0f-aee9dc2c8cf4 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:11.588025 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d2bfe51e-6b9a-4eb1-acfe-1c2e45c2206f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:11.589021 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d2bfe51e-6b9a-4eb1-acfe-1c2e45c2206f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:11.595394 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2bfe51e-6b9a-4eb1-acfe-1c2e45c2206f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:11.596014 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2bfe51e-6b9a-4eb1-acfe-1c2e45c2206f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:11.596805 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2bfe51e-6b9a-4eb1-acfe-1c2e45c2206f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:11.597238 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2bfe51e-6b9a-4eb1-acfe-1c2e45c2206f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:11.629495 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d2bfe51e-6b9a-4eb1-acfe-1c2e45c2206f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045620 Apr 06 16:43:11.630080 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 378/734] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:11 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:43:11.727545 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7ca8e752-8d47-458d-ba0f-aee9dc2c8cf4 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:43:11.736515 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7ca8e752-8d47-458d-ba0f-aee9dc2c8cf4 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1549 microversion: 2.1 time: 0.173614 Apr 06 16:43:11.737165 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 357/735] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:43:11 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:43:12.094643 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-07d8ab60-3c1c-4e3e-8b25-4fad9a00b6a8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:12.095559 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-07d8ab60-3c1c-4e3e-8b25-4fad9a00b6a8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:12.102303 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07d8ab60-3c1c-4e3e-8b25-4fad9a00b6a8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:12.103179 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07d8ab60-3c1c-4e3e-8b25-4fad9a00b6a8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:12.104141 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07d8ab60-3c1c-4e3e-8b25-4fad9a00b6a8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:12.104726 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-07d8ab60-3c1c-4e3e-8b25-4fad9a00b6a8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:12.139751 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-07d8ab60-3c1c-4e3e-8b25-4fad9a00b6a8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049301 Apr 06 16:43:12.140336 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 379/736] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:12 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:12.642883 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1484486c-88ea-43c3-b6bb-c185da32f7bc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:12.643826 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1484486c-88ea-43c3-b6bb-c185da32f7bc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:12.651877 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1484486c-88ea-43c3-b6bb-c185da32f7bc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:12.652330 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1484486c-88ea-43c3-b6bb-c185da32f7bc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:12.653150 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1484486c-88ea-43c3-b6bb-c185da32f7bc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:12.653582 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1484486c-88ea-43c3-b6bb-c185da32f7bc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:12.684215 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1484486c-88ea-43c3-b6bb-c185da32f7bc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045618 Apr 06 16:43:12.684829 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 358/737] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:12 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:13.151938 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9ed2f690-f3c4-4765-ac95-c8eec99ac0be tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:13.152907 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9ed2f690-f3c4-4765-ac95-c8eec99ac0be tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:13.160721 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ed2f690-f3c4-4765-ac95-c8eec99ac0be tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:13.161314 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ed2f690-f3c4-4765-ac95-c8eec99ac0be tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:13.162096 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ed2f690-f3c4-4765-ac95-c8eec99ac0be tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:13.162524 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ed2f690-f3c4-4765-ac95-c8eec99ac0be tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:13.197198 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9ed2f690-f3c4-4765-ac95-c8eec99ac0be tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049042 Apr 06 16:43:13.197943 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 380/738] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:13 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:13.696326 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e17fc178-9301-4e8a-afbb-20379ee17db6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:13.697301 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e17fc178-9301-4e8a-afbb-20379ee17db6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:13.704360 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e17fc178-9301-4e8a-afbb-20379ee17db6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:13.704823 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e17fc178-9301-4e8a-afbb-20379ee17db6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:13.705605 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e17fc178-9301-4e8a-afbb-20379ee17db6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:13.706027 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e17fc178-9301-4e8a-afbb-20379ee17db6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:13.737467 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e17fc178-9301-4e8a-afbb-20379ee17db6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045324 Apr 06 16:43:13.738039 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 359/739] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:13 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:14.209720 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6780eccc-e753-48aa-8bc8-2adf9fd0c77e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:14.210847 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6780eccc-e753-48aa-8bc8-2adf9fd0c77e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:14.217126 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6780eccc-e753-48aa-8bc8-2adf9fd0c77e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:14.217607 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6780eccc-e753-48aa-8bc8-2adf9fd0c77e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:14.218796 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6780eccc-e753-48aa-8bc8-2adf9fd0c77e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:14.219238 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6780eccc-e753-48aa-8bc8-2adf9fd0c77e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:14.257868 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6780eccc-e753-48aa-8bc8-2adf9fd0c77e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052230 Apr 06 16:43:14.258454 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 381/740] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:14 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:14.751413 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-df8d864f-db37-4b36-a23a-69175990eaea tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:14.752240 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-df8d864f-db37-4b36-a23a-69175990eaea tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:14.759165 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df8d864f-db37-4b36-a23a-69175990eaea tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:14.759585 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df8d864f-db37-4b36-a23a-69175990eaea tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:14.760361 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df8d864f-db37-4b36-a23a-69175990eaea tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:14.760824 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df8d864f-db37-4b36-a23a-69175990eaea tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:14.795147 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-df8d864f-db37-4b36-a23a-69175990eaea tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047879 Apr 06 16:43:14.795730 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 360/741] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:14 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:15.271062 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5e4ab953-9f32-4331-b176-ac2598affb55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:15.271963 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5e4ab953-9f32-4331-b176-ac2598affb55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:15.278374 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e4ab953-9f32-4331-b176-ac2598affb55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:15.278819 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e4ab953-9f32-4331-b176-ac2598affb55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:15.279706 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e4ab953-9f32-4331-b176-ac2598affb55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:15.280089 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e4ab953-9f32-4331-b176-ac2598affb55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:15.314636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5e4ab953-9f32-4331-b176-ac2598affb55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048472 Apr 06 16:43:15.315213 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 382/742] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:15 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:15.807540 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-50943128-cae2-45bb-ae5f-5c6e7f180452 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:15.808406 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-50943128-cae2-45bb-ae5f-5c6e7f180452 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:15.815556 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50943128-cae2-45bb-ae5f-5c6e7f180452 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:15.816011 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50943128-cae2-45bb-ae5f-5c6e7f180452 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:15.816835 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50943128-cae2-45bb-ae5f-5c6e7f180452 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:15.817294 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50943128-cae2-45bb-ae5f-5c6e7f180452 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:15.847832 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-50943128-cae2-45bb-ae5f-5c6e7f180452 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044339 Apr 06 16:43:15.848410 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 361/743] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:15 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:16.327128 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a466808b-aa24-4757-911b-a59ec758affc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:16.330436 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a466808b-aa24-4757-911b-a59ec758affc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:16.335539 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a466808b-aa24-4757-911b-a59ec758affc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:16.336057 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a466808b-aa24-4757-911b-a59ec758affc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:16.336947 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a466808b-aa24-4757-911b-a59ec758affc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:16.337649 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a466808b-aa24-4757-911b-a59ec758affc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:16.368294 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a466808b-aa24-4757-911b-a59ec758affc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045382 Apr 06 16:43:16.369139 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 383/744] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:16 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:16.860385 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7fc0bf25-eba5-454c-b23e-5d4502210ebc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:16.861510 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7fc0bf25-eba5-454c-b23e-5d4502210ebc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:16.869071 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fc0bf25-eba5-454c-b23e-5d4502210ebc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:16.869537 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fc0bf25-eba5-454c-b23e-5d4502210ebc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:16.870319 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fc0bf25-eba5-454c-b23e-5d4502210ebc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:16.870754 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fc0bf25-eba5-454c-b23e-5d4502210ebc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:16.902763 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7fc0bf25-eba5-454c-b23e-5d4502210ebc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046742 Apr 06 16:43:16.903340 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 362/745] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:16 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:17.379871 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6cc1d70b-3a1a-4154-8ab7-adc648ad1e27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:17.380836 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6cc1d70b-3a1a-4154-8ab7-adc648ad1e27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:17.386864 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6cc1d70b-3a1a-4154-8ab7-adc648ad1e27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:17.387319 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6cc1d70b-3a1a-4154-8ab7-adc648ad1e27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:17.388086 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6cc1d70b-3a1a-4154-8ab7-adc648ad1e27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:17.388526 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6cc1d70b-3a1a-4154-8ab7-adc648ad1e27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:17.421988 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6cc1d70b-3a1a-4154-8ab7-adc648ad1e27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046028 Apr 06 16:43:17.422570 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 384/746] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:17 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:17.915386 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-59e7f2f9-68a6-4ad9-a02a-448a237aa72f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:17.916377 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-59e7f2f9-68a6-4ad9-a02a-448a237aa72f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:17.923425 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59e7f2f9-68a6-4ad9-a02a-448a237aa72f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:17.923881 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59e7f2f9-68a6-4ad9-a02a-448a237aa72f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:17.924646 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59e7f2f9-68a6-4ad9-a02a-448a237aa72f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:17.925133 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59e7f2f9-68a6-4ad9-a02a-448a237aa72f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:17.955463 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-59e7f2f9-68a6-4ad9-a02a-448a237aa72f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043992 Apr 06 16:43:17.956037 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 363/747] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:17 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:18.434425 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8315376d-f1c6-4c81-a51d-3d9dea3089fc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:18.435355 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8315376d-f1c6-4c81-a51d-3d9dea3089fc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:18.441793 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8315376d-f1c6-4c81-a51d-3d9dea3089fc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:18.442243 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8315376d-f1c6-4c81-a51d-3d9dea3089fc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:18.443059 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8315376d-f1c6-4c81-a51d-3d9dea3089fc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:18.443521 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8315376d-f1c6-4c81-a51d-3d9dea3089fc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:18.474246 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8315376d-f1c6-4c81-a51d-3d9dea3089fc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043781 Apr 06 16:43:18.474854 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 385/748] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:18 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:18.967776 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-390a6a30-eb8d-428b-87f8-5177f341a7ad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:18.968780 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-390a6a30-eb8d-428b-87f8-5177f341a7ad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:18.975529 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-390a6a30-eb8d-428b-87f8-5177f341a7ad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:18.975977 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-390a6a30-eb8d-428b-87f8-5177f341a7ad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:18.976767 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-390a6a30-eb8d-428b-87f8-5177f341a7ad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:18.977230 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-390a6a30-eb8d-428b-87f8-5177f341a7ad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:19.007170 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-390a6a30-eb8d-428b-87f8-5177f341a7ad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043479 Apr 06 16:43:19.007725 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 364/749] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:18 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:19.487526 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c06ea4af-bfcd-40c3-b687-9209a47b855f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:19.488436 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c06ea4af-bfcd-40c3-b687-9209a47b855f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:19.494955 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c06ea4af-bfcd-40c3-b687-9209a47b855f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:19.495391 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c06ea4af-bfcd-40c3-b687-9209a47b855f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:19.496183 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c06ea4af-bfcd-40c3-b687-9209a47b855f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:19.496605 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c06ea4af-bfcd-40c3-b687-9209a47b855f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:19.532795 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c06ea4af-bfcd-40c3-b687-9209a47b855f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050227 Apr 06 16:43:19.533365 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 386/750] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:19 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:20.018812 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-202f49d2-7527-4960-9e64-32878871225d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:20.019647 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-202f49d2-7527-4960-9e64-32878871225d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:20.026227 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-202f49d2-7527-4960-9e64-32878871225d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:20.026680 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-202f49d2-7527-4960-9e64-32878871225d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:20.027447 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-202f49d2-7527-4960-9e64-32878871225d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:20.027882 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-202f49d2-7527-4960-9e64-32878871225d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:20.057161 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-202f49d2-7527-4960-9e64-32878871225d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042467 Apr 06 16:43:20.058092 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 365/751] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:20 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:20.550738 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-766b8b15-4836-4fa8-a115-775f2127e77f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:20.552155 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-766b8b15-4836-4fa8-a115-775f2127e77f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:20.561035 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-766b8b15-4836-4fa8-a115-775f2127e77f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:20.561717 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-766b8b15-4836-4fa8-a115-775f2127e77f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:20.562938 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-766b8b15-4836-4fa8-a115-775f2127e77f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:20.563706 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-766b8b15-4836-4fa8-a115-775f2127e77f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:20.596198 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-766b8b15-4836-4fa8-a115-775f2127e77f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052123 Apr 06 16:43:20.597207 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 387/752] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:20 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:21.069755 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c513f59e-b28f-4d58-b334-9ddfcee69a62 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:21.070681 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c513f59e-b28f-4d58-b334-9ddfcee69a62 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:21.077311 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c513f59e-b28f-4d58-b334-9ddfcee69a62 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:21.077762 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c513f59e-b28f-4d58-b334-9ddfcee69a62 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:21.079028 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c513f59e-b28f-4d58-b334-9ddfcee69a62 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:21.079481 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c513f59e-b28f-4d58-b334-9ddfcee69a62 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:21.109082 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c513f59e-b28f-4d58-b334-9ddfcee69a62 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043216 Apr 06 16:43:21.109715 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 366/753] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:21 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:21.610367 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6e58b60d-d8f6-4635-81ea-0be8be571cf0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:21.611210 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6e58b60d-d8f6-4635-81ea-0be8be571cf0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:21.617725 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e58b60d-d8f6-4635-81ea-0be8be571cf0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:21.618165 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e58b60d-d8f6-4635-81ea-0be8be571cf0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:21.618960 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e58b60d-d8f6-4635-81ea-0be8be571cf0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:21.619381 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e58b60d-d8f6-4635-81ea-0be8be571cf0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:21.650210 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6e58b60d-d8f6-4635-81ea-0be8be571cf0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044304 Apr 06 16:43:21.650777 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 388/754] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:21 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:22.121896 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d0d3a223-fed1-4b6d-af5c-f6ba584b7ce2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:22.122819 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d0d3a223-fed1-4b6d-af5c-f6ba584b7ce2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:22.129812 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0d3a223-fed1-4b6d-af5c-f6ba584b7ce2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:22.130255 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0d3a223-fed1-4b6d-af5c-f6ba584b7ce2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:22.131074 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0d3a223-fed1-4b6d-af5c-f6ba584b7ce2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:22.131502 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0d3a223-fed1-4b6d-af5c-f6ba584b7ce2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:22.162025 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d0d3a223-fed1-4b6d-af5c-f6ba584b7ce2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044056 Apr 06 16:43:22.162629 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 367/755] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:22 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:22.662301 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-86f4e71c-7020-4e4f-abd0-9db44d582161 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:22.663212 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-86f4e71c-7020-4e4f-abd0-9db44d582161 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:22.669515 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86f4e71c-7020-4e4f-abd0-9db44d582161 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:22.669964 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86f4e71c-7020-4e4f-abd0-9db44d582161 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:22.670691 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86f4e71c-7020-4e4f-abd0-9db44d582161 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:22.671125 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86f4e71c-7020-4e4f-abd0-9db44d582161 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:22.707923 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-86f4e71c-7020-4e4f-abd0-9db44d582161 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049556 Apr 06 16:43:22.708523 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 389/756] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:22 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:23.175989 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-833c7eb7-99af-4b46-9ab5-177460721dba tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:23.176978 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-833c7eb7-99af-4b46-9ab5-177460721dba tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:23.183952 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-833c7eb7-99af-4b46-9ab5-177460721dba tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:23.184406 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-833c7eb7-99af-4b46-9ab5-177460721dba tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:23.185220 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-833c7eb7-99af-4b46-9ab5-177460721dba tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:23.185669 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-833c7eb7-99af-4b46-9ab5-177460721dba tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:23.217068 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-833c7eb7-99af-4b46-9ab5-177460721dba tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045688 Apr 06 16:43:23.217646 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 368/757] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:23 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:23.719835 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1b396408-e735-48b1-a38f-6ce47f82faed tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:23.720852 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1b396408-e735-48b1-a38f-6ce47f82faed tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:23.728167 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b396408-e735-48b1-a38f-6ce47f82faed tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:23.728918 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b396408-e735-48b1-a38f-6ce47f82faed tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:23.730159 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b396408-e735-48b1-a38f-6ce47f82faed tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:23.730837 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b396408-e735-48b1-a38f-6ce47f82faed tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:23.762452 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1b396408-e735-48b1-a38f-6ce47f82faed tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046636 Apr 06 16:43:23.766477 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 390/758] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:23 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:24.232051 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-45869728-568d-4599-8406-700ddf2347c3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:24.233359 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-45869728-568d-4599-8406-700ddf2347c3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:24.240638 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45869728-568d-4599-8406-700ddf2347c3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:24.241108 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45869728-568d-4599-8406-700ddf2347c3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:24.241873 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45869728-568d-4599-8406-700ddf2347c3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:24.242689 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45869728-568d-4599-8406-700ddf2347c3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:24.271960 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-45869728-568d-4599-8406-700ddf2347c3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045462 Apr 06 16:43:24.272520 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 369/759] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:24 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:24.776958 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-11e70825-f7f4-4364-a342-63b546c68559 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:24.778215 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-11e70825-f7f4-4364-a342-63b546c68559 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:24.789183 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11e70825-f7f4-4364-a342-63b546c68559 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:24.789183 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11e70825-f7f4-4364-a342-63b546c68559 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:24.790156 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11e70825-f7f4-4364-a342-63b546c68559 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:24.790811 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11e70825-f7f4-4364-a342-63b546c68559 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:24.832047 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-11e70825-f7f4-4364-a342-63b546c68559 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060705 Apr 06 16:43:24.832616 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 391/760] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:24 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:25.284503 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9e8a789a-d292-4181-aa1d-67bfa334a141 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:25.285471 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9e8a789a-d292-4181-aa1d-67bfa334a141 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:25.292323 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e8a789a-d292-4181-aa1d-67bfa334a141 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:25.292795 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e8a789a-d292-4181-aa1d-67bfa334a141 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:25.293570 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e8a789a-d292-4181-aa1d-67bfa334a141 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:25.294002 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e8a789a-d292-4181-aa1d-67bfa334a141 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:25.325211 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9e8a789a-d292-4181-aa1d-67bfa334a141 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045321 Apr 06 16:43:25.325758 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 370/761] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:25 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:25.843584 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5b692e2f-bda0-4a02-ad45-f35d381ac0cf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:25.844718 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5b692e2f-bda0-4a02-ad45-f35d381ac0cf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:25.851115 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b692e2f-bda0-4a02-ad45-f35d381ac0cf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:25.851548 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b692e2f-bda0-4a02-ad45-f35d381ac0cf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:25.852302 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b692e2f-bda0-4a02-ad45-f35d381ac0cf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:25.852723 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b692e2f-bda0-4a02-ad45-f35d381ac0cf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:25.882772 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5b692e2f-bda0-4a02-ad45-f35d381ac0cf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043148 Apr 06 16:43:25.883338 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 392/762] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:25 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:26.338314 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b97361ce-582b-4b7b-8b81-418de2674437 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:26.339292 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b97361ce-582b-4b7b-8b81-418de2674437 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:26.346154 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b97361ce-582b-4b7b-8b81-418de2674437 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:26.346600 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b97361ce-582b-4b7b-8b81-418de2674437 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:26.347366 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b97361ce-582b-4b7b-8b81-418de2674437 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:26.347883 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b97361ce-582b-4b7b-8b81-418de2674437 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:26.383860 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b97361ce-582b-4b7b-8b81-418de2674437 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049774 Apr 06 16:43:26.384429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 371/763] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:26 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:26.894866 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-003397e5-f797-45a5-a20a-e9b46a53c20a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:26.895783 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-003397e5-f797-45a5-a20a-e9b46a53c20a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:26.901943 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-003397e5-f797-45a5-a20a-e9b46a53c20a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:26.902398 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-003397e5-f797-45a5-a20a-e9b46a53c20a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:26.903152 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-003397e5-f797-45a5-a20a-e9b46a53c20a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:26.903598 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-003397e5-f797-45a5-a20a-e9b46a53c20a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:26.933622 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-003397e5-f797-45a5-a20a-e9b46a53c20a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042980 Apr 06 16:43:26.934212 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 393/764] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:26 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:27.395698 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-821fd168-a75d-4a00-8581-7a5c686baabb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:27.396622 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-821fd168-a75d-4a00-8581-7a5c686baabb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:27.403360 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-821fd168-a75d-4a00-8581-7a5c686baabb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:27.403804 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-821fd168-a75d-4a00-8581-7a5c686baabb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:27.404566 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-821fd168-a75d-4a00-8581-7a5c686baabb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:27.405020 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-821fd168-a75d-4a00-8581-7a5c686baabb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:27.434404 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-821fd168-a75d-4a00-8581-7a5c686baabb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043104 Apr 06 16:43:27.435009 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 372/765] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:27 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:27.949127 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9d847142-44dc-499b-9fad-656c2421c3e8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:27.949127 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9d847142-44dc-499b-9fad-656c2421c3e8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:27.954682 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d847142-44dc-499b-9fad-656c2421c3e8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:27.955283 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d847142-44dc-499b-9fad-656c2421c3e8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:27.956100 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d847142-44dc-499b-9fad-656c2421c3e8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:27.956723 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d847142-44dc-499b-9fad-656c2421c3e8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:27.987948 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9d847142-44dc-499b-9fad-656c2421c3e8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046022 Apr 06 16:43:27.988530 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 394/766] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:27 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:28.446701 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a5cd7cac-1f2f-4a98-ad13-03a9c887c8d5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:28.447625 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a5cd7cac-1f2f-4a98-ad13-03a9c887c8d5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:28.454376 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5cd7cac-1f2f-4a98-ad13-03a9c887c8d5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:28.454820 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5cd7cac-1f2f-4a98-ad13-03a9c887c8d5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:28.455487 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5cd7cac-1f2f-4a98-ad13-03a9c887c8d5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:28.455918 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5cd7cac-1f2f-4a98-ad13-03a9c887c8d5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:28.487646 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a5cd7cac-1f2f-4a98-ad13-03a9c887c8d5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044875 Apr 06 16:43:28.488352 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 373/767] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:28 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:29.001752 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d6dbd037-7d7a-4d37-8aab-59902110a272 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:29.002769 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d6dbd037-7d7a-4d37-8aab-59902110a272 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:29.009310 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6dbd037-7d7a-4d37-8aab-59902110a272 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:29.009747 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6dbd037-7d7a-4d37-8aab-59902110a272 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:29.010524 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6dbd037-7d7a-4d37-8aab-59902110a272 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:29.010976 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6dbd037-7d7a-4d37-8aab-59902110a272 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:29.040086 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d6dbd037-7d7a-4d37-8aab-59902110a272 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042730 Apr 06 16:43:29.040668 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 395/768] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:28 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:29.499956 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-81011524-47ae-49f3-b1ac-d58bb30ad7fd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:29.500975 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-81011524-47ae-49f3-b1ac-d58bb30ad7fd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:29.507961 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81011524-47ae-49f3-b1ac-d58bb30ad7fd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:29.508394 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81011524-47ae-49f3-b1ac-d58bb30ad7fd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:29.509213 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81011524-47ae-49f3-b1ac-d58bb30ad7fd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:29.509646 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81011524-47ae-49f3-b1ac-d58bb30ad7fd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:29.549429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-81011524-47ae-49f3-b1ac-d58bb30ad7fd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053518 Apr 06 16:43:29.550000 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 374/769] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:29 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:30.053032 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1d3658cf-9666-4085-9803-e7817ce03766 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:30.054078 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1d3658cf-9666-4085-9803-e7817ce03766 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:30.059971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d3658cf-9666-4085-9803-e7817ce03766 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:30.060416 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d3658cf-9666-4085-9803-e7817ce03766 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:30.061211 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d3658cf-9666-4085-9803-e7817ce03766 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:30.061637 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1d3658cf-9666-4085-9803-e7817ce03766 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:30.091685 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1d3658cf-9666-4085-9803-e7817ce03766 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042708 Apr 06 16:43:30.092191 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 396/770] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:30 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:30.565258 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6b104dec-20d3-442e-8cdf-91171b14f258 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:30.566341 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6b104dec-20d3-442e-8cdf-91171b14f258 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:30.574098 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b104dec-20d3-442e-8cdf-91171b14f258 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:30.574617 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b104dec-20d3-442e-8cdf-91171b14f258 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:30.575503 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b104dec-20d3-442e-8cdf-91171b14f258 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:30.576000 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b104dec-20d3-442e-8cdf-91171b14f258 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:30.607883 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6b104dec-20d3-442e-8cdf-91171b14f258 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048912 Apr 06 16:43:30.608350 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 375/771] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:30 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:31.107917 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b04d8a12-189c-42d6-96bd-65988a5b89e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:31.109444 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b04d8a12-189c-42d6-96bd-65988a5b89e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:31.117437 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b04d8a12-189c-42d6-96bd-65988a5b89e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:31.117888 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b04d8a12-189c-42d6-96bd-65988a5b89e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:31.118858 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b04d8a12-189c-42d6-96bd-65988a5b89e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:31.119078 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b04d8a12-189c-42d6-96bd-65988a5b89e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:31.149998 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b04d8a12-189c-42d6-96bd-65988a5b89e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048804 Apr 06 16:43:31.150591 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 397/772] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:31 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:31.620415 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-468bb468-1de4-4777-bab6-f4f08066d457 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:31.621361 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-468bb468-1de4-4777-bab6-f4f08066d457 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:31.627965 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-468bb468-1de4-4777-bab6-f4f08066d457 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:31.628417 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-468bb468-1de4-4777-bab6-f4f08066d457 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:31.629374 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-468bb468-1de4-4777-bab6-f4f08066d457 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:31.629798 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-468bb468-1de4-4777-bab6-f4f08066d457 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:31.659596 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-468bb468-1de4-4777-bab6-f4f08066d457 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043523 Apr 06 16:43:31.660141 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 376/773] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:31 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:32.163418 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a82ba0d3-dd83-4615-93ad-717c896af063 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:32.164374 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a82ba0d3-dd83-4615-93ad-717c896af063 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:32.170635 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a82ba0d3-dd83-4615-93ad-717c896af063 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:32.171083 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a82ba0d3-dd83-4615-93ad-717c896af063 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:32.171850 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a82ba0d3-dd83-4615-93ad-717c896af063 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:32.172283 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a82ba0d3-dd83-4615-93ad-717c896af063 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:32.207237 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a82ba0d3-dd83-4615-93ad-717c896af063 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048626 Apr 06 16:43:32.208052 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 398/774] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:32 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:32.673693 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b6b8ea3a-509d-40e8-b728-13e1c4d91c09 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:32.674637 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b6b8ea3a-509d-40e8-b728-13e1c4d91c09 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:32.681344 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6b8ea3a-509d-40e8-b728-13e1c4d91c09 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:32.681798 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6b8ea3a-509d-40e8-b728-13e1c4d91c09 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:32.682576 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6b8ea3a-509d-40e8-b728-13e1c4d91c09 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:32.683019 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6b8ea3a-509d-40e8-b728-13e1c4d91c09 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:32.715270 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b6b8ea3a-509d-40e8-b728-13e1c4d91c09 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045737 Apr 06 16:43:32.715832 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 377/775] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:32 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:33.223146 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-660951f0-4950-4235-9cc0-0939546f29cf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:33.224370 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-660951f0-4950-4235-9cc0-0939546f29cf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:33.230786 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-660951f0-4950-4235-9cc0-0939546f29cf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:33.231232 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-660951f0-4950-4235-9cc0-0939546f29cf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:33.232167 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-660951f0-4950-4235-9cc0-0939546f29cf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:33.232610 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-660951f0-4950-4235-9cc0-0939546f29cf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:33.270182 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-660951f0-4950-4235-9cc0-0939546f29cf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053789 Apr 06 16:43:33.270770 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 399/776] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:33 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:33.734194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-491bd628-82fb-4146-ab29-6b01fa452e40 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:33.735716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-491bd628-82fb-4146-ab29-6b01fa452e40 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:33.744229 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-491bd628-82fb-4146-ab29-6b01fa452e40 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:33.744709 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-491bd628-82fb-4146-ab29-6b01fa452e40 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:33.745499 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-491bd628-82fb-4146-ab29-6b01fa452e40 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:33.745930 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-491bd628-82fb-4146-ab29-6b01fa452e40 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:33.776755 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-491bd628-82fb-4146-ab29-6b01fa452e40 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049961 Apr 06 16:43:33.777249 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 378/777] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:33 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:34.283210 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a3ca20a0-c9ca-4cff-81bc-244d092bc701 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:34.284580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a3ca20a0-c9ca-4cff-81bc-244d092bc701 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:34.291399 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3ca20a0-c9ca-4cff-81bc-244d092bc701 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:34.291866 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3ca20a0-c9ca-4cff-81bc-244d092bc701 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:34.292658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3ca20a0-c9ca-4cff-81bc-244d092bc701 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:34.293135 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3ca20a0-c9ca-4cff-81bc-244d092bc701 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:34.327544 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a3ca20a0-c9ca-4cff-81bc-244d092bc701 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049024 Apr 06 16:43:34.328133 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 400/778] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:34 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:34.790153 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f03137a4-c426-4937-87c9-4b4eb548d904 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:34.791083 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f03137a4-c426-4937-87c9-4b4eb548d904 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:34.804618 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f03137a4-c426-4937-87c9-4b4eb548d904 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:34.805132 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f03137a4-c426-4937-87c9-4b4eb548d904 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:34.806008 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f03137a4-c426-4937-87c9-4b4eb548d904 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:34.806575 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f03137a4-c426-4937-87c9-4b4eb548d904 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:34.839835 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f03137a4-c426-4937-87c9-4b4eb548d904 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054621 Apr 06 16:43:34.840386 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 379/779] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:34 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:35.339947 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9dad5d85-86d8-45b4-89a3-98cfa5f95f61 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:35.340902 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9dad5d85-86d8-45b4-89a3-98cfa5f95f61 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:35.346838 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dad5d85-86d8-45b4-89a3-98cfa5f95f61 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:35.347288 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dad5d85-86d8-45b4-89a3-98cfa5f95f61 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:35.348063 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dad5d85-86d8-45b4-89a3-98cfa5f95f61 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:35.348502 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dad5d85-86d8-45b4-89a3-98cfa5f95f61 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:35.379003 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9dad5d85-86d8-45b4-89a3-98cfa5f95f61 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043091 Apr 06 16:43:35.379603 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 401/780] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:35 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:35.857263 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cba513b9-1250-48bf-abbb-dadf5a590665 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:35.862272 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cba513b9-1250-48bf-abbb-dadf5a590665 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:35.870406 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cba513b9-1250-48bf-abbb-dadf5a590665 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:35.870896 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cba513b9-1250-48bf-abbb-dadf5a590665 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:35.872093 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cba513b9-1250-48bf-abbb-dadf5a590665 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:35.872839 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cba513b9-1250-48bf-abbb-dadf5a590665 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:35.906021 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cba513b9-1250-48bf-abbb-dadf5a590665 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056326 Apr 06 16:43:35.906808 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 380/781] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:35 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:36.393518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-10f04f23-656b-4379-85bb-e244b1bba1f0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:36.394450 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-10f04f23-656b-4379-85bb-e244b1bba1f0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:36.401584 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10f04f23-656b-4379-85bb-e244b1bba1f0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:36.402035 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10f04f23-656b-4379-85bb-e244b1bba1f0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:36.402801 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10f04f23-656b-4379-85bb-e244b1bba1f0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:36.403234 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10f04f23-656b-4379-85bb-e244b1bba1f0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:36.433019 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-10f04f23-656b-4379-85bb-e244b1bba1f0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045642 Apr 06 16:43:36.433595 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 402/782] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:36 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:36.921754 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-75bafbce-2eb6-4add-b5d8-cc6cba5ccf67 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:36.922892 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-75bafbce-2eb6-4add-b5d8-cc6cba5ccf67 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:36.931225 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75bafbce-2eb6-4add-b5d8-cc6cba5ccf67 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:36.931789 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75bafbce-2eb6-4add-b5d8-cc6cba5ccf67 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:36.932745 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75bafbce-2eb6-4add-b5d8-cc6cba5ccf67 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:36.933320 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75bafbce-2eb6-4add-b5d8-cc6cba5ccf67 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:36.965394 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-75bafbce-2eb6-4add-b5d8-cc6cba5ccf67 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048670 Apr 06 16:43:36.965953 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 381/783] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:36 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:37.444878 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7a35a200-5cfc-4235-93f4-81d9ab3c16c3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:37.445807 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7a35a200-5cfc-4235-93f4-81d9ab3c16c3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:37.452397 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a35a200-5cfc-4235-93f4-81d9ab3c16c3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:37.452900 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a35a200-5cfc-4235-93f4-81d9ab3c16c3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:37.453660 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a35a200-5cfc-4235-93f4-81d9ab3c16c3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:37.454092 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a35a200-5cfc-4235-93f4-81d9ab3c16c3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:37.486278 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7a35a200-5cfc-4235-93f4-81d9ab3c16c3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045225 Apr 06 16:43:37.487167 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 403/784] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:37 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:38.174279 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4caa9f2d-5bb5-41cb-9d76-1f57969979aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:38.175290 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4caa9f2d-5bb5-41cb-9d76-1f57969979aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:38.181889 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4caa9f2d-5bb5-41cb-9d76-1f57969979aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:38.182336 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4caa9f2d-5bb5-41cb-9d76-1f57969979aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:38.183131 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4caa9f2d-5bb5-41cb-9d76-1f57969979aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:38.183568 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4caa9f2d-5bb5-41cb-9d76-1f57969979aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:38.212795 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4caa9f2d-5bb5-41cb-9d76-1f57969979aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.238678 Apr 06 16:43:38.213374 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 382/785] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:37 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:38.503149 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9dbdd43a-7c22-4715-b41e-fea5797a3927 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:38.504708 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9dbdd43a-7c22-4715-b41e-fea5797a3927 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:38.512663 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dbdd43a-7c22-4715-b41e-fea5797a3927 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:38.513169 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dbdd43a-7c22-4715-b41e-fea5797a3927 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:38.513989 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dbdd43a-7c22-4715-b41e-fea5797a3927 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:38.514406 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dbdd43a-7c22-4715-b41e-fea5797a3927 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:38.544093 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9dbdd43a-7c22-4715-b41e-fea5797a3927 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047457 Apr 06 16:43:38.544773 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 404/786] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:38 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:39.224991 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-50a2f2dd-c5f7-475a-b2d3-4dc40e97ae02 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:39.226047 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-50a2f2dd-c5f7-475a-b2d3-4dc40e97ae02 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:39.233243 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50a2f2dd-c5f7-475a-b2d3-4dc40e97ae02 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:39.233697 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50a2f2dd-c5f7-475a-b2d3-4dc40e97ae02 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:39.234474 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50a2f2dd-c5f7-475a-b2d3-4dc40e97ae02 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:39.234906 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50a2f2dd-c5f7-475a-b2d3-4dc40e97ae02 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:39.270746 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-50a2f2dd-c5f7-475a-b2d3-4dc40e97ae02 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049387 Apr 06 16:43:39.271163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 383/787] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:39 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:39.558090 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d4790cb7-6ac4-4a4f-941c-20b87eb4c306 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:39.559017 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d4790cb7-6ac4-4a4f-941c-20b87eb4c306 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:39.565661 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4790cb7-6ac4-4a4f-941c-20b87eb4c306 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:39.566127 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4790cb7-6ac4-4a4f-941c-20b87eb4c306 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:39.566904 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4790cb7-6ac4-4a4f-941c-20b87eb4c306 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:39.567334 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4790cb7-6ac4-4a4f-941c-20b87eb4c306 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:39.599351 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d4790cb7-6ac4-4a4f-941c-20b87eb4c306 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045715 Apr 06 16:43:39.603809 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 405/788] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:39 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:40.289577 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2826a76e-d930-48e6-bf02-fac880e95954 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:40.290388 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2826a76e-d930-48e6-bf02-fac880e95954 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:40.297147 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2826a76e-d930-48e6-bf02-fac880e95954 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:40.297598 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2826a76e-d930-48e6-bf02-fac880e95954 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:40.298571 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2826a76e-d930-48e6-bf02-fac880e95954 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:40.298999 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2826a76e-d930-48e6-bf02-fac880e95954 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:40.337478 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2826a76e-d930-48e6-bf02-fac880e95954 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052213 Apr 06 16:43:40.338044 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 384/789] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:40 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:40.611878 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fbc9ec38-2b9b-4292-ba76-8b5954f327e4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:40.612837 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fbc9ec38-2b9b-4292-ba76-8b5954f327e4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:40.619621 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbc9ec38-2b9b-4292-ba76-8b5954f327e4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:40.620067 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbc9ec38-2b9b-4292-ba76-8b5954f327e4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:40.620880 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbc9ec38-2b9b-4292-ba76-8b5954f327e4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:40.621308 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbc9ec38-2b9b-4292-ba76-8b5954f327e4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:40.650690 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fbc9ec38-2b9b-4292-ba76-8b5954f327e4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042805 Apr 06 16:43:40.651467 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 406/790] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:40 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:41.352574 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2cd2d81a-f5f7-4338-a100-100437cc9fe6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:41.353539 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2cd2d81a-f5f7-4338-a100-100437cc9fe6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:41.360006 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cd2d81a-f5f7-4338-a100-100437cc9fe6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:41.360472 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cd2d81a-f5f7-4338-a100-100437cc9fe6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:41.361283 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cd2d81a-f5f7-4338-a100-100437cc9fe6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:41.361718 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cd2d81a-f5f7-4338-a100-100437cc9fe6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:41.391044 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2cd2d81a-f5f7-4338-a100-100437cc9fe6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045149 Apr 06 16:43:41.391598 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 385/791] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:41 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:41.667526 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2ee1884d-dcd6-4696-928c-38cd15c76c68 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:41.669105 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2ee1884d-dcd6-4696-928c-38cd15c76c68 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:41.679577 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ee1884d-dcd6-4696-928c-38cd15c76c68 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:41.680034 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ee1884d-dcd6-4696-928c-38cd15c76c68 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:41.680861 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ee1884d-dcd6-4696-928c-38cd15c76c68 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:41.681322 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ee1884d-dcd6-4696-928c-38cd15c76c68 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:41.710660 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2ee1884d-dcd6-4696-928c-38cd15c76c68 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050115 Apr 06 16:43:41.714765 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 407/792] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:41 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:42.403399 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-745f406e-7716-4986-8244-e850f996bc87 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:42.404439 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-745f406e-7716-4986-8244-e850f996bc87 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:42.411494 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-745f406e-7716-4986-8244-e850f996bc87 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:42.411965 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-745f406e-7716-4986-8244-e850f996bc87 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:42.412821 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-745f406e-7716-4986-8244-e850f996bc87 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:42.413293 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-745f406e-7716-4986-8244-e850f996bc87 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:42.444010 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-745f406e-7716-4986-8244-e850f996bc87 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044850 Apr 06 16:43:42.444566 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 386/793] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:42 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:42.726970 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c0d70da7-a16f-4a1d-8ef2-d539db8c01f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:42.728053 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c0d70da7-a16f-4a1d-8ef2-d539db8c01f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:42.734850 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0d70da7-a16f-4a1d-8ef2-d539db8c01f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:42.735035 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0d70da7-a16f-4a1d-8ef2-d539db8c01f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:42.735894 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0d70da7-a16f-4a1d-8ef2-d539db8c01f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:42.736237 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c0d70da7-a16f-4a1d-8ef2-d539db8c01f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:42.766556 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c0d70da7-a16f-4a1d-8ef2-d539db8c01f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046240 Apr 06 16:43:42.767331 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 408/794] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:42 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:43.460286 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bcb12fdd-2b85-4269-b969-091c71e64273 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:43.461313 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bcb12fdd-2b85-4269-b969-091c71e64273 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:43.468643 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcb12fdd-2b85-4269-b969-091c71e64273 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:43.469168 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcb12fdd-2b85-4269-b969-091c71e64273 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:43.470006 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcb12fdd-2b85-4269-b969-091c71e64273 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:43.470479 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcb12fdd-2b85-4269-b969-091c71e64273 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:43.502291 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bcb12fdd-2b85-4269-b969-091c71e64273 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048750 Apr 06 16:43:43.502846 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 387/795] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:43 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:43.779357 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-626b5b52-1e2a-4a18-92e4-74be1f403f82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:43.780352 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-626b5b52-1e2a-4a18-92e4-74be1f403f82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:43.787804 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-626b5b52-1e2a-4a18-92e4-74be1f403f82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:43.788470 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-626b5b52-1e2a-4a18-92e4-74be1f403f82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:43.789342 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-626b5b52-1e2a-4a18-92e4-74be1f403f82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:43.789778 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-626b5b52-1e2a-4a18-92e4-74be1f403f82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:43.819918 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-626b5b52-1e2a-4a18-92e4-74be1f403f82 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045280 Apr 06 16:43:43.820483 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 409/796] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:43 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:44.519015 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c9df225a-bee6-426e-816b-caf6ccc2d1d9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:44.520526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c9df225a-bee6-426e-816b-caf6ccc2d1d9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:44.531391 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9df225a-bee6-426e-816b-caf6ccc2d1d9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:44.532141 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9df225a-bee6-426e-816b-caf6ccc2d1d9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:44.533466 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9df225a-bee6-426e-816b-caf6ccc2d1d9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:44.534192 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9df225a-bee6-426e-816b-caf6ccc2d1d9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:44.564735 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c9df225a-bee6-426e-816b-caf6ccc2d1d9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052485 Apr 06 16:43:44.565309 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 388/797] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:44 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:44.836052 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b55ec37a-98cf-4d34-b462-c8d9b092d800 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:44.837116 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b55ec37a-98cf-4d34-b462-c8d9b092d800 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:44.844500 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b55ec37a-98cf-4d34-b462-c8d9b092d800 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:44.845038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b55ec37a-98cf-4d34-b462-c8d9b092d800 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:44.845895 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b55ec37a-98cf-4d34-b462-c8d9b092d800 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:44.846376 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b55ec37a-98cf-4d34-b462-c8d9b092d800 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:44.878437 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b55ec37a-98cf-4d34-b462-c8d9b092d800 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048896 Apr 06 16:43:44.878998 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 410/798] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:44 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:45.581667 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f7362b12-27b6-4b29-b12e-917a60ed94e2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:45.583200 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f7362b12-27b6-4b29-b12e-917a60ed94e2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:45.590958 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7362b12-27b6-4b29-b12e-917a60ed94e2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:45.591405 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7362b12-27b6-4b29-b12e-917a60ed94e2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:45.592170 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7362b12-27b6-4b29-b12e-917a60ed94e2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:45.592603 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7362b12-27b6-4b29-b12e-917a60ed94e2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:45.622486 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f7362b12-27b6-4b29-b12e-917a60ed94e2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047518 Apr 06 16:43:45.623037 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 389/799] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:45 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:45.890842 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-65149a1e-a0f1-4cc7-8dca-d2ffa4737591 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:45.891778 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-65149a1e-a0f1-4cc7-8dca-d2ffa4737591 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:45.898245 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65149a1e-a0f1-4cc7-8dca-d2ffa4737591 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:45.898690 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65149a1e-a0f1-4cc7-8dca-d2ffa4737591 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:45.899460 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65149a1e-a0f1-4cc7-8dca-d2ffa4737591 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:45.899886 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65149a1e-a0f1-4cc7-8dca-d2ffa4737591 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:45.928638 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-65149a1e-a0f1-4cc7-8dca-d2ffa4737591 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041797 Apr 06 16:43:45.929554 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 411/800] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:45 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:46.074672 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-15b4f053-6488-4cc4-a855-9a1f14603874 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d4799f2-e011-436f-8dd8-4ec8516b79be"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:43:46.075738 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-15b4f053-6488-4cc4-a855-9a1f14603874 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:46.082001 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15b4f053-6488-4cc4-a855-9a1f14603874 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:46.082451 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15b4f053-6488-4cc4-a855-9a1f14603874 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:46.083251 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15b4f053-6488-4cc4-a855-9a1f14603874 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:46.083690 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15b4f053-6488-4cc4-a855-9a1f14603874 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:46.461321 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-15b4f053-6488-4cc4-a855-9a1f14603874 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "POST /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.390754 Apr 06 16:43:46.462176 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 390/801] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Apr 6 16:43:46 2022] POST /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718/os-volume_attachments => generated 194 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:46.635672 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7c34ef9a-a936-49ed-8cd5-d00246bf209d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:46.636607 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7c34ef9a-a936-49ed-8cd5-d00246bf209d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:46.643223 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c34ef9a-a936-49ed-8cd5-d00246bf209d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:46.643679 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c34ef9a-a936-49ed-8cd5-d00246bf209d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:46.644438 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c34ef9a-a936-49ed-8cd5-d00246bf209d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:46.644924 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c34ef9a-a936-49ed-8cd5-d00246bf209d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:46.674420 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7c34ef9a-a936-49ed-8cd5-d00246bf209d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042896 Apr 06 16:43:46.674976 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 412/802] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:46 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:47.042802 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-828be0c0-f388-4bbd-a487-341140504bb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:47.043787 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-828be0c0-f388-4bbd-a487-341140504bb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:47.050208 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-828be0c0-f388-4bbd-a487-341140504bb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:47.050588 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-828be0c0-f388-4bbd-a487-341140504bb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:47.051346 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-828be0c0-f388-4bbd-a487-341140504bb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:47.051773 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-828be0c0-f388-4bbd-a487-341140504bb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:47.081157 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-828be0c0-f388-4bbd-a487-341140504bb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.142958 Apr 06 16:43:47.081703 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 391/803] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:46 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:47.688151 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4decf3ac-b9ad-42b4-a6e1-730ea2ce114a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:47.689142 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4decf3ac-b9ad-42b4-a6e1-730ea2ce114a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:47.695917 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4decf3ac-b9ad-42b4-a6e1-730ea2ce114a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:47.696353 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4decf3ac-b9ad-42b4-a6e1-730ea2ce114a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:47.697153 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4decf3ac-b9ad-42b4-a6e1-730ea2ce114a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:47.697591 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4decf3ac-b9ad-42b4-a6e1-730ea2ce114a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:47.727004 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4decf3ac-b9ad-42b4-a6e1-730ea2ce114a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043130 Apr 06 16:43:47.727570 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 413/804] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:47 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:48.093836 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-043dc2cb-0819-4d8a-a50d-d5d2155b8846 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:48.094799 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-043dc2cb-0819-4d8a-a50d-d5d2155b8846 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:48.102413 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-043dc2cb-0819-4d8a-a50d-d5d2155b8846 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:48.102874 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-043dc2cb-0819-4d8a-a50d-d5d2155b8846 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:48.103650 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-043dc2cb-0819-4d8a-a50d-d5d2155b8846 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:48.104081 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-043dc2cb-0819-4d8a-a50d-d5d2155b8846 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:48.134707 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-043dc2cb-0819-4d8a-a50d-d5d2155b8846 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044898 Apr 06 16:43:48.135261 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 392/805] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:48 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:48.738539 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5e1f8b26-dcd0-40b8-a41a-be41196d30a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:48.739370 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5e1f8b26-dcd0-40b8-a41a-be41196d30a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:48.747428 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e1f8b26-dcd0-40b8-a41a-be41196d30a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:48.748077 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e1f8b26-dcd0-40b8-a41a-be41196d30a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:48.749119 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e1f8b26-dcd0-40b8-a41a-be41196d30a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:48.749708 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5e1f8b26-dcd0-40b8-a41a-be41196d30a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:48.786632 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5e1f8b26-dcd0-40b8-a41a-be41196d30a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052009 Apr 06 16:43:48.787421 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 414/806] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:48 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:49.147203 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e09ac529-b489-43c2-82c7-037c29b89b5a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:49.148191 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e09ac529-b489-43c2-82c7-037c29b89b5a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:49.154996 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e09ac529-b489-43c2-82c7-037c29b89b5a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:49.155449 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e09ac529-b489-43c2-82c7-037c29b89b5a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:49.156228 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e09ac529-b489-43c2-82c7-037c29b89b5a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:49.156751 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e09ac529-b489-43c2-82c7-037c29b89b5a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:49.186096 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e09ac529-b489-43c2-82c7-037c29b89b5a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043072 Apr 06 16:43:49.186631 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 393/807] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:49 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:49.799986 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8a000b69-05da-4a9d-8241-21bb98c718f2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:49.800974 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8a000b69-05da-4a9d-8241-21bb98c718f2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:49.807854 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a000b69-05da-4a9d-8241-21bb98c718f2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:49.808421 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a000b69-05da-4a9d-8241-21bb98c718f2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:49.809465 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a000b69-05da-4a9d-8241-21bb98c718f2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:49.809843 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a000b69-05da-4a9d-8241-21bb98c718f2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:49.839668 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8a000b69-05da-4a9d-8241-21bb98c718f2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043667 Apr 06 16:43:49.840217 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 415/808] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:49 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:50.199014 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ace41a0b-2c4e-47e6-b79f-7eae6947222b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:50.199938 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ace41a0b-2c4e-47e6-b79f-7eae6947222b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:50.206540 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ace41a0b-2c4e-47e6-b79f-7eae6947222b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:50.206991 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ace41a0b-2c4e-47e6-b79f-7eae6947222b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:50.207755 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ace41a0b-2c4e-47e6-b79f-7eae6947222b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:50.208192 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ace41a0b-2c4e-47e6-b79f-7eae6947222b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:50.239610 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ace41a0b-2c4e-47e6-b79f-7eae6947222b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045804 Apr 06 16:43:50.240184 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 394/809] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:50 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:50.853487 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-79b40091-d12e-4826-b03c-998e0c8742bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:50.854613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-79b40091-d12e-4826-b03c-998e0c8742bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:50.862162 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79b40091-d12e-4826-b03c-998e0c8742bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:50.862641 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79b40091-d12e-4826-b03c-998e0c8742bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:50.863492 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79b40091-d12e-4826-b03c-998e0c8742bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:50.863944 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79b40091-d12e-4826-b03c-998e0c8742bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:50.896824 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-79b40091-d12e-4826-b03c-998e0c8742bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048864 Apr 06 16:43:50.897480 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 416/810] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:50 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:51.252401 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8c49eb74-af36-4ab2-8f48-cb14a546fdcf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:51.253540 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8c49eb74-af36-4ab2-8f48-cb14a546fdcf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:51.260482 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c49eb74-af36-4ab2-8f48-cb14a546fdcf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:51.260967 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c49eb74-af36-4ab2-8f48-cb14a546fdcf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:51.261743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c49eb74-af36-4ab2-8f48-cb14a546fdcf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:51.262208 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c49eb74-af36-4ab2-8f48-cb14a546fdcf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:51.305267 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8c49eb74-af36-4ab2-8f48-cb14a546fdcf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056842 Apr 06 16:43:51.305862 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 395/811] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:51 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:51.909215 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b015bc2d-bdbf-40e4-b063-1476ad27f4f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:51.910138 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b015bc2d-bdbf-40e4-b063-1476ad27f4f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:51.917267 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b015bc2d-bdbf-40e4-b063-1476ad27f4f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:51.917713 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b015bc2d-bdbf-40e4-b063-1476ad27f4f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:51.918493 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b015bc2d-bdbf-40e4-b063-1476ad27f4f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:51.918957 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b015bc2d-bdbf-40e4-b063-1476ad27f4f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:51.952484 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b015bc2d-bdbf-40e4-b063-1476ad27f4f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047288 Apr 06 16:43:51.953091 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 417/812] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:51 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:52.318009 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-209a25e4-c887-4339-abf4-abd18947c184 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:52.318937 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-209a25e4-c887-4339-abf4-abd18947c184 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:52.326162 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-209a25e4-c887-4339-abf4-abd18947c184 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:52.326621 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-209a25e4-c887-4339-abf4-abd18947c184 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:52.327409 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-209a25e4-c887-4339-abf4-abd18947c184 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:52.327834 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-209a25e4-c887-4339-abf4-abd18947c184 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:52.359106 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-209a25e4-c887-4339-abf4-abd18947c184 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045161 Apr 06 16:43:52.359677 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 396/813] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:52 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:52.964507 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-946d7737-6545-4d52-9e99-3dafb01b56a7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:52.965466 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-946d7737-6545-4d52-9e99-3dafb01b56a7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:52.971944 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-946d7737-6545-4d52-9e99-3dafb01b56a7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:52.972428 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-946d7737-6545-4d52-9e99-3dafb01b56a7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:52.973239 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-946d7737-6545-4d52-9e99-3dafb01b56a7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:52.973671 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-946d7737-6545-4d52-9e99-3dafb01b56a7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:53.003223 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-946d7737-6545-4d52-9e99-3dafb01b56a7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042667 Apr 06 16:43:53.003777 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 418/814] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:52 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:53.372093 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2fb1d46b-ce29-4894-a81c-0a3f473f7bc1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:53.373047 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2fb1d46b-ce29-4894-a81c-0a3f473f7bc1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:53.379624 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2fb1d46b-ce29-4894-a81c-0a3f473f7bc1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:53.380068 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2fb1d46b-ce29-4894-a81c-0a3f473f7bc1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:53.380865 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2fb1d46b-ce29-4894-a81c-0a3f473f7bc1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:53.381300 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2fb1d46b-ce29-4894-a81c-0a3f473f7bc1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:53.410669 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2fb1d46b-ce29-4894-a81c-0a3f473f7bc1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042624 Apr 06 16:43:53.411228 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 397/815] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:53 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:54.017561 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-88fc77f0-3725-491b-847d-1816428c114e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:54.018964 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-88fc77f0-3725-491b-847d-1816428c114e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:54.028367 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88fc77f0-3725-491b-847d-1816428c114e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:54.029086 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88fc77f0-3725-491b-847d-1816428c114e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:54.030064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88fc77f0-3725-491b-847d-1816428c114e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:54.030592 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88fc77f0-3725-491b-847d-1816428c114e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:54.062513 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-88fc77f0-3725-491b-847d-1816428c114e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050702 Apr 06 16:43:54.063080 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 419/816] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:54 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:54.425989 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1f86cc0d-c21f-4ba3-8316-f07edbfd1653 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:54.427440 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1f86cc0d-c21f-4ba3-8316-f07edbfd1653 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:54.434831 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f86cc0d-c21f-4ba3-8316-f07edbfd1653 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:54.435286 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f86cc0d-c21f-4ba3-8316-f07edbfd1653 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:54.436058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f86cc0d-c21f-4ba3-8316-f07edbfd1653 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:54.436492 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f86cc0d-c21f-4ba3-8316-f07edbfd1653 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:54.466253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1f86cc0d-c21f-4ba3-8316-f07edbfd1653 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047256 Apr 06 16:43:54.466906 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 398/817] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:54 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:55.074966 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4b007e48-8c1f-4336-836a-ddd69ecea8ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:55.075881 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4b007e48-8c1f-4336-836a-ddd69ecea8ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:55.082482 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b007e48-8c1f-4336-836a-ddd69ecea8ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:55.082936 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b007e48-8c1f-4336-836a-ddd69ecea8ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:55.083709 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b007e48-8c1f-4336-836a-ddd69ecea8ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:55.084142 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b007e48-8c1f-4336-836a-ddd69ecea8ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:55.113557 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4b007e48-8c1f-4336-836a-ddd69ecea8ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042591 Apr 06 16:43:55.114091 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 420/818] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:55 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:55.478935 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-44110642-b6b8-45fb-b442-43b5201b9100 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:55.479885 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-44110642-b6b8-45fb-b442-43b5201b9100 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:55.486565 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44110642-b6b8-45fb-b442-43b5201b9100 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:55.487020 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44110642-b6b8-45fb-b442-43b5201b9100 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:55.487809 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44110642-b6b8-45fb-b442-43b5201b9100 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:55.488237 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44110642-b6b8-45fb-b442-43b5201b9100 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:55.518043 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-44110642-b6b8-45fb-b442-43b5201b9100 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043774 Apr 06 16:43:55.518608 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 399/819] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:55 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:56.126304 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e08cda68-8a3d-48d3-bc40-7fad57d6fd91 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:56.127234 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e08cda68-8a3d-48d3-bc40-7fad57d6fd91 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:56.133867 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e08cda68-8a3d-48d3-bc40-7fad57d6fd91 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:56.134319 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e08cda68-8a3d-48d3-bc40-7fad57d6fd91 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:56.135092 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e08cda68-8a3d-48d3-bc40-7fad57d6fd91 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:56.135527 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e08cda68-8a3d-48d3-bc40-7fad57d6fd91 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:56.164629 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e08cda68-8a3d-48d3-bc40-7fad57d6fd91 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042318 Apr 06 16:43:56.165216 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 421/820] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:56 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:56.530250 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b593fb55-4b2f-4acc-bd85-b6c4c3c2cb6e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:56.531179 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b593fb55-4b2f-4acc-bd85-b6c4c3c2cb6e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:56.538024 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b593fb55-4b2f-4acc-bd85-b6c4c3c2cb6e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:56.538465 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b593fb55-4b2f-4acc-bd85-b6c4c3c2cb6e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:56.539266 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b593fb55-4b2f-4acc-bd85-b6c4c3c2cb6e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:56.539696 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b593fb55-4b2f-4acc-bd85-b6c4c3c2cb6e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:56.569000 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b593fb55-4b2f-4acc-bd85-b6c4c3c2cb6e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042784 Apr 06 16:43:56.569630 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 400/821] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:56 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:57.176041 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c1b643fe-2267-46bb-82ac-68ccb346d200 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:57.177066 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c1b643fe-2267-46bb-82ac-68ccb346d200 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:57.183756 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1b643fe-2267-46bb-82ac-68ccb346d200 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:57.184183 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1b643fe-2267-46bb-82ac-68ccb346d200 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:57.184980 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1b643fe-2267-46bb-82ac-68ccb346d200 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:57.185406 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1b643fe-2267-46bb-82ac-68ccb346d200 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:57.214746 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c1b643fe-2267-46bb-82ac-68ccb346d200 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042657 Apr 06 16:43:57.215291 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 422/822] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:57 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:57.581672 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d5067f5f-4c80-4a4f-abd5-c706abe12967 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:57.582555 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d5067f5f-4c80-4a4f-abd5-c706abe12967 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:57.589319 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5067f5f-4c80-4a4f-abd5-c706abe12967 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:57.589765 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5067f5f-4c80-4a4f-abd5-c706abe12967 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:57.590835 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5067f5f-4c80-4a4f-abd5-c706abe12967 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:57.591266 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5067f5f-4c80-4a4f-abd5-c706abe12967 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:57.620745 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d5067f5f-4c80-4a4f-abd5-c706abe12967 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043193 Apr 06 16:43:57.621328 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 401/823] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:57 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:58.227272 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-18d75007-b5d2-4404-975d-48c1cbacd4a3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:58.228191 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-18d75007-b5d2-4404-975d-48c1cbacd4a3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:58.234582 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18d75007-b5d2-4404-975d-48c1cbacd4a3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:58.235020 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18d75007-b5d2-4404-975d-48c1cbacd4a3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:58.235786 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18d75007-b5d2-4404-975d-48c1cbacd4a3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:58.236211 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18d75007-b5d2-4404-975d-48c1cbacd4a3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:58.266597 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-18d75007-b5d2-4404-975d-48c1cbacd4a3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043708 Apr 06 16:43:58.267149 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 423/824] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:58 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:58.633962 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7e1f6d56-d867-4fba-beb0-0d37e3897f87 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:58.634980 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7e1f6d56-d867-4fba-beb0-0d37e3897f87 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:58.641984 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e1f6d56-d867-4fba-beb0-0d37e3897f87 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:58.642441 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e1f6d56-d867-4fba-beb0-0d37e3897f87 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:58.643204 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e1f6d56-d867-4fba-beb0-0d37e3897f87 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:58.643636 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e1f6d56-d867-4fba-beb0-0d37e3897f87 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:58.672561 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7e1f6d56-d867-4fba-beb0-0d37e3897f87 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043262 Apr 06 16:43:58.673170 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 402/825] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:58 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:43:59.278776 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-29c2e747-168c-476e-a239-02cd3116e7ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:59.279764 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-29c2e747-168c-476e-a239-02cd3116e7ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:59.286815 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29c2e747-168c-476e-a239-02cd3116e7ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:59.287285 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29c2e747-168c-476e-a239-02cd3116e7ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:59.288137 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29c2e747-168c-476e-a239-02cd3116e7ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:59.288560 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29c2e747-168c-476e-a239-02cd3116e7ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:59.320061 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-29c2e747-168c-476e-a239-02cd3116e7ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045302 Apr 06 16:43:59.320611 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 424/826] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:43:59 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:43:59.685109 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-254a53eb-4ffb-46b1-abea-cabee7b87d7a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:43:59.686015 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-254a53eb-4ffb-46b1-abea-cabee7b87d7a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:43:59.692725 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-254a53eb-4ffb-46b1-abea-cabee7b87d7a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:59.693167 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-254a53eb-4ffb-46b1-abea-cabee7b87d7a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:59.693922 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-254a53eb-4ffb-46b1-abea-cabee7b87d7a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:43:59.694325 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-254a53eb-4ffb-46b1-abea-cabee7b87d7a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:43:59.723694 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-254a53eb-4ffb-46b1-abea-cabee7b87d7a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042560 Apr 06 16:43:59.724231 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 403/827] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:43:59 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:00.331979 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-29789007-dfbc-4a3f-b99b-b980f0e35248 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:00.332603 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-29789007-dfbc-4a3f-b99b-b980f0e35248 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:00.338810 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29789007-dfbc-4a3f-b99b-b980f0e35248 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:00.339252 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29789007-dfbc-4a3f-b99b-b980f0e35248 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:00.340006 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29789007-dfbc-4a3f-b99b-b980f0e35248 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:00.340427 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29789007-dfbc-4a3f-b99b-b980f0e35248 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:00.370402 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-29789007-dfbc-4a3f-b99b-b980f0e35248 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042684 Apr 06 16:44:00.370956 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 425/828] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:00 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:00.736638 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4bb85c68-d957-4e58-a644-ee321717da7c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:00.737630 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4bb85c68-d957-4e58-a644-ee321717da7c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:00.744552 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bb85c68-d957-4e58-a644-ee321717da7c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:00.745016 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bb85c68-d957-4e58-a644-ee321717da7c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:00.745813 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bb85c68-d957-4e58-a644-ee321717da7c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:00.746238 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bb85c68-d957-4e58-a644-ee321717da7c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:00.774993 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4bb85c68-d957-4e58-a644-ee321717da7c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042441 Apr 06 16:44:00.775568 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 404/829] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:00 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:01.382494 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-41af3c63-6d0c-4d36-9e6e-230cf42c9b2b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:01.383404 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-41af3c63-6d0c-4d36-9e6e-230cf42c9b2b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:01.389823 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41af3c63-6d0c-4d36-9e6e-230cf42c9b2b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:01.390262 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41af3c63-6d0c-4d36-9e6e-230cf42c9b2b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:01.391026 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41af3c63-6d0c-4d36-9e6e-230cf42c9b2b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:01.391447 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41af3c63-6d0c-4d36-9e6e-230cf42c9b2b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:01.421562 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-41af3c63-6d0c-4d36-9e6e-230cf42c9b2b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043117 Apr 06 16:44:01.422154 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 426/830] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:01 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:01.787276 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6cf2919f-671f-451a-afd2-6f76a8d61112 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:01.788390 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6cf2919f-671f-451a-afd2-6f76a8d61112 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:01.795193 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cf2919f-671f-451a-afd2-6f76a8d61112 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:01.795646 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cf2919f-671f-451a-afd2-6f76a8d61112 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:01.796424 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cf2919f-671f-451a-afd2-6f76a8d61112 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:01.796888 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cf2919f-671f-451a-afd2-6f76a8d61112 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:01.827758 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6cf2919f-671f-451a-afd2-6f76a8d61112 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044574 Apr 06 16:44:01.828304 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 405/831] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:01 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:02.433422 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c8f22bbe-5caa-4726-88b3-d082c31d31ac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:02.434494 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c8f22bbe-5caa-4726-88b3-d082c31d31ac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:02.440714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8f22bbe-5caa-4726-88b3-d082c31d31ac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:02.441200 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8f22bbe-5caa-4726-88b3-d082c31d31ac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:02.441953 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8f22bbe-5caa-4726-88b3-d082c31d31ac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:02.442389 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8f22bbe-5caa-4726-88b3-d082c31d31ac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:02.471602 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c8f22bbe-5caa-4726-88b3-d082c31d31ac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042145 Apr 06 16:44:02.472141 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 427/832] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:02 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:02.840367 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ffcf0e27-2f6d-4323-b7b3-7b41dd3b70c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:02.841348 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ffcf0e27-2f6d-4323-b7b3-7b41dd3b70c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:02.848104 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffcf0e27-2f6d-4323-b7b3-7b41dd3b70c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:02.848578 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffcf0e27-2f6d-4323-b7b3-7b41dd3b70c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:02.849393 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffcf0e27-2f6d-4323-b7b3-7b41dd3b70c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:02.849806 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffcf0e27-2f6d-4323-b7b3-7b41dd3b70c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:02.880843 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ffcf0e27-2f6d-4323-b7b3-7b41dd3b70c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044494 Apr 06 16:44:02.881464 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 406/833] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:02 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:03.483875 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-94f8227f-915c-4004-85c3-a898b204d849 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:03.484826 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-94f8227f-915c-4004-85c3-a898b204d849 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:03.491966 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94f8227f-915c-4004-85c3-a898b204d849 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:03.492433 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94f8227f-915c-4004-85c3-a898b204d849 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:03.493245 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94f8227f-915c-4004-85c3-a898b204d849 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:03.493678 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94f8227f-915c-4004-85c3-a898b204d849 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:03.523731 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-94f8227f-915c-4004-85c3-a898b204d849 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043904 Apr 06 16:44:03.524299 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 428/834] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:03 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:03.893967 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d5fa1688-0d12-48d8-9740-c620929100fb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:03.894882 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d5fa1688-0d12-48d8-9740-c620929100fb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:03.904296 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5fa1688-0d12-48d8-9740-c620929100fb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:03.905225 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5fa1688-0d12-48d8-9740-c620929100fb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:03.906710 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5fa1688-0d12-48d8-9740-c620929100fb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:03.907563 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5fa1688-0d12-48d8-9740-c620929100fb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:03.949739 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d5fa1688-0d12-48d8-9740-c620929100fb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059925 Apr 06 16:44:03.951258 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 407/835] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:03 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:04.536971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-233893c2-a937-4a1b-a234-caa03eb0f23a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:04.538915 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-233893c2-a937-4a1b-a234-caa03eb0f23a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:04.546789 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-233893c2-a937-4a1b-a234-caa03eb0f23a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:04.547344 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-233893c2-a937-4a1b-a234-caa03eb0f23a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:04.548139 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-233893c2-a937-4a1b-a234-caa03eb0f23a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:04.548571 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-233893c2-a937-4a1b-a234-caa03eb0f23a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:04.580272 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-233893c2-a937-4a1b-a234-caa03eb0f23a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048045 Apr 06 16:44:04.580863 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 429/836] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:04 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:04.963205 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-57de6f29-b5a0-4ca0-b5f6-3e5452f72cd9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:04.965378 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-57de6f29-b5a0-4ca0-b5f6-3e5452f72cd9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:04.972161 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57de6f29-b5a0-4ca0-b5f6-3e5452f72cd9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:04.972763 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57de6f29-b5a0-4ca0-b5f6-3e5452f72cd9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:04.973720 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57de6f29-b5a0-4ca0-b5f6-3e5452f72cd9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:04.974352 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57de6f29-b5a0-4ca0-b5f6-3e5452f72cd9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:05.019388 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-57de6f29-b5a0-4ca0-b5f6-3e5452f72cd9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060580 Apr 06 16:44:05.020000 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 408/837] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:04 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:05.592505 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7dc8d793-7f1d-4f88-a2cc-a0112cd3f15d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:05.593714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7dc8d793-7f1d-4f88-a2cc-a0112cd3f15d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:05.600987 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dc8d793-7f1d-4f88-a2cc-a0112cd3f15d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:05.601491 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dc8d793-7f1d-4f88-a2cc-a0112cd3f15d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:05.602354 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dc8d793-7f1d-4f88-a2cc-a0112cd3f15d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:05.602838 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dc8d793-7f1d-4f88-a2cc-a0112cd3f15d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:05.633626 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7dc8d793-7f1d-4f88-a2cc-a0112cd3f15d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045444 Apr 06 16:44:05.634203 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 430/838] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:05 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:06.032123 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-57dffff2-50e5-4607-a49e-67889e2fa006 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:06.033072 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-57dffff2-50e5-4607-a49e-67889e2fa006 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:06.040208 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57dffff2-50e5-4607-a49e-67889e2fa006 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:06.040657 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57dffff2-50e5-4607-a49e-67889e2fa006 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:06.041565 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57dffff2-50e5-4607-a49e-67889e2fa006 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:06.041997 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57dffff2-50e5-4607-a49e-67889e2fa006 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:06.073498 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-57dffff2-50e5-4607-a49e-67889e2fa006 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045490 Apr 06 16:44:06.074876 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 409/839] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:06 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:06.645735 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e9183fa4-79b0-4bbf-a0b3-7ac37010f6de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:06.646795 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e9183fa4-79b0-4bbf-a0b3-7ac37010f6de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:06.660423 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9183fa4-79b0-4bbf-a0b3-7ac37010f6de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:06.660903 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9183fa4-79b0-4bbf-a0b3-7ac37010f6de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:06.661667 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9183fa4-79b0-4bbf-a0b3-7ac37010f6de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:06.662094 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9183fa4-79b0-4bbf-a0b3-7ac37010f6de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:06.692257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e9183fa4-79b0-4bbf-a0b3-7ac37010f6de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050502 Apr 06 16:44:06.692855 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 431/840] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:06 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:07.086137 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fbf32ea9-0e96-4daf-8087-ce3010c2b251 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:07.086959 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fbf32ea9-0e96-4daf-8087-ce3010c2b251 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:07.093721 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbf32ea9-0e96-4daf-8087-ce3010c2b251 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:07.094153 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbf32ea9-0e96-4daf-8087-ce3010c2b251 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:07.094929 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbf32ea9-0e96-4daf-8087-ce3010c2b251 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:07.095362 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbf32ea9-0e96-4daf-8087-ce3010c2b251 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:07.126061 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fbf32ea9-0e96-4daf-8087-ce3010c2b251 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044301 Apr 06 16:44:07.126633 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 410/841] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:07 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:07.705014 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3159b8e2-ddec-4d56-afe2-fbc6175eec04 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:07.705926 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3159b8e2-ddec-4d56-afe2-fbc6175eec04 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:07.712362 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3159b8e2-ddec-4d56-afe2-fbc6175eec04 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:07.712866 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3159b8e2-ddec-4d56-afe2-fbc6175eec04 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:07.713617 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3159b8e2-ddec-4d56-afe2-fbc6175eec04 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:07.714042 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3159b8e2-ddec-4d56-afe2-fbc6175eec04 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:07.744473 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3159b8e2-ddec-4d56-afe2-fbc6175eec04 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043443 Apr 06 16:44:07.745068 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 432/842] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:07 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:08.138690 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-26b9f6cf-c905-4bab-ba14-8f230800d085 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:08.139603 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-26b9f6cf-c905-4bab-ba14-8f230800d085 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:08.146328 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26b9f6cf-c905-4bab-ba14-8f230800d085 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:08.146938 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26b9f6cf-c905-4bab-ba14-8f230800d085 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:08.147707 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26b9f6cf-c905-4bab-ba14-8f230800d085 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:08.148134 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26b9f6cf-c905-4bab-ba14-8f230800d085 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:08.178831 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-26b9f6cf-c905-4bab-ba14-8f230800d085 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044381 Apr 06 16:44:08.179410 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 411/843] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:08 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:08.755798 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cfa8fadd-d793-45d7-9cf8-781dd4508676 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:08.756793 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cfa8fadd-d793-45d7-9cf8-781dd4508676 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:08.762948 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfa8fadd-d793-45d7-9cf8-781dd4508676 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:08.763396 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfa8fadd-d793-45d7-9cf8-781dd4508676 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:08.764160 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfa8fadd-d793-45d7-9cf8-781dd4508676 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:08.764595 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfa8fadd-d793-45d7-9cf8-781dd4508676 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:08.793854 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cfa8fadd-d793-45d7-9cf8-781dd4508676 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042019 Apr 06 16:44:08.794435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 433/844] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:08 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:09.191783 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-79962419-d0f4-4b7b-b2ac-33c17696832d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:09.192669 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-79962419-d0f4-4b7b-b2ac-33c17696832d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:09.200147 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79962419-d0f4-4b7b-b2ac-33c17696832d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:09.200603 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79962419-d0f4-4b7b-b2ac-33c17696832d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:09.201448 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79962419-d0f4-4b7b-b2ac-33c17696832d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:09.201914 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79962419-d0f4-4b7b-b2ac-33c17696832d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:09.232564 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-79962419-d0f4-4b7b-b2ac-33c17696832d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045586 Apr 06 16:44:09.233170 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 412/845] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:09 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:09.805901 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fef2b5f7-582a-48fc-a6cd-90b6e9869f53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:09.806918 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fef2b5f7-582a-48fc-a6cd-90b6e9869f53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:09.814453 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fef2b5f7-582a-48fc-a6cd-90b6e9869f53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:09.814927 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fef2b5f7-582a-48fc-a6cd-90b6e9869f53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:09.815736 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fef2b5f7-582a-48fc-a6cd-90b6e9869f53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:09.816167 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fef2b5f7-582a-48fc-a6cd-90b6e9869f53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:09.851575 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fef2b5f7-582a-48fc-a6cd-90b6e9869f53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050326 Apr 06 16:44:09.852126 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 434/846] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:09 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:10.249640 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6828ae5e-f1e8-4ed2-bca7-29c87195a39e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:10.251724 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6828ae5e-f1e8-4ed2-bca7-29c87195a39e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:10.261360 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6828ae5e-f1e8-4ed2-bca7-29c87195a39e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:10.262411 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6828ae5e-f1e8-4ed2-bca7-29c87195a39e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:10.263520 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6828ae5e-f1e8-4ed2-bca7-29c87195a39e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:10.264031 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6828ae5e-f1e8-4ed2-bca7-29c87195a39e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:10.304647 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6828ae5e-f1e8-4ed2-bca7-29c87195a39e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061655 Apr 06 16:44:10.305686 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 413/847] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:10 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 06 16:44:10.864664 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-551f9c39-dd5a-47ca-a2eb-f11907e8d532 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:10.865698 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-551f9c39-dd5a-47ca-a2eb-f11907e8d532 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:10.872546 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-551f9c39-dd5a-47ca-a2eb-f11907e8d532 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:10.873216 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-551f9c39-dd5a-47ca-a2eb-f11907e8d532 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:10.874012 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-551f9c39-dd5a-47ca-a2eb-f11907e8d532 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:10.874447 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-551f9c39-dd5a-47ca-a2eb-f11907e8d532 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:10.906574 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-551f9c39-dd5a-47ca-a2eb-f11907e8d532 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046666 Apr 06 16:44:10.907178 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 435/848] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:10 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:11.320513 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0051af14-57cf-4b16-b5bc-8dd8b888cd87 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:11.321458 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0051af14-57cf-4b16-b5bc-8dd8b888cd87 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:11.328889 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0051af14-57cf-4b16-b5bc-8dd8b888cd87 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:11.329456 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0051af14-57cf-4b16-b5bc-8dd8b888cd87 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:11.330736 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0051af14-57cf-4b16-b5bc-8dd8b888cd87 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:11.331167 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0051af14-57cf-4b16-b5bc-8dd8b888cd87 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:11.363172 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0051af14-57cf-4b16-b5bc-8dd8b888cd87 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047240 Apr 06 16:44:11.363733 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 414/849] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:11 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:11.918538 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eee5581f-4589-4709-bd00-1fbcf28042b6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:11.919605 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eee5581f-4589-4709-bd00-1fbcf28042b6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:11.926122 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eee5581f-4589-4709-bd00-1fbcf28042b6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:11.926555 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eee5581f-4589-4709-bd00-1fbcf28042b6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:11.927321 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eee5581f-4589-4709-bd00-1fbcf28042b6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:11.927751 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eee5581f-4589-4709-bd00-1fbcf28042b6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:11.959318 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eee5581f-4589-4709-bd00-1fbcf28042b6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044667 Apr 06 16:44:11.960160 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 436/850] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:11 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:12.380224 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b67a1318-863f-482b-92ef-f3cc9a575c38 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:12.381776 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b67a1318-863f-482b-92ef-f3cc9a575c38 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:12.392728 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b67a1318-863f-482b-92ef-f3cc9a575c38 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:12.393444 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b67a1318-863f-482b-92ef-f3cc9a575c38 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:12.394722 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b67a1318-863f-482b-92ef-f3cc9a575c38 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:12.395448 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b67a1318-863f-482b-92ef-f3cc9a575c38 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:12.426980 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b67a1318-863f-482b-92ef-f3cc9a575c38 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053505 Apr 06 16:44:12.427557 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 415/851] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:12 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:12.971717 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6bf42ce3-b0e4-405e-8a6c-fa0064521375 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:12.974504 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6bf42ce3-b0e4-405e-8a6c-fa0064521375 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:12.979547 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bf42ce3-b0e4-405e-8a6c-fa0064521375 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:12.980002 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bf42ce3-b0e4-405e-8a6c-fa0064521375 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:12.980813 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bf42ce3-b0e4-405e-8a6c-fa0064521375 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:12.981243 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bf42ce3-b0e4-405e-8a6c-fa0064521375 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:13.019197 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6bf42ce3-b0e4-405e-8a6c-fa0064521375 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051470 Apr 06 16:44:13.019878 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 437/852] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:12 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:13.439657 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f7756044-198d-4d2e-a5e4-162b11d849e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:13.440618 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f7756044-198d-4d2e-a5e4-162b11d849e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:13.447640 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7756044-198d-4d2e-a5e4-162b11d849e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:13.448085 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7756044-198d-4d2e-a5e4-162b11d849e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:13.448887 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7756044-198d-4d2e-a5e4-162b11d849e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:13.449320 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7756044-198d-4d2e-a5e4-162b11d849e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:13.478757 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f7756044-198d-4d2e-a5e4-162b11d849e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043093 Apr 06 16:44:13.479307 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 416/853] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:13 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:14.034613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e97bbda0-6884-4ce4-b931-b40f28ba7e59 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:14.035574 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e97bbda0-6884-4ce4-b931-b40f28ba7e59 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:14.043956 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e97bbda0-6884-4ce4-b931-b40f28ba7e59 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:14.044405 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e97bbda0-6884-4ce4-b931-b40f28ba7e59 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:14.045215 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e97bbda0-6884-4ce4-b931-b40f28ba7e59 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:14.045645 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e97bbda0-6884-4ce4-b931-b40f28ba7e59 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:14.075856 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e97bbda0-6884-4ce4-b931-b40f28ba7e59 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045138 Apr 06 16:44:14.076422 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 438/854] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:14 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:14.491808 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eedd2922-ad3a-41a5-9c76-b004c08ecc61 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:14.492723 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eedd2922-ad3a-41a5-9c76-b004c08ecc61 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:14.499698 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eedd2922-ad3a-41a5-9c76-b004c08ecc61 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:14.500152 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eedd2922-ad3a-41a5-9c76-b004c08ecc61 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:14.500964 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eedd2922-ad3a-41a5-9c76-b004c08ecc61 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:14.501399 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eedd2922-ad3a-41a5-9c76-b004c08ecc61 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:14.532572 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eedd2922-ad3a-41a5-9c76-b004c08ecc61 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045181 Apr 06 16:44:14.533170 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 417/855] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:14 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:15.088075 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d02873c9-227c-463d-b73c-8a5e8e2be2bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:15.089029 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d02873c9-227c-463d-b73c-8a5e8e2be2bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:15.096283 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d02873c9-227c-463d-b73c-8a5e8e2be2bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:15.096764 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d02873c9-227c-463d-b73c-8a5e8e2be2bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:15.097542 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d02873c9-227c-463d-b73c-8a5e8e2be2bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:15.097977 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d02873c9-227c-463d-b73c-8a5e8e2be2bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:15.128902 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d02873c9-227c-463d-b73c-8a5e8e2be2bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044974 Apr 06 16:44:15.129480 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 439/856] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:15 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:15.549833 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-daf244fd-aa25-4310-9332-aa61e1cbda18 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:15.550966 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-daf244fd-aa25-4310-9332-aa61e1cbda18 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:15.559672 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-daf244fd-aa25-4310-9332-aa61e1cbda18 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:15.560124 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-daf244fd-aa25-4310-9332-aa61e1cbda18 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:15.560948 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-daf244fd-aa25-4310-9332-aa61e1cbda18 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:15.561384 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-daf244fd-aa25-4310-9332-aa61e1cbda18 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:15.591475 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-daf244fd-aa25-4310-9332-aa61e1cbda18 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048342 Apr 06 16:44:15.591946 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 418/857] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:15 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:16.140936 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fedeb937-faf5-470f-8fed-ec07c32de707 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:16.141855 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fedeb937-faf5-470f-8fed-ec07c32de707 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:16.148606 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fedeb937-faf5-470f-8fed-ec07c32de707 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:16.149072 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fedeb937-faf5-470f-8fed-ec07c32de707 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:16.149880 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fedeb937-faf5-470f-8fed-ec07c32de707 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:16.150304 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fedeb937-faf5-470f-8fed-ec07c32de707 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:16.181067 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fedeb937-faf5-470f-8fed-ec07c32de707 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044197 Apr 06 16:44:16.181840 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 440/858] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:16 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:16.607742 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c849db0d-4a3a-4e6c-b834-878726eda889 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:16.608983 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c849db0d-4a3a-4e6c-b834-878726eda889 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:16.617820 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c849db0d-4a3a-4e6c-b834-878726eda889 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:16.618388 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c849db0d-4a3a-4e6c-b834-878726eda889 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:16.619714 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c849db0d-4a3a-4e6c-b834-878726eda889 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:16.620304 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c849db0d-4a3a-4e6c-b834-878726eda889 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:16.651738 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c849db0d-4a3a-4e6c-b834-878726eda889 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050916 Apr 06 16:44:16.652304 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 419/859] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:16 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:17.196406 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-29c20ff3-8100-4f9c-b8cf-7e66fcc001eb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:17.197478 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-29c20ff3-8100-4f9c-b8cf-7e66fcc001eb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:17.203958 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29c20ff3-8100-4f9c-b8cf-7e66fcc001eb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:17.204409 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29c20ff3-8100-4f9c-b8cf-7e66fcc001eb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:17.205230 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29c20ff3-8100-4f9c-b8cf-7e66fcc001eb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:17.205663 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29c20ff3-8100-4f9c-b8cf-7e66fcc001eb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:17.237077 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-29c20ff3-8100-4f9c-b8cf-7e66fcc001eb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046897 Apr 06 16:44:17.237654 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 441/860] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:17 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:17.664243 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-950a164c-dc65-4199-8dc7-c12e1596650f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:17.665204 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-950a164c-dc65-4199-8dc7-c12e1596650f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:17.672192 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-950a164c-dc65-4199-8dc7-c12e1596650f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:17.672637 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-950a164c-dc65-4199-8dc7-c12e1596650f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:17.673427 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-950a164c-dc65-4199-8dc7-c12e1596650f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:17.673855 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-950a164c-dc65-4199-8dc7-c12e1596650f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:17.704209 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-950a164c-dc65-4199-8dc7-c12e1596650f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044020 Apr 06 16:44:17.704802 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 420/861] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:17 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:18.250199 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-94159095-0905-4aa6-b779-1738d48727bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:18.251099 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-94159095-0905-4aa6-b779-1738d48727bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:18.257337 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94159095-0905-4aa6-b779-1738d48727bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:18.257780 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94159095-0905-4aa6-b779-1738d48727bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:18.258536 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94159095-0905-4aa6-b779-1738d48727bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:18.258963 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94159095-0905-4aa6-b779-1738d48727bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:18.289064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-94159095-0905-4aa6-b779-1738d48727bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042862 Apr 06 16:44:18.289632 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 442/862] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:18 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:18.716467 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d19fd957-bfba-4f23-b01e-b9f993b63e7a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:18.718611 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d19fd957-bfba-4f23-b01e-b9f993b63e7a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:18.730781 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d19fd957-bfba-4f23-b01e-b9f993b63e7a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:18.731289 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d19fd957-bfba-4f23-b01e-b9f993b63e7a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:18.732153 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d19fd957-bfba-4f23-b01e-b9f993b63e7a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:18.732591 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d19fd957-bfba-4f23-b01e-b9f993b63e7a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:18.763553 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d19fd957-bfba-4f23-b01e-b9f993b63e7a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051199 Apr 06 16:44:18.764096 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 421/863] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:18 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:19.303953 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4cd0fe58-f3df-454c-a6d2-e245a8e8f4a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:19.305679 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4cd0fe58-f3df-454c-a6d2-e245a8e8f4a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:19.312645 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cd0fe58-f3df-454c-a6d2-e245a8e8f4a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:19.313458 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cd0fe58-f3df-454c-a6d2-e245a8e8f4a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:19.314295 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cd0fe58-f3df-454c-a6d2-e245a8e8f4a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:19.314866 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cd0fe58-f3df-454c-a6d2-e245a8e8f4a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:19.348233 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4cd0fe58-f3df-454c-a6d2-e245a8e8f4a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048290 Apr 06 16:44:19.348836 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 443/864] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:19 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:19.775777 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-35bd711f-eea9-4a82-89f3-c98bd0eef0e8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:19.776730 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-35bd711f-eea9-4a82-89f3-c98bd0eef0e8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:19.783428 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35bd711f-eea9-4a82-89f3-c98bd0eef0e8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:19.783887 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35bd711f-eea9-4a82-89f3-c98bd0eef0e8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:19.784656 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35bd711f-eea9-4a82-89f3-c98bd0eef0e8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:19.785136 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35bd711f-eea9-4a82-89f3-c98bd0eef0e8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:19.816195 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-35bd711f-eea9-4a82-89f3-c98bd0eef0e8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044594 Apr 06 16:44:19.816786 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 422/865] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:19 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:20.361357 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c08f046d-a7a7-480c-98ea-b28adc74fdc9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:20.362792 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c08f046d-a7a7-480c-98ea-b28adc74fdc9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:20.370378 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c08f046d-a7a7-480c-98ea-b28adc74fdc9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:20.370819 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c08f046d-a7a7-480c-98ea-b28adc74fdc9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:20.371611 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c08f046d-a7a7-480c-98ea-b28adc74fdc9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:20.372067 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c08f046d-a7a7-480c-98ea-b28adc74fdc9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:20.406159 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c08f046d-a7a7-480c-98ea-b28adc74fdc9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049690 Apr 06 16:44:20.406736 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 444/866] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:20 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:20.832582 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cb7b8663-8542-4d9f-b3bb-a74dc7842ed4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:20.834127 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cb7b8663-8542-4d9f-b3bb-a74dc7842ed4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:20.842267 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb7b8663-8542-4d9f-b3bb-a74dc7842ed4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:20.842721 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb7b8663-8542-4d9f-b3bb-a74dc7842ed4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:20.843489 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb7b8663-8542-4d9f-b3bb-a74dc7842ed4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:20.843920 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb7b8663-8542-4d9f-b3bb-a74dc7842ed4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:20.874089 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cb7b8663-8542-4d9f-b3bb-a74dc7842ed4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048276 Apr 06 16:44:20.874658 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 423/867] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:20 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:21.419235 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-76189088-eab1-4681-afaf-1a52b932a364 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:21.420159 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-76189088-eab1-4681-afaf-1a52b932a364 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:21.426314 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76189088-eab1-4681-afaf-1a52b932a364 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:21.426755 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76189088-eab1-4681-afaf-1a52b932a364 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:21.427514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76189088-eab1-4681-afaf-1a52b932a364 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:21.427976 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76189088-eab1-4681-afaf-1a52b932a364 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:21.457453 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-76189088-eab1-4681-afaf-1a52b932a364 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042859 Apr 06 16:44:21.458081 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 445/868] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:21 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:21.888038 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ac33a2b7-cd10-4e91-9095-ef67d14eac45 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:21.888993 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ac33a2b7-cd10-4e91-9095-ef67d14eac45 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:21.897742 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac33a2b7-cd10-4e91-9095-ef67d14eac45 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:21.898551 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac33a2b7-cd10-4e91-9095-ef67d14eac45 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:21.899808 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac33a2b7-cd10-4e91-9095-ef67d14eac45 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:21.900333 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac33a2b7-cd10-4e91-9095-ef67d14eac45 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:21.935201 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ac33a2b7-cd10-4e91-9095-ef67d14eac45 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051584 Apr 06 16:44:21.935769 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 424/869] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:21 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:22.472781 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a617a955-0ada-434a-b103-9a6d87574bc8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:22.473817 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a617a955-0ada-434a-b103-9a6d87574bc8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:22.481736 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a617a955-0ada-434a-b103-9a6d87574bc8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:22.482184 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a617a955-0ada-434a-b103-9a6d87574bc8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:22.482944 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a617a955-0ada-434a-b103-9a6d87574bc8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:22.483392 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a617a955-0ada-434a-b103-9a6d87574bc8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:22.512579 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a617a955-0ada-434a-b103-9a6d87574bc8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046134 Apr 06 16:44:22.513211 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 446/870] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:22 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:22.951778 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-73473aa8-5e75-4177-aaea-bd0079205681 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:22.953309 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-73473aa8-5e75-4177-aaea-bd0079205681 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:22.963399 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73473aa8-5e75-4177-aaea-bd0079205681 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:22.963846 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73473aa8-5e75-4177-aaea-bd0079205681 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:22.964617 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73473aa8-5e75-4177-aaea-bd0079205681 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:22.965077 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73473aa8-5e75-4177-aaea-bd0079205681 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:22.994730 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-73473aa8-5e75-4177-aaea-bd0079205681 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050227 Apr 06 16:44:22.995286 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 425/871] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:22 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:23.525500 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-604e9dec-1cf5-43ef-852a-267d7792f1b3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:23.526461 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-604e9dec-1cf5-43ef-852a-267d7792f1b3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:23.533252 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-604e9dec-1cf5-43ef-852a-267d7792f1b3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:23.533696 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-604e9dec-1cf5-43ef-852a-267d7792f1b3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:23.534463 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-604e9dec-1cf5-43ef-852a-267d7792f1b3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:23.534897 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-604e9dec-1cf5-43ef-852a-267d7792f1b3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:23.566055 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-604e9dec-1cf5-43ef-852a-267d7792f1b3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044583 Apr 06 16:44:23.566620 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 447/872] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:23 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:24.010195 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0dbb1a28-bdbc-4909-be87-3ef349c8f836 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:24.011141 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0dbb1a28-bdbc-4909-be87-3ef349c8f836 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:24.017348 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dbb1a28-bdbc-4909-be87-3ef349c8f836 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:24.017795 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dbb1a28-bdbc-4909-be87-3ef349c8f836 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:24.018559 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dbb1a28-bdbc-4909-be87-3ef349c8f836 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:24.018981 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dbb1a28-bdbc-4909-be87-3ef349c8f836 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:24.048357 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0dbb1a28-bdbc-4909-be87-3ef349c8f836 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044153 Apr 06 16:44:24.049566 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 426/873] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:24 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:24.582081 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aba4678a-e132-45d0-9260-db49ba5846e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:24.583261 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aba4678a-e132-45d0-9260-db49ba5846e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:24.591097 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aba4678a-e132-45d0-9260-db49ba5846e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:24.591480 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aba4678a-e132-45d0-9260-db49ba5846e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:24.592251 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aba4678a-e132-45d0-9260-db49ba5846e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:24.592708 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aba4678a-e132-45d0-9260-db49ba5846e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:24.622948 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aba4678a-e132-45d0-9260-db49ba5846e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047279 Apr 06 16:44:24.623510 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 448/874] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:24 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:25.065241 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2433a120-01f1-4543-b454-d78efe304547 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:25.066604 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2433a120-01f1-4543-b454-d78efe304547 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:25.077421 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2433a120-01f1-4543-b454-d78efe304547 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:25.078056 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2433a120-01f1-4543-b454-d78efe304547 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:25.079145 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2433a120-01f1-4543-b454-d78efe304547 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:25.079755 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2433a120-01f1-4543-b454-d78efe304547 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:25.111964 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2433a120-01f1-4543-b454-d78efe304547 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053597 Apr 06 16:44:25.112542 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 427/875] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:25 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:25.636002 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a204a956-9155-4639-b780-c780d851867f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:25.636984 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a204a956-9155-4639-b780-c780d851867f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:25.645159 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a204a956-9155-4639-b780-c780d851867f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:25.645608 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a204a956-9155-4639-b780-c780d851867f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:25.646349 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a204a956-9155-4639-b780-c780d851867f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:25.646784 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a204a956-9155-4639-b780-c780d851867f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:25.678981 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a204a956-9155-4639-b780-c780d851867f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047188 Apr 06 16:44:25.679539 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 449/876] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:25 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:26.128084 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-254ae2bb-fe59-4513-9eaa-ad3362ad2cb7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:26.129627 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-254ae2bb-fe59-4513-9eaa-ad3362ad2cb7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:26.138717 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-254ae2bb-fe59-4513-9eaa-ad3362ad2cb7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:26.139166 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-254ae2bb-fe59-4513-9eaa-ad3362ad2cb7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:26.139944 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-254ae2bb-fe59-4513-9eaa-ad3362ad2cb7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:26.140374 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-254ae2bb-fe59-4513-9eaa-ad3362ad2cb7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:26.169339 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-254ae2bb-fe59-4513-9eaa-ad3362ad2cb7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047837 Apr 06 16:44:26.169906 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 428/877] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:26 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:26.692852 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b26ab3c3-1ca7-4fcf-a891-4064b2a3f2e5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:26.693799 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b26ab3c3-1ca7-4fcf-a891-4064b2a3f2e5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:26.699737 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b26ab3c3-1ca7-4fcf-a891-4064b2a3f2e5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:26.700165 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b26ab3c3-1ca7-4fcf-a891-4064b2a3f2e5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:26.700970 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b26ab3c3-1ca7-4fcf-a891-4064b2a3f2e5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:26.701400 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b26ab3c3-1ca7-4fcf-a891-4064b2a3f2e5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:26.730339 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b26ab3c3-1ca7-4fcf-a891-4064b2a3f2e5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041413 Apr 06 16:44:26.731089 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 450/878] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:26 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:27.186332 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-23dfb26f-4c4a-45f2-8fd6-a5f0d61b43ec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:27.187456 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-23dfb26f-4c4a-45f2-8fd6-a5f0d61b43ec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:27.196991 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23dfb26f-4c4a-45f2-8fd6-a5f0d61b43ec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:27.197505 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23dfb26f-4c4a-45f2-8fd6-a5f0d61b43ec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:27.198711 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23dfb26f-4c4a-45f2-8fd6-a5f0d61b43ec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:27.199159 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23dfb26f-4c4a-45f2-8fd6-a5f0d61b43ec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:27.233830 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-23dfb26f-4c4a-45f2-8fd6-a5f0d61b43ec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054285 Apr 06 16:44:27.234302 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 429/879] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:27 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:27.743452 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5540f252-3cbd-494f-8d17-7290fec89bd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:27.744383 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5540f252-3cbd-494f-8d17-7290fec89bd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:27.750354 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5540f252-3cbd-494f-8d17-7290fec89bd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:27.750803 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5540f252-3cbd-494f-8d17-7290fec89bd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:27.751577 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5540f252-3cbd-494f-8d17-7290fec89bd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:27.752181 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5540f252-3cbd-494f-8d17-7290fec89bd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:27.780149 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5540f252-3cbd-494f-8d17-7290fec89bd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041270 Apr 06 16:44:27.780731 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 451/880] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:27 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:28.248766 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-556722e5-0b15-4360-ac18-294ef518e243 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:28.249760 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-556722e5-0b15-4360-ac18-294ef518e243 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:28.256430 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-556722e5-0b15-4360-ac18-294ef518e243 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:28.256939 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-556722e5-0b15-4360-ac18-294ef518e243 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:28.257715 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-556722e5-0b15-4360-ac18-294ef518e243 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:28.258148 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-556722e5-0b15-4360-ac18-294ef518e243 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:28.287798 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-556722e5-0b15-4360-ac18-294ef518e243 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044117 Apr 06 16:44:28.288351 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 430/881] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:28 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:28.793827 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-37574231-d4ad-45ba-aec4-0c4bce2c65a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:28.794883 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-37574231-d4ad-45ba-aec4-0c4bce2c65a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:28.801645 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37574231-d4ad-45ba-aec4-0c4bce2c65a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:28.802071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37574231-d4ad-45ba-aec4-0c4bce2c65a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:28.802831 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37574231-d4ad-45ba-aec4-0c4bce2c65a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:28.803255 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37574231-d4ad-45ba-aec4-0c4bce2c65a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:28.831313 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-37574231-d4ad-45ba-aec4-0c4bce2c65a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042484 Apr 06 16:44:28.831855 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 452/882] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:28 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:29.305626 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1afe1472-04f6-4cff-bab1-2e5b70ab3847 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:29.307113 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1afe1472-04f6-4cff-bab1-2e5b70ab3847 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:29.318254 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1afe1472-04f6-4cff-bab1-2e5b70ab3847 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:29.319132 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1afe1472-04f6-4cff-bab1-2e5b70ab3847 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:29.320417 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1afe1472-04f6-4cff-bab1-2e5b70ab3847 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:29.321201 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1afe1472-04f6-4cff-bab1-2e5b70ab3847 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:29.352525 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1afe1472-04f6-4cff-bab1-2e5b70ab3847 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053668 Apr 06 16:44:29.353113 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 431/883] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:29 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:29.848831 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e1bd0911-ffcb-4389-ab2c-2b27ecb99681 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:29.850441 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e1bd0911-ffcb-4389-ab2c-2b27ecb99681 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:29.859321 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1bd0911-ffcb-4389-ab2c-2b27ecb99681 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:29.859777 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1bd0911-ffcb-4389-ab2c-2b27ecb99681 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:29.860559 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1bd0911-ffcb-4389-ab2c-2b27ecb99681 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:29.861022 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1bd0911-ffcb-4389-ab2c-2b27ecb99681 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:29.890023 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e1bd0911-ffcb-4389-ab2c-2b27ecb99681 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047675 Apr 06 16:44:29.890552 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 453/884] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:29 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:30.366421 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c8208c01-f755-4e5c-8e2b-6180ed53f549 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:30.367431 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c8208c01-f755-4e5c-8e2b-6180ed53f549 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:30.374767 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8208c01-f755-4e5c-8e2b-6180ed53f549 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:30.375214 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8208c01-f755-4e5c-8e2b-6180ed53f549 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:30.375980 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8208c01-f755-4e5c-8e2b-6180ed53f549 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:30.376411 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8208c01-f755-4e5c-8e2b-6180ed53f549 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:30.406848 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c8208c01-f755-4e5c-8e2b-6180ed53f549 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045437 Apr 06 16:44:30.409785 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 432/885] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:30 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:30.902030 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-70e2d57e-2824-45af-bfb4-470ccb399359 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:30.903052 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-70e2d57e-2824-45af-bfb4-470ccb399359 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:30.909604 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70e2d57e-2824-45af-bfb4-470ccb399359 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:30.910051 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70e2d57e-2824-45af-bfb4-470ccb399359 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:30.910818 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70e2d57e-2824-45af-bfb4-470ccb399359 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:30.911254 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70e2d57e-2824-45af-bfb4-470ccb399359 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:30.941905 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-70e2d57e-2824-45af-bfb4-470ccb399359 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043926 Apr 06 16:44:30.942472 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 454/886] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:30 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:31.421352 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eae37ef6-5e24-4660-99d1-ad4a940f9f93 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:31.422630 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eae37ef6-5e24-4660-99d1-ad4a940f9f93 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:31.430561 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eae37ef6-5e24-4660-99d1-ad4a940f9f93 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:31.431002 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eae37ef6-5e24-4660-99d1-ad4a940f9f93 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:31.432008 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eae37ef6-5e24-4660-99d1-ad4a940f9f93 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:31.432526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eae37ef6-5e24-4660-99d1-ad4a940f9f93 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:31.464100 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eae37ef6-5e24-4660-99d1-ad4a940f9f93 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047978 Apr 06 16:44:31.464666 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 433/887] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:31 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:31.955015 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-471221ca-f3c3-4e1a-bbd5-d67850f1b94d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:31.956203 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-471221ca-f3c3-4e1a-bbd5-d67850f1b94d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:31.963235 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-471221ca-f3c3-4e1a-bbd5-d67850f1b94d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:31.963862 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-471221ca-f3c3-4e1a-bbd5-d67850f1b94d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:31.964520 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-471221ca-f3c3-4e1a-bbd5-d67850f1b94d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:31.964918 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-471221ca-f3c3-4e1a-bbd5-d67850f1b94d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:31.997514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-471221ca-f3c3-4e1a-bbd5-d67850f1b94d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046802 Apr 06 16:44:31.998250 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 455/888] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:31 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:32.476198 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7eeb504b-639f-4f49-a1cb-c3897d37f310 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:32.477136 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7eeb504b-639f-4f49-a1cb-c3897d37f310 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:32.483899 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7eeb504b-639f-4f49-a1cb-c3897d37f310 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:32.484351 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7eeb504b-639f-4f49-a1cb-c3897d37f310 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:32.485146 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7eeb504b-639f-4f49-a1cb-c3897d37f310 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:32.485571 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7eeb504b-639f-4f49-a1cb-c3897d37f310 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:32.517663 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7eeb504b-639f-4f49-a1cb-c3897d37f310 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045493 Apr 06 16:44:32.518219 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 434/889] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:32 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:33.010500 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-db94c6d8-0818-4ea4-bd68-5f56f1cea784 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:33.011402 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-db94c6d8-0818-4ea4-bd68-5f56f1cea784 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:33.017987 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db94c6d8-0818-4ea4-bd68-5f56f1cea784 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:33.018438 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db94c6d8-0818-4ea4-bd68-5f56f1cea784 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:33.019211 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db94c6d8-0818-4ea4-bd68-5f56f1cea784 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:33.019639 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db94c6d8-0818-4ea4-bd68-5f56f1cea784 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:33.055824 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-db94c6d8-0818-4ea4-bd68-5f56f1cea784 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049733 Apr 06 16:44:33.056396 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 456/890] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:33 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:33.535355 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7cc75382-f10e-45e4-8f15-26fb3969dffb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:33.536930 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7cc75382-f10e-45e4-8f15-26fb3969dffb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:33.547004 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cc75382-f10e-45e4-8f15-26fb3969dffb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:33.547453 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cc75382-f10e-45e4-8f15-26fb3969dffb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:33.548238 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cc75382-f10e-45e4-8f15-26fb3969dffb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:33.548671 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cc75382-f10e-45e4-8f15-26fb3969dffb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:33.578741 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7cc75382-f10e-45e4-8f15-26fb3969dffb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050512 Apr 06 16:44:33.579311 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 435/891] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:33 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:34.069875 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c34c04c7-964f-4214-8f2c-770bf5949e16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:34.071118 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c34c04c7-964f-4214-8f2c-770bf5949e16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:34.078216 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c34c04c7-964f-4214-8f2c-770bf5949e16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:34.078666 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c34c04c7-964f-4214-8f2c-770bf5949e16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:34.079440 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c34c04c7-964f-4214-8f2c-770bf5949e16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:34.079866 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c34c04c7-964f-4214-8f2c-770bf5949e16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:34.111139 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c34c04c7-964f-4214-8f2c-770bf5949e16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046487 Apr 06 16:44:34.111835 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 457/892] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:34 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:34.594494 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d9a0fbab-5a56-4e7c-80d9-39eba41608c3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:34.595496 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d9a0fbab-5a56-4e7c-80d9-39eba41608c3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:34.603041 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9a0fbab-5a56-4e7c-80d9-39eba41608c3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:34.603494 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9a0fbab-5a56-4e7c-80d9-39eba41608c3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:34.604273 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9a0fbab-5a56-4e7c-80d9-39eba41608c3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:34.604714 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9a0fbab-5a56-4e7c-80d9-39eba41608c3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:34.634850 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d9a0fbab-5a56-4e7c-80d9-39eba41608c3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046915 Apr 06 16:44:34.635408 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 436/893] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:34 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:35.124539 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e36bfa8c-1513-416d-8108-a5571b7a11cb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:35.125522 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e36bfa8c-1513-416d-8108-a5571b7a11cb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:35.131803 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e36bfa8c-1513-416d-8108-a5571b7a11cb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:35.132254 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e36bfa8c-1513-416d-8108-a5571b7a11cb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:35.133062 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e36bfa8c-1513-416d-8108-a5571b7a11cb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:35.133495 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e36bfa8c-1513-416d-8108-a5571b7a11cb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:35.163633 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e36bfa8c-1513-416d-8108-a5571b7a11cb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043143 Apr 06 16:44:35.164188 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 458/894] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:35 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:35.648238 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-33ac8d14-1b12-4c30-84d0-10d2b7c1ccd8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:35.649186 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-33ac8d14-1b12-4c30-84d0-10d2b7c1ccd8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:35.656055 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33ac8d14-1b12-4c30-84d0-10d2b7c1ccd8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:35.656503 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33ac8d14-1b12-4c30-84d0-10d2b7c1ccd8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:35.657316 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33ac8d14-1b12-4c30-84d0-10d2b7c1ccd8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:35.657785 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33ac8d14-1b12-4c30-84d0-10d2b7c1ccd8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:35.686710 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-33ac8d14-1b12-4c30-84d0-10d2b7c1ccd8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043234 Apr 06 16:44:35.687260 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 437/895] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:35 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:36.175493 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e00766bb-d0f8-41fd-b23a-0b64ce4000d3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:36.176563 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e00766bb-d0f8-41fd-b23a-0b64ce4000d3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:36.183004 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e00766bb-d0f8-41fd-b23a-0b64ce4000d3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:36.183456 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e00766bb-d0f8-41fd-b23a-0b64ce4000d3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:36.184227 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e00766bb-d0f8-41fd-b23a-0b64ce4000d3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:36.184663 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e00766bb-d0f8-41fd-b23a-0b64ce4000d3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:36.213112 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e00766bb-d0f8-41fd-b23a-0b64ce4000d3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041962 Apr 06 16:44:36.213674 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 459/896] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:36 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:36.700218 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b69a9b21-ee51-4043-baf6-a4853e374f6e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:36.701165 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b69a9b21-ee51-4043-baf6-a4853e374f6e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:36.708139 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b69a9b21-ee51-4043-baf6-a4853e374f6e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:36.708590 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b69a9b21-ee51-4043-baf6-a4853e374f6e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:36.709403 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b69a9b21-ee51-4043-baf6-a4853e374f6e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:36.710373 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b69a9b21-ee51-4043-baf6-a4853e374f6e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:36.743215 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b69a9b21-ee51-4043-baf6-a4853e374f6e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047060 Apr 06 16:44:36.743773 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 438/897] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:36 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:37.224931 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a898c9c5-4474-40f0-bb1d-22fb101dce61 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:37.225856 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a898c9c5-4474-40f0-bb1d-22fb101dce61 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:37.232257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a898c9c5-4474-40f0-bb1d-22fb101dce61 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:37.232720 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a898c9c5-4474-40f0-bb1d-22fb101dce61 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:37.233502 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a898c9c5-4474-40f0-bb1d-22fb101dce61 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:37.233961 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a898c9c5-4474-40f0-bb1d-22fb101dce61 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:37.268242 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a898c9c5-4474-40f0-bb1d-22fb101dce61 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047212 Apr 06 16:44:37.268830 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 460/898] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:37 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:37.758803 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c7b1ccee-956e-4f98-b67e-c05cc4899e49 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:37.759761 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c7b1ccee-956e-4f98-b67e-c05cc4899e49 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:37.766209 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7b1ccee-956e-4f98-b67e-c05cc4899e49 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:37.766664 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7b1ccee-956e-4f98-b67e-c05cc4899e49 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:37.767429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7b1ccee-956e-4f98-b67e-c05cc4899e49 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:37.767866 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7b1ccee-956e-4f98-b67e-c05cc4899e49 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:37.796998 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c7b1ccee-956e-4f98-b67e-c05cc4899e49 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044596 Apr 06 16:44:37.797554 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 439/899] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:37 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:38.280483 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-22d554fd-87b9-43ce-b951-102c141d332d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:38.281598 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-22d554fd-87b9-43ce-b951-102c141d332d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:38.289770 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22d554fd-87b9-43ce-b951-102c141d332d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:38.290327 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22d554fd-87b9-43ce-b951-102c141d332d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:38.291224 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22d554fd-87b9-43ce-b951-102c141d332d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:38.291658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22d554fd-87b9-43ce-b951-102c141d332d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:38.326105 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-22d554fd-87b9-43ce-b951-102c141d332d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049618 Apr 06 16:44:38.326724 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 461/900] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:38 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:38.810652 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-15753103-8fc5-4567-aabd-6f8abf018fa0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:38.811580 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-15753103-8fc5-4567-aabd-6f8abf018fa0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:38.818330 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15753103-8fc5-4567-aabd-6f8abf018fa0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:38.818803 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15753103-8fc5-4567-aabd-6f8abf018fa0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:38.819553 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15753103-8fc5-4567-aabd-6f8abf018fa0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:38.820014 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15753103-8fc5-4567-aabd-6f8abf018fa0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:38.852818 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-15753103-8fc5-4567-aabd-6f8abf018fa0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046314 Apr 06 16:44:38.853427 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 440/901] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:38 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:39.338103 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-568c6814-c3d1-4ced-b76d-5f93a0af51bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:39.339036 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-568c6814-c3d1-4ced-b76d-5f93a0af51bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:39.345389 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-568c6814-c3d1-4ced-b76d-5f93a0af51bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:39.345844 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-568c6814-c3d1-4ced-b76d-5f93a0af51bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:39.346612 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-568c6814-c3d1-4ced-b76d-5f93a0af51bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:39.347043 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-568c6814-c3d1-4ced-b76d-5f93a0af51bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:39.378029 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-568c6814-c3d1-4ced-b76d-5f93a0af51bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043881 Apr 06 16:44:39.378504 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 462/902] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:39 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:39.865368 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1adce6cf-b691-42a4-a42e-0f4a26849ea6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:39.866570 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1adce6cf-b691-42a4-a42e-0f4a26849ea6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:39.873244 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1adce6cf-b691-42a4-a42e-0f4a26849ea6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:39.873700 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1adce6cf-b691-42a4-a42e-0f4a26849ea6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:39.874474 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1adce6cf-b691-42a4-a42e-0f4a26849ea6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:39.874906 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1adce6cf-b691-42a4-a42e-0f4a26849ea6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:39.905577 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1adce6cf-b691-42a4-a42e-0f4a26849ea6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044442 Apr 06 16:44:39.906111 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 441/903] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:39 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:40.389743 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d1173954-f3ea-4941-8ae5-bdd1bc78292b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:40.390673 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d1173954-f3ea-4941-8ae5-bdd1bc78292b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:40.397070 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1173954-f3ea-4941-8ae5-bdd1bc78292b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:40.397376 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1173954-f3ea-4941-8ae5-bdd1bc78292b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:40.398131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1173954-f3ea-4941-8ae5-bdd1bc78292b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:40.398563 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1173954-f3ea-4941-8ae5-bdd1bc78292b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:40.428437 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d1173954-f3ea-4941-8ae5-bdd1bc78292b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043000 Apr 06 16:44:40.429050 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 463/904] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:40 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:40.919916 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8ee299db-3610-4172-947f-bff360362bf3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:40.920854 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8ee299db-3610-4172-947f-bff360362bf3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:40.927497 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ee299db-3610-4172-947f-bff360362bf3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:40.927942 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ee299db-3610-4172-947f-bff360362bf3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:40.928725 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ee299db-3610-4172-947f-bff360362bf3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:40.929164 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ee299db-3610-4172-947f-bff360362bf3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:40.958375 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8ee299db-3610-4172-947f-bff360362bf3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042476 Apr 06 16:44:40.958959 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 442/905] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:40 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:41.441312 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-89cf7cdc-6006-4f9b-a38e-78c656c6842a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:41.442253 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-89cf7cdc-6006-4f9b-a38e-78c656c6842a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:41.448095 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89cf7cdc-6006-4f9b-a38e-78c656c6842a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:41.448539 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89cf7cdc-6006-4f9b-a38e-78c656c6842a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:41.449567 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89cf7cdc-6006-4f9b-a38e-78c656c6842a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:41.449988 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89cf7cdc-6006-4f9b-a38e-78c656c6842a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:41.478469 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-89cf7cdc-6006-4f9b-a38e-78c656c6842a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041160 Apr 06 16:44:41.479284 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 464/906] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:41 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:41.972054 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-843d5df9-7013-42c8-9bfc-1e791282bcd2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:41.972976 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-843d5df9-7013-42c8-9bfc-1e791282bcd2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:41.979575 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-843d5df9-7013-42c8-9bfc-1e791282bcd2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:41.980022 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-843d5df9-7013-42c8-9bfc-1e791282bcd2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:41.980813 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-843d5df9-7013-42c8-9bfc-1e791282bcd2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:41.981245 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-843d5df9-7013-42c8-9bfc-1e791282bcd2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:42.010159 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-843d5df9-7013-42c8-9bfc-1e791282bcd2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042455 Apr 06 16:44:42.010711 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 443/907] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:41 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:42.491587 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d6bd395f-dd01-4871-bf07-3dd7e7b3da6b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:42.492508 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d6bd395f-dd01-4871-bf07-3dd7e7b3da6b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:42.498696 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6bd395f-dd01-4871-bf07-3dd7e7b3da6b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:42.499148 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6bd395f-dd01-4871-bf07-3dd7e7b3da6b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:42.499886 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6bd395f-dd01-4871-bf07-3dd7e7b3da6b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:42.500309 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6bd395f-dd01-4871-bf07-3dd7e7b3da6b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:42.531597 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d6bd395f-dd01-4871-bf07-3dd7e7b3da6b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044306 Apr 06 16:44:42.532520 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 465/908] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:42 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:43.024892 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-da707f08-d535-4e2d-9d6c-44accd39f831 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:43.026127 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-da707f08-d535-4e2d-9d6c-44accd39f831 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:43.037941 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da707f08-d535-4e2d-9d6c-44accd39f831 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:43.038682 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da707f08-d535-4e2d-9d6c-44accd39f831 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:43.040005 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da707f08-d535-4e2d-9d6c-44accd39f831 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:43.040784 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da707f08-d535-4e2d-9d6c-44accd39f831 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:43.074957 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-da707f08-d535-4e2d-9d6c-44accd39f831 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055511 Apr 06 16:44:43.075535 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 444/909] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:43 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:43.544844 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c09eb3de-eea3-4203-b5cd-e3252d837b33 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:43.545676 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c09eb3de-eea3-4203-b5cd-e3252d837b33 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:43.552156 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c09eb3de-eea3-4203-b5cd-e3252d837b33 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:43.552611 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c09eb3de-eea3-4203-b5cd-e3252d837b33 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:43.553423 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c09eb3de-eea3-4203-b5cd-e3252d837b33 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:43.553855 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c09eb3de-eea3-4203-b5cd-e3252d837b33 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:43.584006 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c09eb3de-eea3-4203-b5cd-e3252d837b33 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043251 Apr 06 16:44:43.584574 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 466/910] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:43 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:44.087845 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-94e20f71-49b2-43e1-b105-96f21744a95a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:44.088935 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-94e20f71-49b2-43e1-b105-96f21744a95a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:44.098241 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94e20f71-49b2-43e1-b105-96f21744a95a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:44.098692 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94e20f71-49b2-43e1-b105-96f21744a95a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:44.099472 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94e20f71-49b2-43e1-b105-96f21744a95a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:44.099905 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94e20f71-49b2-43e1-b105-96f21744a95a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:44.131712 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-94e20f71-49b2-43e1-b105-96f21744a95a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049370 Apr 06 16:44:44.132275 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 445/911] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:44 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:44.597643 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-84670c82-3b08-4ef6-9b33-5c72570db831 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:44.598575 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-84670c82-3b08-4ef6-9b33-5c72570db831 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:44.607418 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84670c82-3b08-4ef6-9b33-5c72570db831 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:44.607876 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84670c82-3b08-4ef6-9b33-5c72570db831 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:44.608722 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84670c82-3b08-4ef6-9b33-5c72570db831 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:44.609342 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84670c82-3b08-4ef6-9b33-5c72570db831 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:44.640837 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-84670c82-3b08-4ef6-9b33-5c72570db831 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048387 Apr 06 16:44:44.645470 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 467/912] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:44 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:45.147380 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ddd4d4ce-aa9f-47bf-8c1a-fdb3619fdb31 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:45.148305 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ddd4d4ce-aa9f-47bf-8c1a-fdb3619fdb31 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:45.155046 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddd4d4ce-aa9f-47bf-8c1a-fdb3619fdb31 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:45.155499 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddd4d4ce-aa9f-47bf-8c1a-fdb3619fdb31 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:45.156268 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddd4d4ce-aa9f-47bf-8c1a-fdb3619fdb31 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:45.156721 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddd4d4ce-aa9f-47bf-8c1a-fdb3619fdb31 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:45.186426 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ddd4d4ce-aa9f-47bf-8c1a-fdb3619fdb31 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043829 Apr 06 16:44:45.186988 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 446/913] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:45 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:45.656258 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-834f3610-5d06-47d0-9cef-ff37dc6a5a34 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:45.657237 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-834f3610-5d06-47d0-9cef-ff37dc6a5a34 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:45.664577 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-834f3610-5d06-47d0-9cef-ff37dc6a5a34 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:45.665058 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-834f3610-5d06-47d0-9cef-ff37dc6a5a34 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:45.666010 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-834f3610-5d06-47d0-9cef-ff37dc6a5a34 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:45.666644 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-834f3610-5d06-47d0-9cef-ff37dc6a5a34 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:45.699887 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-834f3610-5d06-47d0-9cef-ff37dc6a5a34 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049534 Apr 06 16:44:45.700457 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 468/914] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:45 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:46.199575 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a8bb5489-705f-4a25-b297-ec6075f1f70c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:46.200619 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a8bb5489-705f-4a25-b297-ec6075f1f70c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:46.210714 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8bb5489-705f-4a25-b297-ec6075f1f70c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:46.211214 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8bb5489-705f-4a25-b297-ec6075f1f70c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:46.212221 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8bb5489-705f-4a25-b297-ec6075f1f70c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:46.212660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8bb5489-705f-4a25-b297-ec6075f1f70c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:46.244610 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a8bb5489-705f-4a25-b297-ec6075f1f70c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049662 Apr 06 16:44:46.245213 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 447/915] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:46 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:46.713680 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b181eee6-ac21-4dc7-872a-4f644332ee2a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:46.714516 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b181eee6-ac21-4dc7-872a-4f644332ee2a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:46.721030 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b181eee6-ac21-4dc7-872a-4f644332ee2a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:46.721480 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b181eee6-ac21-4dc7-872a-4f644332ee2a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:46.722255 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b181eee6-ac21-4dc7-872a-4f644332ee2a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:46.722689 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b181eee6-ac21-4dc7-872a-4f644332ee2a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:46.754606 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b181eee6-ac21-4dc7-872a-4f644332ee2a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046278 Apr 06 16:44:46.755218 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 469/916] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:46 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:47.260380 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-04672a7c-2188-4de6-a835-08fd9ea3b2b7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:47.261493 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-04672a7c-2188-4de6-a835-08fd9ea3b2b7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:47.270742 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04672a7c-2188-4de6-a835-08fd9ea3b2b7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:47.271399 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04672a7c-2188-4de6-a835-08fd9ea3b2b7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:47.272611 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04672a7c-2188-4de6-a835-08fd9ea3b2b7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:47.273248 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04672a7c-2188-4de6-a835-08fd9ea3b2b7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:47.313578 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-04672a7c-2188-4de6-a835-08fd9ea3b2b7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059576 Apr 06 16:44:47.314160 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 448/917] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:47 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:47.766930 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a1be4081-782a-485b-a549-64aca4d59508 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:47.768390 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a1be4081-782a-485b-a549-64aca4d59508 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:47.777405 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1be4081-782a-485b-a549-64aca4d59508 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:47.778178 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1be4081-782a-485b-a549-64aca4d59508 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:47.779101 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1be4081-782a-485b-a549-64aca4d59508 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:47.779621 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1be4081-782a-485b-a549-64aca4d59508 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:47.816884 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a1be4081-782a-485b-a549-64aca4d59508 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054510 Apr 06 16:44:47.817643 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 470/918] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:47 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:48.328247 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c703aa7e-a202-4d42-8dde-5246e336fc08 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:48.329217 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c703aa7e-a202-4d42-8dde-5246e336fc08 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:48.338966 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c703aa7e-a202-4d42-8dde-5246e336fc08 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:48.339618 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c703aa7e-a202-4d42-8dde-5246e336fc08 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:48.340754 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c703aa7e-a202-4d42-8dde-5246e336fc08 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:48.341407 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c703aa7e-a202-4d42-8dde-5246e336fc08 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:48.373861 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c703aa7e-a202-4d42-8dde-5246e336fc08 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050578 Apr 06 16:44:48.374525 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 449/919] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:48 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:48.830110 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3fd47499-350f-4389-a7b1-bf8a8ed11328 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:48.830948 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3fd47499-350f-4389-a7b1-bf8a8ed11328 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:48.837393 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fd47499-350f-4389-a7b1-bf8a8ed11328 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:48.837842 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fd47499-350f-4389-a7b1-bf8a8ed11328 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:48.839289 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fd47499-350f-4389-a7b1-bf8a8ed11328 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:48.839732 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fd47499-350f-4389-a7b1-bf8a8ed11328 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:48.871325 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3fd47499-350f-4389-a7b1-bf8a8ed11328 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046420 Apr 06 16:44:48.871911 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 471/920] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:48 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:49.387136 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7dd4a3b3-d5d9-4bc7-a305-39ebe6de163b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:49.388049 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7dd4a3b3-d5d9-4bc7-a305-39ebe6de163b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:49.394680 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7dd4a3b3-d5d9-4bc7-a305-39ebe6de163b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:49.395126 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7dd4a3b3-d5d9-4bc7-a305-39ebe6de163b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:49.395866 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7dd4a3b3-d5d9-4bc7-a305-39ebe6de163b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:49.396291 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7dd4a3b3-d5d9-4bc7-a305-39ebe6de163b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:49.425830 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7dd4a3b3-d5d9-4bc7-a305-39ebe6de163b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042734 Apr 06 16:44:49.426374 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 450/921] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:49 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:49.885306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1c9956e6-f52d-4ab3-90e9-752d30caf99c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:49.886212 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1c9956e6-f52d-4ab3-90e9-752d30caf99c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:49.892774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c9956e6-f52d-4ab3-90e9-752d30caf99c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:49.893233 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c9956e6-f52d-4ab3-90e9-752d30caf99c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:49.893995 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c9956e6-f52d-4ab3-90e9-752d30caf99c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:49.894429 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1c9956e6-f52d-4ab3-90e9-752d30caf99c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:49.923433 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1c9956e6-f52d-4ab3-90e9-752d30caf99c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042651 Apr 06 16:44:49.924193 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 472/922] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:49 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:50.441227 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fa52cc51-9d9c-46f0-b6de-84609efa52f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:50.442152 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fa52cc51-9d9c-46f0-b6de-84609efa52f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:50.449165 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa52cc51-9d9c-46f0-b6de-84609efa52f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:50.449645 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa52cc51-9d9c-46f0-b6de-84609efa52f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:50.450410 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa52cc51-9d9c-46f0-b6de-84609efa52f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:50.450838 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa52cc51-9d9c-46f0-b6de-84609efa52f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:50.480090 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fa52cc51-9d9c-46f0-b6de-84609efa52f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043003 Apr 06 16:44:50.480661 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 451/923] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:50 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:50.937852 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d1cbc7fd-a9a0-4005-9e0d-668621e09914 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:50.939004 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d1cbc7fd-a9a0-4005-9e0d-668621e09914 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:50.947535 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1cbc7fd-a9a0-4005-9e0d-668621e09914 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:50.948130 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1cbc7fd-a9a0-4005-9e0d-668621e09914 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:50.949216 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1cbc7fd-a9a0-4005-9e0d-668621e09914 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:50.949816 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1cbc7fd-a9a0-4005-9e0d-668621e09914 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:50.982841 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d1cbc7fd-a9a0-4005-9e0d-668621e09914 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050504 Apr 06 16:44:50.983490 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 473/924] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:50 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:51.497344 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b8fc34bc-6f4e-4c09-8ae0-5547048c06ae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:51.498919 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b8fc34bc-6f4e-4c09-8ae0-5547048c06ae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:51.510315 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8fc34bc-6f4e-4c09-8ae0-5547048c06ae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:51.511067 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8fc34bc-6f4e-4c09-8ae0-5547048c06ae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:51.512346 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8fc34bc-6f4e-4c09-8ae0-5547048c06ae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:51.513160 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8fc34bc-6f4e-4c09-8ae0-5547048c06ae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:51.549675 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b8fc34bc-6f4e-4c09-8ae0-5547048c06ae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059468 Apr 06 16:44:51.550577 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 452/925] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:51 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:51.996398 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4ee3def0-54c7-4e65-b1e7-620ca9897dd3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:51.997247 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4ee3def0-54c7-4e65-b1e7-620ca9897dd3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:52.004095 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ee3def0-54c7-4e65-b1e7-620ca9897dd3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:52.004535 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ee3def0-54c7-4e65-b1e7-620ca9897dd3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:52.005320 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ee3def0-54c7-4e65-b1e7-620ca9897dd3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:52.005744 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ee3def0-54c7-4e65-b1e7-620ca9897dd3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:52.037027 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4ee3def0-54c7-4e65-b1e7-620ca9897dd3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044641 Apr 06 16:44:52.037598 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 474/926] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:51 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:52.563299 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-912c62c7-5a5d-4b7a-8802-7903c450a484 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:52.564244 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-912c62c7-5a5d-4b7a-8802-7903c450a484 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:52.573800 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-912c62c7-5a5d-4b7a-8802-7903c450a484 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:52.574445 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-912c62c7-5a5d-4b7a-8802-7903c450a484 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:52.575696 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-912c62c7-5a5d-4b7a-8802-7903c450a484 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:52.576307 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-912c62c7-5a5d-4b7a-8802-7903c450a484 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:52.606796 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-912c62c7-5a5d-4b7a-8802-7903c450a484 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048141 Apr 06 16:44:52.607232 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 453/927] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:52 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:53.048666 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-75753e2e-fb57-49a9-aa9a-714ffc9215e7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:53.049732 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-75753e2e-fb57-49a9-aa9a-714ffc9215e7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:53.056340 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75753e2e-fb57-49a9-aa9a-714ffc9215e7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:53.056864 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75753e2e-fb57-49a9-aa9a-714ffc9215e7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:53.057633 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75753e2e-fb57-49a9-aa9a-714ffc9215e7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:53.058075 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75753e2e-fb57-49a9-aa9a-714ffc9215e7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:53.087472 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-75753e2e-fb57-49a9-aa9a-714ffc9215e7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042818 Apr 06 16:44:53.088078 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 475/928] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:53 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:53.620249 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1023c539-bbbb-4707-b998-a35de43dada2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:53.621345 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1023c539-bbbb-4707-b998-a35de43dada2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:53.628992 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1023c539-bbbb-4707-b998-a35de43dada2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:53.629456 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1023c539-bbbb-4707-b998-a35de43dada2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:53.630208 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1023c539-bbbb-4707-b998-a35de43dada2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:53.630655 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1023c539-bbbb-4707-b998-a35de43dada2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:53.659321 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1023c539-bbbb-4707-b998-a35de43dada2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043921 Apr 06 16:44:53.659954 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 454/929] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:53 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:54.099228 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f46410f2-ac99-4d25-85a0-32e41494b439 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:54.100131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f46410f2-ac99-4d25-85a0-32e41494b439 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:54.106554 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f46410f2-ac99-4d25-85a0-32e41494b439 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:54.107000 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f46410f2-ac99-4d25-85a0-32e41494b439 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:54.107747 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f46410f2-ac99-4d25-85a0-32e41494b439 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:54.108171 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f46410f2-ac99-4d25-85a0-32e41494b439 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:54.137203 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f46410f2-ac99-4d25-85a0-32e41494b439 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042078 Apr 06 16:44:54.137625 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 476/930] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:54 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:54.671835 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-43c4f32d-4b45-4e19-81a5-4d3de4b0b3c0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:54.673101 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-43c4f32d-4b45-4e19-81a5-4d3de4b0b3c0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:54.679951 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43c4f32d-4b45-4e19-81a5-4d3de4b0b3c0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:54.680399 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43c4f32d-4b45-4e19-81a5-4d3de4b0b3c0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:54.681250 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43c4f32d-4b45-4e19-81a5-4d3de4b0b3c0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:54.681640 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43c4f32d-4b45-4e19-81a5-4d3de4b0b3c0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:54.711279 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-43c4f32d-4b45-4e19-81a5-4d3de4b0b3c0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044265 Apr 06 16:44:54.711851 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 455/931] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:54 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:55.150747 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b420e82b-5e87-49d9-b250-fe01849fe90d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:55.151714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b420e82b-5e87-49d9-b250-fe01849fe90d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:55.158887 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b420e82b-5e87-49d9-b250-fe01849fe90d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:55.159338 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b420e82b-5e87-49d9-b250-fe01849fe90d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:55.160184 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b420e82b-5e87-49d9-b250-fe01849fe90d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:55.160617 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b420e82b-5e87-49d9-b250-fe01849fe90d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:55.189730 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b420e82b-5e87-49d9-b250-fe01849fe90d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044027 Apr 06 16:44:55.190186 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 477/932] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:55 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:55.725631 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5af1f909-c70f-461b-98eb-ef3bf44f2de5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:55.726553 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5af1f909-c70f-461b-98eb-ef3bf44f2de5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:55.733204 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5af1f909-c70f-461b-98eb-ef3bf44f2de5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:55.733681 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5af1f909-c70f-461b-98eb-ef3bf44f2de5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:55.734455 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5af1f909-c70f-461b-98eb-ef3bf44f2de5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:55.734885 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5af1f909-c70f-461b-98eb-ef3bf44f2de5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:55.767822 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5af1f909-c70f-461b-98eb-ef3bf44f2de5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047186 Apr 06 16:44:55.768521 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 456/933] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:55 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:56.203085 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fbacb5cd-4f8e-4845-acc1-a27b35355cad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:56.204229 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fbacb5cd-4f8e-4845-acc1-a27b35355cad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:56.212645 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbacb5cd-4f8e-4845-acc1-a27b35355cad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:56.213311 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbacb5cd-4f8e-4845-acc1-a27b35355cad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:56.214352 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbacb5cd-4f8e-4845-acc1-a27b35355cad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:56.214812 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbacb5cd-4f8e-4845-acc1-a27b35355cad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:56.248441 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fbacb5cd-4f8e-4845-acc1-a27b35355cad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049021 Apr 06 16:44:56.248441 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 478/934] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:56 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:56.784090 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-748c214b-d7c9-4e01-990e-1e655c08f77d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:56.785318 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-748c214b-d7c9-4e01-990e-1e655c08f77d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:56.793786 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-748c214b-d7c9-4e01-990e-1e655c08f77d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:56.794369 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-748c214b-d7c9-4e01-990e-1e655c08f77d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:56.795458 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-748c214b-d7c9-4e01-990e-1e655c08f77d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:56.795974 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-748c214b-d7c9-4e01-990e-1e655c08f77d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:56.830265 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-748c214b-d7c9-4e01-990e-1e655c08f77d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053668 Apr 06 16:44:56.830824 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 457/935] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:56 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:57.262096 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c967adc4-aaee-4217-b986-729f23230811 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:57.263338 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c967adc4-aaee-4217-b986-729f23230811 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:57.273484 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c967adc4-aaee-4217-b986-729f23230811 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:57.274339 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c967adc4-aaee-4217-b986-729f23230811 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:57.275471 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c967adc4-aaee-4217-b986-729f23230811 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:57.276185 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c967adc4-aaee-4217-b986-729f23230811 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:57.312303 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c967adc4-aaee-4217-b986-729f23230811 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056149 Apr 06 16:44:57.312911 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 479/936] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:57 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:57.843402 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-98c6bbd0-59a3-4271-8610-e6ae3373de25 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:57.844399 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-98c6bbd0-59a3-4271-8610-e6ae3373de25 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:57.852340 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98c6bbd0-59a3-4271-8610-e6ae3373de25 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:57.852904 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98c6bbd0-59a3-4271-8610-e6ae3373de25 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:57.853707 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98c6bbd0-59a3-4271-8610-e6ae3373de25 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:57.854139 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98c6bbd0-59a3-4271-8610-e6ae3373de25 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:57.884711 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-98c6bbd0-59a3-4271-8610-e6ae3373de25 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046027 Apr 06 16:44:57.885345 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 458/937] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:57 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:58.326363 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eca6f1dd-20f6-4609-89d8-16f39ca2bbf4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:58.327291 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eca6f1dd-20f6-4609-89d8-16f39ca2bbf4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:58.333528 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eca6f1dd-20f6-4609-89d8-16f39ca2bbf4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:58.333978 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eca6f1dd-20f6-4609-89d8-16f39ca2bbf4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:58.334742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eca6f1dd-20f6-4609-89d8-16f39ca2bbf4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:58.335183 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eca6f1dd-20f6-4609-89d8-16f39ca2bbf4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:58.366256 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eca6f1dd-20f6-4609-89d8-16f39ca2bbf4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045714 Apr 06 16:44:58.366843 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 480/938] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:58 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:58.897661 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e33bcab8-4a3f-4591-beae-1c812f81482a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:58.898589 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e33bcab8-4a3f-4591-beae-1c812f81482a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:58.905722 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e33bcab8-4a3f-4591-beae-1c812f81482a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:58.906172 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e33bcab8-4a3f-4591-beae-1c812f81482a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:58.906939 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e33bcab8-4a3f-4591-beae-1c812f81482a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:58.907408 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e33bcab8-4a3f-4591-beae-1c812f81482a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:58.940075 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e33bcab8-4a3f-4591-beae-1c812f81482a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046393 Apr 06 16:44:58.940676 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 459/939] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:58 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:44:59.382032 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-38c53bdd-cb56-428f-a617-355c21260c5f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:59.383075 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-38c53bdd-cb56-428f-a617-355c21260c5f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:59.390813 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38c53bdd-cb56-428f-a617-355c21260c5f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:59.391259 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38c53bdd-cb56-428f-a617-355c21260c5f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:59.392018 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38c53bdd-cb56-428f-a617-355c21260c5f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:59.392440 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38c53bdd-cb56-428f-a617-355c21260c5f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:59.421997 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-38c53bdd-cb56-428f-a617-355c21260c5f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045722 Apr 06 16:44:59.422561 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 481/940] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:44:59 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:44:59.952753 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1a4810b6-f118-424e-81c7-b22acbf824c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:44:59.953731 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1a4810b6-f118-424e-81c7-b22acbf824c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:44:59.966354 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a4810b6-f118-424e-81c7-b22acbf824c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:59.966354 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a4810b6-f118-424e-81c7-b22acbf824c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:59.966354 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a4810b6-f118-424e-81c7-b22acbf824c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:44:59.966354 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a4810b6-f118-424e-81c7-b22acbf824c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:44:59.993279 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1a4810b6-f118-424e-81c7-b22acbf824c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044646 Apr 06 16:44:59.994072 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 460/941] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:44:59 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:00.436142 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a147fce0-bfd4-4412-985a-6de9d7e50565 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:00.437107 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a147fce0-bfd4-4412-985a-6de9d7e50565 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:00.444049 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a147fce0-bfd4-4412-985a-6de9d7e50565 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:00.444495 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a147fce0-bfd4-4412-985a-6de9d7e50565 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:00.445523 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a147fce0-bfd4-4412-985a-6de9d7e50565 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:00.446017 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a147fce0-bfd4-4412-985a-6de9d7e50565 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:00.478412 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a147fce0-bfd4-4412-985a-6de9d7e50565 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047830 Apr 06 16:45:00.478985 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 482/942] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:00 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:01.005889 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d174dea0-e4ec-4b20-99da-f5b84256aeb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:01.006821 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d174dea0-e4ec-4b20-99da-f5b84256aeb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:01.013672 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d174dea0-e4ec-4b20-99da-f5b84256aeb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:01.014286 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d174dea0-e4ec-4b20-99da-f5b84256aeb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:01.015112 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d174dea0-e4ec-4b20-99da-f5b84256aeb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:01.015507 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d174dea0-e4ec-4b20-99da-f5b84256aeb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:01.047028 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d174dea0-e4ec-4b20-99da-f5b84256aeb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045312 Apr 06 16:45:01.047626 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 461/943] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:01 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:01.490945 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e33641ef-be2f-4777-9282-e229588f0a3f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:01.491833 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e33641ef-be2f-4777-9282-e229588f0a3f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:01.498307 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e33641ef-be2f-4777-9282-e229588f0a3f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:01.498756 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e33641ef-be2f-4777-9282-e229588f0a3f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:01.499644 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e33641ef-be2f-4777-9282-e229588f0a3f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:01.500059 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e33641ef-be2f-4777-9282-e229588f0a3f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:01.529973 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e33641ef-be2f-4777-9282-e229588f0a3f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043469 Apr 06 16:45:01.530812 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 483/944] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:01 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:02.060591 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dd93ff21-afd8-4384-9061-f2328b599506 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:02.061901 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dd93ff21-afd8-4384-9061-f2328b599506 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:02.070198 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd93ff21-afd8-4384-9061-f2328b599506 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:02.070927 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd93ff21-afd8-4384-9061-f2328b599506 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:02.071897 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd93ff21-afd8-4384-9061-f2328b599506 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:02.072331 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd93ff21-afd8-4384-9061-f2328b599506 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:02.106675 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dd93ff21-afd8-4384-9061-f2328b599506 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050199 Apr 06 16:45:02.107429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 462/945] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:02 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 06 16:45:02.544552 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-69d524de-63e9-4e98-9741-ec7cbd9edd90 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:02.545799 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-69d524de-63e9-4e98-9741-ec7cbd9edd90 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:02.555701 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69d524de-63e9-4e98-9741-ec7cbd9edd90 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:02.556157 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69d524de-63e9-4e98-9741-ec7cbd9edd90 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:02.557149 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69d524de-63e9-4e98-9741-ec7cbd9edd90 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:02.557626 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69d524de-63e9-4e98-9741-ec7cbd9edd90 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:02.588278 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-69d524de-63e9-4e98-9741-ec7cbd9edd90 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049968 Apr 06 16:45:02.588768 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 484/946] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:02 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:03.124633 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-12467b3d-5e63-475c-9715-b24ca30fcdf7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:03.125879 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-12467b3d-5e63-475c-9715-b24ca30fcdf7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:03.132833 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12467b3d-5e63-475c-9715-b24ca30fcdf7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:03.133282 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12467b3d-5e63-475c-9715-b24ca30fcdf7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:03.134083 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12467b3d-5e63-475c-9715-b24ca30fcdf7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:03.134514 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12467b3d-5e63-475c-9715-b24ca30fcdf7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:03.163788 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-12467b3d-5e63-475c-9715-b24ca30fcdf7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045615 Apr 06 16:45:03.164713 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 463/947] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:03 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:03.601454 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-24226383-a5d2-4d80-84aa-248c78d2f7df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:03.602537 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-24226383-a5d2-4d80-84aa-248c78d2f7df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:03.609821 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24226383-a5d2-4d80-84aa-248c78d2f7df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:03.610423 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24226383-a5d2-4d80-84aa-248c78d2f7df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:03.611190 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24226383-a5d2-4d80-84aa-248c78d2f7df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:03.611622 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24226383-a5d2-4d80-84aa-248c78d2f7df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:03.641817 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-24226383-a5d2-4d80-84aa-248c78d2f7df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044923 Apr 06 16:45:03.642419 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 485/948] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:03 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:04.178265 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ceaa5a64-fa8c-4f0e-a340-bbe37ef95261 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:04.179196 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ceaa5a64-fa8c-4f0e-a340-bbe37ef95261 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:04.186786 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ceaa5a64-fa8c-4f0e-a340-bbe37ef95261 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:04.187305 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ceaa5a64-fa8c-4f0e-a340-bbe37ef95261 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:04.188260 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ceaa5a64-fa8c-4f0e-a340-bbe37ef95261 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:04.188807 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ceaa5a64-fa8c-4f0e-a340-bbe37ef95261 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:04.221120 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ceaa5a64-fa8c-4f0e-a340-bbe37ef95261 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048278 Apr 06 16:45:04.221834 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 464/949] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:04 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:04.654544 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1bab3395-fd2e-4c0a-b12a-b74932ee8cbc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:04.655451 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1bab3395-fd2e-4c0a-b12a-b74932ee8cbc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:04.661835 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bab3395-fd2e-4c0a-b12a-b74932ee8cbc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:04.662273 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bab3395-fd2e-4c0a-b12a-b74932ee8cbc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:04.663022 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bab3395-fd2e-4c0a-b12a-b74932ee8cbc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:04.663449 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bab3395-fd2e-4c0a-b12a-b74932ee8cbc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:04.694172 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1bab3395-fd2e-4c0a-b12a-b74932ee8cbc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043444 Apr 06 16:45:04.694618 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 486/950] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:04 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:05.235104 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0f21d93f-9cee-4d9e-92a7-de45725ee77f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:05.236163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0f21d93f-9cee-4d9e-92a7-de45725ee77f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:05.244130 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f21d93f-9cee-4d9e-92a7-de45725ee77f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:05.244581 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f21d93f-9cee-4d9e-92a7-de45725ee77f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:05.245487 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f21d93f-9cee-4d9e-92a7-de45725ee77f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:05.245923 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f21d93f-9cee-4d9e-92a7-de45725ee77f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:05.276421 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0f21d93f-9cee-4d9e-92a7-de45725ee77f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046315 Apr 06 16:45:05.276931 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 465/951] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:05 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:05.709377 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3e94ff66-7bb1-4254-923b-7c7f41e86419 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:05.710494 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3e94ff66-7bb1-4254-923b-7c7f41e86419 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:05.718087 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e94ff66-7bb1-4254-923b-7c7f41e86419 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:05.718680 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e94ff66-7bb1-4254-923b-7c7f41e86419 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:05.719564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e94ff66-7bb1-4254-923b-7c7f41e86419 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:05.720114 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e94ff66-7bb1-4254-923b-7c7f41e86419 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:05.754690 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3e94ff66-7bb1-4254-923b-7c7f41e86419 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051291 Apr 06 16:45:05.755304 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 487/952] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:05 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:05.820206 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 16:45:05.820371 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 16:45:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 16:45:06.288046 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-17b0c15b-680a-49fb-9ad9-41ab2b4bf9e5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:06.289164 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-17b0c15b-680a-49fb-9ad9-41ab2b4bf9e5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:06.296725 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17b0c15b-680a-49fb-9ad9-41ab2b4bf9e5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:06.297212 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17b0c15b-680a-49fb-9ad9-41ab2b4bf9e5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:06.297982 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17b0c15b-680a-49fb-9ad9-41ab2b4bf9e5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:06.298416 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17b0c15b-680a-49fb-9ad9-41ab2b4bf9e5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:06.332339 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-17b0c15b-680a-49fb-9ad9-41ab2b4bf9e5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048172 Apr 06 16:45:06.333089 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 466/953] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:06 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:06.767835 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-93aafe71-5dc5-4b32-90ae-a21c4cd4c026 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:06.768791 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-93aafe71-5dc5-4b32-90ae-a21c4cd4c026 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:06.775444 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93aafe71-5dc5-4b32-90ae-a21c4cd4c026 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:06.775896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93aafe71-5dc5-4b32-90ae-a21c4cd4c026 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:06.776638 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93aafe71-5dc5-4b32-90ae-a21c4cd4c026 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:06.777102 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93aafe71-5dc5-4b32-90ae-a21c4cd4c026 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:06.806180 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-93aafe71-5dc5-4b32-90ae-a21c4cd4c026 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042347 Apr 06 16:45:06.806755 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 488/954] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:06 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:07.346025 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1f6535f0-77bd-4440-b3f0-57b125b886e3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:07.346967 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1f6535f0-77bd-4440-b3f0-57b125b886e3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:07.353695 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f6535f0-77bd-4440-b3f0-57b125b886e3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:07.354277 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f6535f0-77bd-4440-b3f0-57b125b886e3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:07.355165 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f6535f0-77bd-4440-b3f0-57b125b886e3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:07.355699 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f6535f0-77bd-4440-b3f0-57b125b886e3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:07.390874 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1f6535f0-77bd-4440-b3f0-57b125b886e3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050088 Apr 06 16:45:07.391449 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 467/955] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:07 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:07.818264 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-30559aeb-6859-4f49-abd8-de1d2bc7cd8c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:07.819212 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-30559aeb-6859-4f49-abd8-de1d2bc7cd8c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:07.826206 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30559aeb-6859-4f49-abd8-de1d2bc7cd8c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:07.826654 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30559aeb-6859-4f49-abd8-de1d2bc7cd8c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:07.827430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30559aeb-6859-4f49-abd8-de1d2bc7cd8c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:07.827864 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30559aeb-6859-4f49-abd8-de1d2bc7cd8c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:07.857365 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-30559aeb-6859-4f49-abd8-de1d2bc7cd8c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043053 Apr 06 16:45:07.857905 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 489/956] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:07 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:08.403348 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fc9024dd-b813-4462-a2b6-a65d35f3e717 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:08.404292 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fc9024dd-b813-4462-a2b6-a65d35f3e717 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:08.411090 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc9024dd-b813-4462-a2b6-a65d35f3e717 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:08.411536 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc9024dd-b813-4462-a2b6-a65d35f3e717 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:08.412295 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc9024dd-b813-4462-a2b6-a65d35f3e717 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:08.412725 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc9024dd-b813-4462-a2b6-a65d35f3e717 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:08.443127 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fc9024dd-b813-4462-a2b6-a65d35f3e717 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043958 Apr 06 16:45:08.443689 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 468/957] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:08 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:08.871343 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-88f85144-df04-4ef5-bf4b-376d4b03e760 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:08.872284 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-88f85144-df04-4ef5-bf4b-376d4b03e760 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:08.879985 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88f85144-df04-4ef5-bf4b-376d4b03e760 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:08.880608 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88f85144-df04-4ef5-bf4b-376d4b03e760 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:08.881374 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88f85144-df04-4ef5-bf4b-376d4b03e760 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:08.881821 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88f85144-df04-4ef5-bf4b-376d4b03e760 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:08.911414 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-88f85144-df04-4ef5-bf4b-376d4b03e760 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046243 Apr 06 16:45:08.911973 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 490/958] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:08 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:09.456151 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-786c15ed-16bd-46b3-afda-463922a5e8e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:09.457099 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-786c15ed-16bd-46b3-afda-463922a5e8e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:09.463559 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-786c15ed-16bd-46b3-afda-463922a5e8e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:09.464011 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-786c15ed-16bd-46b3-afda-463922a5e8e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:09.464830 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-786c15ed-16bd-46b3-afda-463922a5e8e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:09.465268 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-786c15ed-16bd-46b3-afda-463922a5e8e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:09.494712 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-786c15ed-16bd-46b3-afda-463922a5e8e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043335 Apr 06 16:45:09.495285 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 469/959] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:09 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:09.923628 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-164ee361-d0c0-46b8-8c0e-7d3b984ccefd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:09.924639 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-164ee361-d0c0-46b8-8c0e-7d3b984ccefd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:09.932147 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-164ee361-d0c0-46b8-8c0e-7d3b984ccefd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:09.932727 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-164ee361-d0c0-46b8-8c0e-7d3b984ccefd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:09.933656 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-164ee361-d0c0-46b8-8c0e-7d3b984ccefd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:09.934091 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-164ee361-d0c0-46b8-8c0e-7d3b984ccefd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:09.966475 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-164ee361-d0c0-46b8-8c0e-7d3b984ccefd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046905 Apr 06 16:45:09.967263 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 491/960] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:09 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:10.506913 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c4ba276f-b7c0-4e58-9fc1-e402b59efe06 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:10.507934 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c4ba276f-b7c0-4e58-9fc1-e402b59efe06 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:10.515407 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4ba276f-b7c0-4e58-9fc1-e402b59efe06 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:10.515993 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4ba276f-b7c0-4e58-9fc1-e402b59efe06 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:10.516838 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4ba276f-b7c0-4e58-9fc1-e402b59efe06 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:10.517279 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4ba276f-b7c0-4e58-9fc1-e402b59efe06 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:10.549464 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c4ba276f-b7c0-4e58-9fc1-e402b59efe06 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046551 Apr 06 16:45:10.550313 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 470/961] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:10 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:10.978911 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1240348f-9ff3-421b-9db4-42d226a297fb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:10.979886 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1240348f-9ff3-421b-9db4-42d226a297fb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:10.986408 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1240348f-9ff3-421b-9db4-42d226a297fb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:10.986864 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1240348f-9ff3-421b-9db4-42d226a297fb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:10.987644 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1240348f-9ff3-421b-9db4-42d226a297fb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:10.988071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1240348f-9ff3-421b-9db4-42d226a297fb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:11.018681 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1240348f-9ff3-421b-9db4-42d226a297fb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044012 Apr 06 16:45:11.019243 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 492/962] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:10 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:11.562485 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cb34ac28-08ce-4695-bd38-c425f2151fd0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:11.563408 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cb34ac28-08ce-4695-bd38-c425f2151fd0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:11.571083 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb34ac28-08ce-4695-bd38-c425f2151fd0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:11.571528 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb34ac28-08ce-4695-bd38-c425f2151fd0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:11.572375 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb34ac28-08ce-4695-bd38-c425f2151fd0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:11.572765 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb34ac28-08ce-4695-bd38-c425f2151fd0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:11.608035 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cb34ac28-08ce-4695-bd38-c425f2151fd0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050488 Apr 06 16:45:11.608819 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 471/963] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:11 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:12.032019 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9fd59dc8-189b-4662-b00d-0a6af3b45546 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:12.033016 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9fd59dc8-189b-4662-b00d-0a6af3b45546 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:12.040199 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fd59dc8-189b-4662-b00d-0a6af3b45546 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:12.040648 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fd59dc8-189b-4662-b00d-0a6af3b45546 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:12.041687 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fd59dc8-189b-4662-b00d-0a6af3b45546 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:12.042118 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fd59dc8-189b-4662-b00d-0a6af3b45546 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:12.083896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9fd59dc8-189b-4662-b00d-0a6af3b45546 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056978 Apr 06 16:45:12.084819 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 493/964] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:12 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:12.622922 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-18cc2a99-384b-45b9-9bc9-046aea0f83d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:12.623884 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-18cc2a99-384b-45b9-9bc9-046aea0f83d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:12.632086 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18cc2a99-384b-45b9-9bc9-046aea0f83d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:12.632672 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18cc2a99-384b-45b9-9bc9-046aea0f83d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:12.633482 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18cc2a99-384b-45b9-9bc9-046aea0f83d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:12.633911 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18cc2a99-384b-45b9-9bc9-046aea0f83d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:12.667638 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-18cc2a99-384b-45b9-9bc9-046aea0f83d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049551 Apr 06 16:45:12.668221 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 472/965] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:12 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:13.097656 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fded547c-19bf-4ca0-af93-cb477980280e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:13.098832 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fded547c-19bf-4ca0-af93-cb477980280e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:13.105967 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fded547c-19bf-4ca0-af93-cb477980280e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:13.106414 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fded547c-19bf-4ca0-af93-cb477980280e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:13.107232 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fded547c-19bf-4ca0-af93-cb477980280e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:13.107661 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fded547c-19bf-4ca0-af93-cb477980280e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:13.139367 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fded547c-19bf-4ca0-af93-cb477980280e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046817 Apr 06 16:45:13.139942 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 494/966] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:13 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:13.679929 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-01cd2a33-3184-4075-bdf2-be0408fa5448 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:13.680875 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-01cd2a33-3184-4075-bdf2-be0408fa5448 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:13.687618 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-01cd2a33-3184-4075-bdf2-be0408fa5448 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:13.688063 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-01cd2a33-3184-4075-bdf2-be0408fa5448 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:13.688874 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-01cd2a33-3184-4075-bdf2-be0408fa5448 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:13.689303 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-01cd2a33-3184-4075-bdf2-be0408fa5448 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:13.719493 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-01cd2a33-3184-4075-bdf2-be0408fa5448 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043659 Apr 06 16:45:13.720058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 473/967] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:13 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:14.152185 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5eba502f-22ed-4a91-b841-b8b88d1193a6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:14.153142 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5eba502f-22ed-4a91-b841-b8b88d1193a6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:14.159943 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5eba502f-22ed-4a91-b841-b8b88d1193a6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:14.160427 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5eba502f-22ed-4a91-b841-b8b88d1193a6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:14.161208 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5eba502f-22ed-4a91-b841-b8b88d1193a6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:14.161637 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5eba502f-22ed-4a91-b841-b8b88d1193a6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:14.194714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5eba502f-22ed-4a91-b841-b8b88d1193a6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045633 Apr 06 16:45:14.194714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 495/968] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:14 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:14.732224 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b29854c8-b2df-4cb9-8329-6a91262ebfe0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:14.733091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b29854c8-b2df-4cb9-8329-6a91262ebfe0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:14.740992 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b29854c8-b2df-4cb9-8329-6a91262ebfe0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:14.741575 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b29854c8-b2df-4cb9-8329-6a91262ebfe0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:14.742452 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b29854c8-b2df-4cb9-8329-6a91262ebfe0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:14.742888 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b29854c8-b2df-4cb9-8329-6a91262ebfe0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:14.772628 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b29854c8-b2df-4cb9-8329-6a91262ebfe0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044652 Apr 06 16:45:14.773316 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 474/969] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:14 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:15.206621 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9182a101-54a9-402c-bba8-442427012084 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:15.207554 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9182a101-54a9-402c-bba8-442427012084 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:15.214171 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9182a101-54a9-402c-bba8-442427012084 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:15.214620 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9182a101-54a9-402c-bba8-442427012084 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:15.215382 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9182a101-54a9-402c-bba8-442427012084 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:15.215824 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9182a101-54a9-402c-bba8-442427012084 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:15.246248 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9182a101-54a9-402c-bba8-442427012084 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043579 Apr 06 16:45:15.246816 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 496/970] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:15 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:15.785405 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1d4c9c22-e2d4-4826-8f00-ee944e6d7125 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:15.786336 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1d4c9c22-e2d4-4826-8f00-ee944e6d7125 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:15.793205 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d4c9c22-e2d4-4826-8f00-ee944e6d7125 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:15.793660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d4c9c22-e2d4-4826-8f00-ee944e6d7125 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:15.794467 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d4c9c22-e2d4-4826-8f00-ee944e6d7125 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:15.794880 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d4c9c22-e2d4-4826-8f00-ee944e6d7125 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:15.824824 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1d4c9c22-e2d4-4826-8f00-ee944e6d7125 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043538 Apr 06 16:45:15.825388 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 475/971] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:15 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:16.259781 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ee298be5-766d-4e2c-ad9b-66c04370afd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:16.260889 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ee298be5-766d-4e2c-ad9b-66c04370afd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:16.268163 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee298be5-766d-4e2c-ad9b-66c04370afd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:16.268643 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee298be5-766d-4e2c-ad9b-66c04370afd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:16.269486 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee298be5-766d-4e2c-ad9b-66c04370afd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:16.269910 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee298be5-766d-4e2c-ad9b-66c04370afd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:16.317114 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ee298be5-766d-4e2c-ad9b-66c04370afd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061676 Apr 06 16:45:16.317927 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 497/972] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:16 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:16.838040 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7bf18a40-9431-4647-b18f-da4e4c880592 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:16.838980 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7bf18a40-9431-4647-b18f-da4e4c880592 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:16.845567 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7bf18a40-9431-4647-b18f-da4e4c880592 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:16.846019 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7bf18a40-9431-4647-b18f-da4e4c880592 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:16.846778 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7bf18a40-9431-4647-b18f-da4e4c880592 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:16.847201 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7bf18a40-9431-4647-b18f-da4e4c880592 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:16.881230 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7bf18a40-9431-4647-b18f-da4e4c880592 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047875 Apr 06 16:45:16.881766 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 476/973] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:16 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:17.330142 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fd159470-500b-4e19-af52-16aa3e744822 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:17.331076 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fd159470-500b-4e19-af52-16aa3e744822 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:17.337825 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd159470-500b-4e19-af52-16aa3e744822 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:17.338268 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd159470-500b-4e19-af52-16aa3e744822 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:17.339040 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd159470-500b-4e19-af52-16aa3e744822 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:17.339463 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd159470-500b-4e19-af52-16aa3e744822 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:17.373027 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fd159470-500b-4e19-af52-16aa3e744822 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046849 Apr 06 16:45:17.373676 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 498/974] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:17 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:17.892992 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2fe29214-b9f7-4cea-a92e-f985b07e6b4b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:17.894108 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2fe29214-b9f7-4cea-a92e-f985b07e6b4b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:17.900919 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2fe29214-b9f7-4cea-a92e-f985b07e6b4b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:17.901370 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2fe29214-b9f7-4cea-a92e-f985b07e6b4b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:17.902165 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2fe29214-b9f7-4cea-a92e-f985b07e6b4b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:17.902593 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2fe29214-b9f7-4cea-a92e-f985b07e6b4b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:17.932290 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2fe29214-b9f7-4cea-a92e-f985b07e6b4b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043397 Apr 06 16:45:17.932915 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 477/975] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:17 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:18.107857 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 16:45:18.108172 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 16:45:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 16:45:18.385888 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ae71a8d5-f387-4fe0-b93e-1e5489e4bc87 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:18.386857 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ae71a8d5-f387-4fe0-b93e-1e5489e4bc87 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:18.393332 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae71a8d5-f387-4fe0-b93e-1e5489e4bc87 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:18.393776 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae71a8d5-f387-4fe0-b93e-1e5489e4bc87 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:18.394509 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae71a8d5-f387-4fe0-b93e-1e5489e4bc87 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:18.394960 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae71a8d5-f387-4fe0-b93e-1e5489e4bc87 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:18.426130 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ae71a8d5-f387-4fe0-b93e-1e5489e4bc87 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044886 Apr 06 16:45:18.427000 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 499/976] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:18 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:18.945547 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c2fd350c-4b14-4b32-8c72-5ea1f2131403 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:18.946442 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c2fd350c-4b14-4b32-8c72-5ea1f2131403 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:18.952600 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2fd350c-4b14-4b32-8c72-5ea1f2131403 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:18.953100 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2fd350c-4b14-4b32-8c72-5ea1f2131403 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:18.953863 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2fd350c-4b14-4b32-8c72-5ea1f2131403 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:18.954294 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2fd350c-4b14-4b32-8c72-5ea1f2131403 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:18.984643 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c2fd350c-4b14-4b32-8c72-5ea1f2131403 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043883 Apr 06 16:45:18.985215 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 478/977] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:18 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:19.438487 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-50835c65-ef19-4959-b0ae-414e59b95826 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:19.439402 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-50835c65-ef19-4959-b0ae-414e59b95826 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:19.446213 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50835c65-ef19-4959-b0ae-414e59b95826 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:19.446654 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50835c65-ef19-4959-b0ae-414e59b95826 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:19.447408 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50835c65-ef19-4959-b0ae-414e59b95826 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:19.447837 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-50835c65-ef19-4959-b0ae-414e59b95826 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:19.477431 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-50835c65-ef19-4959-b0ae-414e59b95826 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042900 Apr 06 16:45:19.479174 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 500/978] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:19 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:19.997258 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-75a2f69a-e058-4b73-a3c7-8fda587329c4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:19.998231 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-75a2f69a-e058-4b73-a3c7-8fda587329c4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:20.004890 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75a2f69a-e058-4b73-a3c7-8fda587329c4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:20.005341 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75a2f69a-e058-4b73-a3c7-8fda587329c4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:20.006085 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75a2f69a-e058-4b73-a3c7-8fda587329c4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:20.006526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75a2f69a-e058-4b73-a3c7-8fda587329c4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:20.034796 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-75a2f69a-e058-4b73-a3c7-8fda587329c4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041613 Apr 06 16:45:20.035341 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 479/979] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:19 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:20.489596 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d8131cef-a7b0-4e7d-a7c1-56feb838941f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:20.490903 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d8131cef-a7b0-4e7d-a7c1-56feb838941f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:20.497498 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8131cef-a7b0-4e7d-a7c1-56feb838941f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:20.497940 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8131cef-a7b0-4e7d-a7c1-56feb838941f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:20.498731 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8131cef-a7b0-4e7d-a7c1-56feb838941f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:20.499155 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8131cef-a7b0-4e7d-a7c1-56feb838941f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:20.528479 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d8131cef-a7b0-4e7d-a7c1-56feb838941f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043008 Apr 06 16:45:20.529070 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 501/980] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:20 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:21.047803 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-87b1c7a2-176a-4dd3-966f-2731eebc8a99 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:21.048721 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-87b1c7a2-176a-4dd3-966f-2731eebc8a99 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:21.055838 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87b1c7a2-176a-4dd3-966f-2731eebc8a99 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:21.056298 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87b1c7a2-176a-4dd3-966f-2731eebc8a99 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:21.057111 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87b1c7a2-176a-4dd3-966f-2731eebc8a99 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:21.057548 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87b1c7a2-176a-4dd3-966f-2731eebc8a99 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:21.087662 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-87b1c7a2-176a-4dd3-966f-2731eebc8a99 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043867 Apr 06 16:45:21.088285 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 480/981] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:21 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:21.540844 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-75f02394-be01-4229-be5f-8fde2eb46890 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:21.541797 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-75f02394-be01-4229-be5f-8fde2eb46890 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:21.548319 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75f02394-be01-4229-be5f-8fde2eb46890 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:21.548797 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75f02394-be01-4229-be5f-8fde2eb46890 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:21.549572 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75f02394-be01-4229-be5f-8fde2eb46890 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:21.550008 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75f02394-be01-4229-be5f-8fde2eb46890 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:21.579451 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-75f02394-be01-4229-be5f-8fde2eb46890 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042925 Apr 06 16:45:21.580025 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 502/982] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:21 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:22.100349 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8d96c745-399b-463f-a61a-0c3f0c7fbd4d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:22.101471 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8d96c745-399b-463f-a61a-0c3f0c7fbd4d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:22.108295 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d96c745-399b-463f-a61a-0c3f0c7fbd4d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:22.108779 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d96c745-399b-463f-a61a-0c3f0c7fbd4d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:22.109563 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d96c745-399b-463f-a61a-0c3f0c7fbd4d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:22.109995 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d96c745-399b-463f-a61a-0c3f0c7fbd4d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:22.161904 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8d96c745-399b-463f-a61a-0c3f0c7fbd4d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065478 Apr 06 16:45:22.162871 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 481/983] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:22 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:22.591914 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9d218ce3-2208-436f-8ad9-23031a180af0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:22.592896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9d218ce3-2208-436f-8ad9-23031a180af0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:22.599321 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d218ce3-2208-436f-8ad9-23031a180af0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:22.599774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d218ce3-2208-436f-8ad9-23031a180af0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:22.600614 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d218ce3-2208-436f-8ad9-23031a180af0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:22.601269 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d218ce3-2208-436f-8ad9-23031a180af0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:22.631357 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9d218ce3-2208-436f-8ad9-23031a180af0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043440 Apr 06 16:45:22.632164 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 503/984] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:22 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:23.174770 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-584d7e13-b596-4539-9b98-69b2dbeea757 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:23.175731 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-584d7e13-b596-4539-9b98-69b2dbeea757 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:23.182576 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-584d7e13-b596-4539-9b98-69b2dbeea757 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:23.183036 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-584d7e13-b596-4539-9b98-69b2dbeea757 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:23.183815 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-584d7e13-b596-4539-9b98-69b2dbeea757 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:23.184255 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-584d7e13-b596-4539-9b98-69b2dbeea757 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:23.215341 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-584d7e13-b596-4539-9b98-69b2dbeea757 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044585 Apr 06 16:45:23.215894 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 482/985] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:23 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:23.643725 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-95ce9c27-f5dc-4190-a383-cbeb9ff8c649 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:23.644747 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-95ce9c27-f5dc-4190-a383-cbeb9ff8c649 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:23.651875 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95ce9c27-f5dc-4190-a383-cbeb9ff8c649 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:23.652316 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95ce9c27-f5dc-4190-a383-cbeb9ff8c649 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:23.653124 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95ce9c27-f5dc-4190-a383-cbeb9ff8c649 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:23.653552 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95ce9c27-f5dc-4190-a383-cbeb9ff8c649 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:23.683277 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-95ce9c27-f5dc-4190-a383-cbeb9ff8c649 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043538 Apr 06 16:45:23.683844 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 504/986] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:23 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:24.230473 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5ed2e7d2-ebd7-4d5a-992e-55ec4c978b95 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:24.231853 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5ed2e7d2-ebd7-4d5a-992e-55ec4c978b95 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:24.241951 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ed2e7d2-ebd7-4d5a-992e-55ec4c978b95 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:24.242711 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ed2e7d2-ebd7-4d5a-992e-55ec4c978b95 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:24.243988 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ed2e7d2-ebd7-4d5a-992e-55ec4c978b95 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:24.244640 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ed2e7d2-ebd7-4d5a-992e-55ec4c978b95 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:24.290444 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5ed2e7d2-ebd7-4d5a-992e-55ec4c978b95 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066603 Apr 06 16:45:24.291385 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 483/987] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:24 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:24.695529 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fd8c019d-0ed6-441c-8608-da746fbe4771 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:24.696460 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fd8c019d-0ed6-441c-8608-da746fbe4771 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:24.703082 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd8c019d-0ed6-441c-8608-da746fbe4771 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:24.703555 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd8c019d-0ed6-441c-8608-da746fbe4771 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:24.704427 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd8c019d-0ed6-441c-8608-da746fbe4771 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:24.704962 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd8c019d-0ed6-441c-8608-da746fbe4771 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:24.735369 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fd8c019d-0ed6-441c-8608-da746fbe4771 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043956 Apr 06 16:45:24.735921 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 505/988] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:24 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:25.305103 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8583059a-0601-4bac-8b8c-2aafc3d57b4b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:25.306208 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8583059a-0601-4bac-8b8c-2aafc3d57b4b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:25.313359 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8583059a-0601-4bac-8b8c-2aafc3d57b4b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:25.313818 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8583059a-0601-4bac-8b8c-2aafc3d57b4b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:25.314569 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8583059a-0601-4bac-8b8c-2aafc3d57b4b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:25.315008 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8583059a-0601-4bac-8b8c-2aafc3d57b4b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:25.346642 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8583059a-0601-4bac-8b8c-2aafc3d57b4b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046326 Apr 06 16:45:25.347217 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 484/989] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:25 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:25.747963 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fd70f3ae-4204-456b-9625-a9d556137a7d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:25.748947 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fd70f3ae-4204-456b-9625-a9d556137a7d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:25.755487 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd70f3ae-4204-456b-9625-a9d556137a7d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:25.755929 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd70f3ae-4204-456b-9625-a9d556137a7d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:25.756757 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd70f3ae-4204-456b-9625-a9d556137a7d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:25.757470 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd70f3ae-4204-456b-9625-a9d556137a7d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:25.786623 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fd70f3ae-4204-456b-9625-a9d556137a7d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042788 Apr 06 16:45:25.787189 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 506/990] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:25 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:26.359155 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-de53ae8d-66df-4d9a-a042-28ea92a4c683 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:26.360065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-de53ae8d-66df-4d9a-a042-28ea92a4c683 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:26.367206 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de53ae8d-66df-4d9a-a042-28ea92a4c683 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:26.367759 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de53ae8d-66df-4d9a-a042-28ea92a4c683 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:26.368526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de53ae8d-66df-4d9a-a042-28ea92a4c683 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:26.368985 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de53ae8d-66df-4d9a-a042-28ea92a4c683 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:26.399405 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-de53ae8d-66df-4d9a-a042-28ea92a4c683 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044183 Apr 06 16:45:26.400016 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 485/991] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:26 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:26.798784 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1ff2c8df-24ad-4d1f-8b52-ac44ad079d26 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:26.799731 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1ff2c8df-24ad-4d1f-8b52-ac44ad079d26 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:26.806791 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ff2c8df-24ad-4d1f-8b52-ac44ad079d26 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:26.807237 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ff2c8df-24ad-4d1f-8b52-ac44ad079d26 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:26.808019 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ff2c8df-24ad-4d1f-8b52-ac44ad079d26 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:26.808432 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ff2c8df-24ad-4d1f-8b52-ac44ad079d26 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:26.840250 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1ff2c8df-24ad-4d1f-8b52-ac44ad079d26 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045446 Apr 06 16:45:26.840894 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 507/992] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:26 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:27.411806 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9e9b1360-43e1-44e2-97a8-b452111e5498 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:27.412791 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9e9b1360-43e1-44e2-97a8-b452111e5498 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:27.419860 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e9b1360-43e1-44e2-97a8-b452111e5498 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:27.420350 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e9b1360-43e1-44e2-97a8-b452111e5498 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:27.421172 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e9b1360-43e1-44e2-97a8-b452111e5498 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:27.421604 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e9b1360-43e1-44e2-97a8-b452111e5498 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:27.452518 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9e9b1360-43e1-44e2-97a8-b452111e5498 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044740 Apr 06 16:45:27.453254 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 486/993] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:27 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:27.852617 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8405394f-8062-4ab7-bcc8-373a375c52c9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:27.853593 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8405394f-8062-4ab7-bcc8-373a375c52c9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:27.860539 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8405394f-8062-4ab7-bcc8-373a375c52c9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:27.861144 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8405394f-8062-4ab7-bcc8-373a375c52c9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:27.861927 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8405394f-8062-4ab7-bcc8-373a375c52c9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:27.862361 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8405394f-8062-4ab7-bcc8-373a375c52c9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:27.893244 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8405394f-8062-4ab7-bcc8-373a375c52c9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044676 Apr 06 16:45:27.893812 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 508/994] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:27 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:28.465220 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1611fa35-24bc-4214-9e9c-f3ee76a1db2a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:28.466188 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1611fa35-24bc-4214-9e9c-f3ee76a1db2a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:28.473021 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1611fa35-24bc-4214-9e9c-f3ee76a1db2a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:28.473465 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1611fa35-24bc-4214-9e9c-f3ee76a1db2a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:28.474220 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1611fa35-24bc-4214-9e9c-f3ee76a1db2a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:28.474643 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1611fa35-24bc-4214-9e9c-f3ee76a1db2a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:28.504457 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1611fa35-24bc-4214-9e9c-f3ee76a1db2a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043224 Apr 06 16:45:28.505031 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 487/995] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:28 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:28.905693 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1a6b4957-2adb-485a-8eea-25cedfdc3368 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:28.906642 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1a6b4957-2adb-485a-8eea-25cedfdc3368 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:28.913330 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a6b4957-2adb-485a-8eea-25cedfdc3368 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:28.913823 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a6b4957-2adb-485a-8eea-25cedfdc3368 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:28.914878 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a6b4957-2adb-485a-8eea-25cedfdc3368 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:28.915305 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a6b4957-2adb-485a-8eea-25cedfdc3368 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:28.945463 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1a6b4957-2adb-485a-8eea-25cedfdc3368 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043712 Apr 06 16:45:28.946061 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 509/996] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:28 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:29.517017 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dbacc7a2-80f0-4bb5-99c7-ee8458214043 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:29.517936 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dbacc7a2-80f0-4bb5-99c7-ee8458214043 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:29.524652 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dbacc7a2-80f0-4bb5-99c7-ee8458214043 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:29.525337 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dbacc7a2-80f0-4bb5-99c7-ee8458214043 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:29.526103 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dbacc7a2-80f0-4bb5-99c7-ee8458214043 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:29.526530 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dbacc7a2-80f0-4bb5-99c7-ee8458214043 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:29.555727 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dbacc7a2-80f0-4bb5-99c7-ee8458214043 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042744 Apr 06 16:45:29.556282 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 488/997] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:29 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:29.957842 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b77a22fd-a8fc-4e36-8877-85e0c8d132d2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:29.958768 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b77a22fd-a8fc-4e36-8877-85e0c8d132d2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:29.965353 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b77a22fd-a8fc-4e36-8877-85e0c8d132d2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:29.965801 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b77a22fd-a8fc-4e36-8877-85e0c8d132d2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:29.966572 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b77a22fd-a8fc-4e36-8877-85e0c8d132d2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:29.967004 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b77a22fd-a8fc-4e36-8877-85e0c8d132d2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:29.996547 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b77a22fd-a8fc-4e36-8877-85e0c8d132d2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042685 Apr 06 16:45:29.997145 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 510/998] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:29 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:30.568560 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4149d187-ec9a-4490-9dda-bc3dbd3089bb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:30.569493 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4149d187-ec9a-4490-9dda-bc3dbd3089bb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:30.576286 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4149d187-ec9a-4490-9dda-bc3dbd3089bb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:30.576744 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4149d187-ec9a-4490-9dda-bc3dbd3089bb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:30.577552 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4149d187-ec9a-4490-9dda-bc3dbd3089bb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:30.577995 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4149d187-ec9a-4490-9dda-bc3dbd3089bb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:30.608216 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4149d187-ec9a-4490-9dda-bc3dbd3089bb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043619 Apr 06 16:45:30.608700 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 489/999] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:30 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:31.009024 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6a3bbe1c-7c16-484d-8b0d-aab51781af7b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:31.009953 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6a3bbe1c-7c16-484d-8b0d-aab51781af7b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:31.016386 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6a3bbe1c-7c16-484d-8b0d-aab51781af7b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:31.016886 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6a3bbe1c-7c16-484d-8b0d-aab51781af7b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:31.017653 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6a3bbe1c-7c16-484d-8b0d-aab51781af7b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:31.018084 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6a3bbe1c-7c16-484d-8b0d-aab51781af7b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:31.050240 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6a3bbe1c-7c16-484d-8b0d-aab51781af7b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045232 Apr 06 16:45:31.050783 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 511/1000] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:31 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:31.621419 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-80ec7ab4-6825-45b9-9d60-112f6e95b7d3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:31.622386 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-80ec7ab4-6825-45b9-9d60-112f6e95b7d3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:31.629194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80ec7ab4-6825-45b9-9d60-112f6e95b7d3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:31.629644 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80ec7ab4-6825-45b9-9d60-112f6e95b7d3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:31.630430 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80ec7ab4-6825-45b9-9d60-112f6e95b7d3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:31.630861 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80ec7ab4-6825-45b9-9d60-112f6e95b7d3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:31.662022 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-80ec7ab4-6825-45b9-9d60-112f6e95b7d3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044994 Apr 06 16:45:31.662878 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 490/1001] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:31 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:32.062672 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1585baad-837c-4c0e-855b-dbbfc0fe158b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:32.063495 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1585baad-837c-4c0e-855b-dbbfc0fe158b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:32.070576 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1585baad-837c-4c0e-855b-dbbfc0fe158b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:32.071022 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1585baad-837c-4c0e-855b-dbbfc0fe158b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:32.071806 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1585baad-837c-4c0e-855b-dbbfc0fe158b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:32.072263 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1585baad-837c-4c0e-855b-dbbfc0fe158b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:32.103942 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1585baad-837c-4c0e-855b-dbbfc0fe158b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045407 Apr 06 16:45:32.104537 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 512/1002] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:32 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:32.674918 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e040215c-fdf8-4d4e-a3a6-d6ead17d81f6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:32.675839 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e040215c-fdf8-4d4e-a3a6-d6ead17d81f6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:32.682777 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e040215c-fdf8-4d4e-a3a6-d6ead17d81f6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:32.683223 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e040215c-fdf8-4d4e-a3a6-d6ead17d81f6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:32.684010 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e040215c-fdf8-4d4e-a3a6-d6ead17d81f6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:32.684439 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e040215c-fdf8-4d4e-a3a6-d6ead17d81f6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:32.715517 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e040215c-fdf8-4d4e-a3a6-d6ead17d81f6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044865 Apr 06 16:45:32.716091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 491/1003] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:32 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:33.116560 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e7cadd20-e139-4c40-9a56-bd66be70930c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:33.117541 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e7cadd20-e139-4c40-9a56-bd66be70930c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:33.123852 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7cadd20-e139-4c40-9a56-bd66be70930c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:33.124396 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7cadd20-e139-4c40-9a56-bd66be70930c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:33.125177 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7cadd20-e139-4c40-9a56-bd66be70930c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:33.125597 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e7cadd20-e139-4c40-9a56-bd66be70930c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:33.154803 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e7cadd20-e139-4c40-9a56-bd66be70930c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042942 Apr 06 16:45:33.155365 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 513/1004] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:33 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:33.728071 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b369151a-5ba5-4ca8-83b8-cec0ce4bee0e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:33.728938 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b369151a-5ba5-4ca8-83b8-cec0ce4bee0e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:33.735743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b369151a-5ba5-4ca8-83b8-cec0ce4bee0e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:33.736190 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b369151a-5ba5-4ca8-83b8-cec0ce4bee0e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:33.737119 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b369151a-5ba5-4ca8-83b8-cec0ce4bee0e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:33.737552 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b369151a-5ba5-4ca8-83b8-cec0ce4bee0e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:33.769599 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b369151a-5ba5-4ca8-83b8-cec0ce4bee0e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045823 Apr 06 16:45:33.770175 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 492/1005] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:33 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:34.167095 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-be0c7af9-a488-4ba8-b185-e220d20ba398 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:34.168005 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-be0c7af9-a488-4ba8-b185-e220d20ba398 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:34.174682 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be0c7af9-a488-4ba8-b185-e220d20ba398 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:34.175107 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be0c7af9-a488-4ba8-b185-e220d20ba398 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:34.175911 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be0c7af9-a488-4ba8-b185-e220d20ba398 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:34.176317 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be0c7af9-a488-4ba8-b185-e220d20ba398 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:34.206759 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-be0c7af9-a488-4ba8-b185-e220d20ba398 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043633 Apr 06 16:45:34.207331 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 514/1006] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:34 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:34.782775 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ca8dbcae-8540-4a49-ab72-338a7613543c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:34.783710 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ca8dbcae-8540-4a49-ab72-338a7613543c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:34.790663 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca8dbcae-8540-4a49-ab72-338a7613543c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:34.791110 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca8dbcae-8540-4a49-ab72-338a7613543c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:34.791892 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca8dbcae-8540-4a49-ab72-338a7613543c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:34.792327 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca8dbcae-8540-4a49-ab72-338a7613543c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:34.821951 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ca8dbcae-8540-4a49-ab72-338a7613543c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043264 Apr 06 16:45:34.822523 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 493/1007] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:34 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:35.219679 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e1bdb3db-6dce-4cf4-9759-807f716fd660 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:35.220628 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e1bdb3db-6dce-4cf4-9759-807f716fd660 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:35.227896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1bdb3db-6dce-4cf4-9759-807f716fd660 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:35.228380 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1bdb3db-6dce-4cf4-9759-807f716fd660 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:35.229189 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1bdb3db-6dce-4cf4-9759-807f716fd660 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:35.229629 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1bdb3db-6dce-4cf4-9759-807f716fd660 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:35.259580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e1bdb3db-6dce-4cf4-9759-807f716fd660 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043799 Apr 06 16:45:35.260033 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 515/1008] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:35 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:35.834408 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-278de52b-55fd-41c2-b48a-cf1482fbf3d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:35.835456 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-278de52b-55fd-41c2-b48a-cf1482fbf3d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:35.842249 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-278de52b-55fd-41c2-b48a-cf1482fbf3d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:35.842703 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-278de52b-55fd-41c2-b48a-cf1482fbf3d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:35.843481 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-278de52b-55fd-41c2-b48a-cf1482fbf3d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:35.843945 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-278de52b-55fd-41c2-b48a-cf1482fbf3d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:35.875418 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-278de52b-55fd-41c2-b48a-cf1482fbf3d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045134 Apr 06 16:45:35.876010 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 494/1009] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:35 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:36.271873 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-37e239ee-0ae1-4d35-9915-5c9ca9e59b4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:36.272963 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-37e239ee-0ae1-4d35-9915-5c9ca9e59b4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:36.279717 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37e239ee-0ae1-4d35-9915-5c9ca9e59b4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:36.280131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37e239ee-0ae1-4d35-9915-5c9ca9e59b4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:36.280920 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37e239ee-0ae1-4d35-9915-5c9ca9e59b4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:36.281382 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37e239ee-0ae1-4d35-9915-5c9ca9e59b4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:36.317415 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-37e239ee-0ae1-4d35-9915-5c9ca9e59b4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049500 Apr 06 16:45:36.318000 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 516/1010] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:36 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:36.887740 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-929d609f-ee1a-4fd5-a160-865ed4194c04 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:36.888662 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-929d609f-ee1a-4fd5-a160-865ed4194c04 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:36.895553 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-929d609f-ee1a-4fd5-a160-865ed4194c04 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:36.895983 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-929d609f-ee1a-4fd5-a160-865ed4194c04 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:36.896875 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-929d609f-ee1a-4fd5-a160-865ed4194c04 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:36.897341 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-929d609f-ee1a-4fd5-a160-865ed4194c04 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:36.928842 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-929d609f-ee1a-4fd5-a160-865ed4194c04 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045107 Apr 06 16:45:36.929386 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 495/1011] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:36 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:37.329630 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b61f3f98-653b-498d-a234-01d6d9dba349 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:37.330563 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b61f3f98-653b-498d-a234-01d6d9dba349 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:37.337774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b61f3f98-653b-498d-a234-01d6d9dba349 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:37.338219 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b61f3f98-653b-498d-a234-01d6d9dba349 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:37.338988 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b61f3f98-653b-498d-a234-01d6d9dba349 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:37.339418 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b61f3f98-653b-498d-a234-01d6d9dba349 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:37.374091 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b61f3f98-653b-498d-a234-01d6d9dba349 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048643 Apr 06 16:45:37.374671 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 517/1012] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:37 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:37.941362 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7fb480df-5900-47d7-a5cb-ada08b9bbb08 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:37.942285 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7fb480df-5900-47d7-a5cb-ada08b9bbb08 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:37.949532 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fb480df-5900-47d7-a5cb-ada08b9bbb08 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:37.949984 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fb480df-5900-47d7-a5cb-ada08b9bbb08 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:37.950759 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fb480df-5900-47d7-a5cb-ada08b9bbb08 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:37.951192 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fb480df-5900-47d7-a5cb-ada08b9bbb08 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:37.981526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7fb480df-5900-47d7-a5cb-ada08b9bbb08 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044161 Apr 06 16:45:37.982065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 496/1013] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:37 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:38.386774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cece3a4a-3375-4ec0-a81e-d19dfc1a2c5b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:38.387697 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cece3a4a-3375-4ec0-a81e-d19dfc1a2c5b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:38.394231 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cece3a4a-3375-4ec0-a81e-d19dfc1a2c5b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:38.394681 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cece3a4a-3375-4ec0-a81e-d19dfc1a2c5b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:38.395479 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cece3a4a-3375-4ec0-a81e-d19dfc1a2c5b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:38.395910 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cece3a4a-3375-4ec0-a81e-d19dfc1a2c5b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:38.425847 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cece3a4a-3375-4ec0-a81e-d19dfc1a2c5b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043129 Apr 06 16:45:38.426570 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 518/1014] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:38 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:38.994877 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-821db6d6-4aa5-4a09-b65e-047b9a97a43d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:38.995930 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-821db6d6-4aa5-4a09-b65e-047b9a97a43d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:39.002893 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-821db6d6-4aa5-4a09-b65e-047b9a97a43d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:39.003335 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-821db6d6-4aa5-4a09-b65e-047b9a97a43d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:39.004095 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-821db6d6-4aa5-4a09-b65e-047b9a97a43d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:39.004522 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-821db6d6-4aa5-4a09-b65e-047b9a97a43d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:39.034584 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-821db6d6-4aa5-4a09-b65e-047b9a97a43d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044071 Apr 06 16:45:39.035174 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 497/1015] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:38 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:39.437747 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-94b62a99-9132-4968-9ef1-d9fa236c690c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:39.438675 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-94b62a99-9132-4968-9ef1-d9fa236c690c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:39.445368 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94b62a99-9132-4968-9ef1-d9fa236c690c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:39.445822 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94b62a99-9132-4968-9ef1-d9fa236c690c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:39.446786 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94b62a99-9132-4968-9ef1-d9fa236c690c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:39.447226 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94b62a99-9132-4968-9ef1-d9fa236c690c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:39.476041 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-94b62a99-9132-4968-9ef1-d9fa236c690c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042259 Apr 06 16:45:39.476610 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 519/1016] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:39 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:40.047365 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d2d7ea3b-23e7-4207-bd7b-6a390ccb28bd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:40.048289 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d2d7ea3b-23e7-4207-bd7b-6a390ccb28bd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:40.055227 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2d7ea3b-23e7-4207-bd7b-6a390ccb28bd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:40.055836 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2d7ea3b-23e7-4207-bd7b-6a390ccb28bd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:40.056762 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2d7ea3b-23e7-4207-bd7b-6a390ccb28bd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:40.057315 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2d7ea3b-23e7-4207-bd7b-6a390ccb28bd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:40.091860 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d2d7ea3b-23e7-4207-bd7b-6a390ccb28bd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048534 Apr 06 16:45:40.092405 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 498/1017] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:40 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:40.488044 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-28b4a2cb-05c4-420d-b826-5058ebc05e95 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:40.489034 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-28b4a2cb-05c4-420d-b826-5058ebc05e95 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:40.496240 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28b4a2cb-05c4-420d-b826-5058ebc05e95 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:40.496706 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28b4a2cb-05c4-420d-b826-5058ebc05e95 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:40.497478 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28b4a2cb-05c4-420d-b826-5058ebc05e95 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:40.497904 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28b4a2cb-05c4-420d-b826-5058ebc05e95 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:40.527776 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-28b4a2cb-05c4-420d-b826-5058ebc05e95 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043652 Apr 06 16:45:40.528345 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 520/1018] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:40 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:41.104127 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4a6102e7-eb0b-40bb-93c5-c14174877650 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:41.105068 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4a6102e7-eb0b-40bb-93c5-c14174877650 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:41.111885 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a6102e7-eb0b-40bb-93c5-c14174877650 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:41.112328 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a6102e7-eb0b-40bb-93c5-c14174877650 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:41.113137 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a6102e7-eb0b-40bb-93c5-c14174877650 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:41.113590 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a6102e7-eb0b-40bb-93c5-c14174877650 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:41.145837 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4a6102e7-eb0b-40bb-93c5-c14174877650 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045893 Apr 06 16:45:41.146408 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 499/1019] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:41 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:41.540409 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a286f70f-a0e8-4753-88c1-0d117b617078 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:41.541381 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a286f70f-a0e8-4753-88c1-0d117b617078 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:41.547806 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a286f70f-a0e8-4753-88c1-0d117b617078 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:41.548245 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a286f70f-a0e8-4753-88c1-0d117b617078 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:41.549043 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a286f70f-a0e8-4753-88c1-0d117b617078 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:41.549467 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a286f70f-a0e8-4753-88c1-0d117b617078 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:41.579409 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a286f70f-a0e8-4753-88c1-0d117b617078 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043436 Apr 06 16:45:41.579962 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 521/1020] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:41 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:42.158412 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-37ce4d0a-e965-4619-b899-4491c17ef490 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:42.159371 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-37ce4d0a-e965-4619-b899-4491c17ef490 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:42.166012 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37ce4d0a-e965-4619-b899-4491c17ef490 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:42.166458 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37ce4d0a-e965-4619-b899-4491c17ef490 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:42.167242 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37ce4d0a-e965-4619-b899-4491c17ef490 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:42.167675 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37ce4d0a-e965-4619-b899-4491c17ef490 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:42.197797 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-37ce4d0a-e965-4619-b899-4491c17ef490 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043558 Apr 06 16:45:42.198362 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 500/1021] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:42 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:42.593216 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-508673c9-52a9-48bc-ba0f-a5d55a3360c0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:42.594141 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-508673c9-52a9-48bc-ba0f-a5d55a3360c0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:42.600996 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-508673c9-52a9-48bc-ba0f-a5d55a3360c0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:42.601493 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-508673c9-52a9-48bc-ba0f-a5d55a3360c0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:42.602362 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-508673c9-52a9-48bc-ba0f-a5d55a3360c0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:42.602944 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-508673c9-52a9-48bc-ba0f-a5d55a3360c0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:42.636730 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-508673c9-52a9-48bc-ba0f-a5d55a3360c0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047567 Apr 06 16:45:42.637309 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 522/1022] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:42 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:43.211926 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-62e25c95-e9dd-4f36-ab23-87be3c2ff935 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:43.212868 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-62e25c95-e9dd-4f36-ab23-87be3c2ff935 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:43.219160 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62e25c95-e9dd-4f36-ab23-87be3c2ff935 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:43.219624 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62e25c95-e9dd-4f36-ab23-87be3c2ff935 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:43.220385 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62e25c95-e9dd-4f36-ab23-87be3c2ff935 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:43.220837 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62e25c95-e9dd-4f36-ab23-87be3c2ff935 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:43.250129 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-62e25c95-e9dd-4f36-ab23-87be3c2ff935 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043658 Apr 06 16:45:43.250655 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 501/1023] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:43 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:43.649767 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9f037b24-481b-4225-97ce-ebe12ed85340 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:43.650710 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9f037b24-481b-4225-97ce-ebe12ed85340 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:43.657349 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f037b24-481b-4225-97ce-ebe12ed85340 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:43.657800 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f037b24-481b-4225-97ce-ebe12ed85340 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:43.658570 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f037b24-481b-4225-97ce-ebe12ed85340 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:43.659009 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f037b24-481b-4225-97ce-ebe12ed85340 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:43.688965 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9f037b24-481b-4225-97ce-ebe12ed85340 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043826 Apr 06 16:45:43.689536 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 523/1024] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:43 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:44.262388 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ccaafacc-03f7-4000-ad64-ef947ac9f71e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:44.263223 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ccaafacc-03f7-4000-ad64-ef947ac9f71e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:44.270278 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccaafacc-03f7-4000-ad64-ef947ac9f71e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:44.270732 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccaafacc-03f7-4000-ad64-ef947ac9f71e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:44.271619 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccaafacc-03f7-4000-ad64-ef947ac9f71e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:44.272209 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccaafacc-03f7-4000-ad64-ef947ac9f71e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:44.302810 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ccaafacc-03f7-4000-ad64-ef947ac9f71e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044538 Apr 06 16:45:44.303459 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 502/1025] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:44 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:44.701905 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e5df874-6794-45b4-9967-f0f18e546c18 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:44.703135 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1e5df874-6794-45b4-9967-f0f18e546c18 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:44.710784 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e5df874-6794-45b4-9967-f0f18e546c18 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:44.711397 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e5df874-6794-45b4-9967-f0f18e546c18 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:44.712168 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e5df874-6794-45b4-9967-f0f18e546c18 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:44.712601 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e5df874-6794-45b4-9967-f0f18e546c18 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:44.744993 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1e5df874-6794-45b4-9967-f0f18e546c18 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047618 Apr 06 16:45:44.745587 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 524/1026] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:44 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:45.315591 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8109d80a-76d2-411f-b6e1-a2d821c27a0d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:45.316483 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8109d80a-76d2-411f-b6e1-a2d821c27a0d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:45.323704 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8109d80a-76d2-411f-b6e1-a2d821c27a0d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:45.324217 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8109d80a-76d2-411f-b6e1-a2d821c27a0d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:45.325034 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8109d80a-76d2-411f-b6e1-a2d821c27a0d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:45.325483 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8109d80a-76d2-411f-b6e1-a2d821c27a0d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:45.356565 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8109d80a-76d2-411f-b6e1-a2d821c27a0d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045389 Apr 06 16:45:45.357169 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 503/1027] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:45 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:45.757708 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-304863a2-8f96-4faf-9d99-97d139accccc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:45.758624 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-304863a2-8f96-4faf-9d99-97d139accccc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:45.765315 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-304863a2-8f96-4faf-9d99-97d139accccc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:45.765760 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-304863a2-8f96-4faf-9d99-97d139accccc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:45.766606 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-304863a2-8f96-4faf-9d99-97d139accccc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:45.767038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-304863a2-8f96-4faf-9d99-97d139accccc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:45.796450 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-304863a2-8f96-4faf-9d99-97d139accccc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042902 Apr 06 16:45:45.797045 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 525/1028] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:45 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:46.369743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8cdebb3a-03f8-44bb-860f-b3fe4d7afac8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:46.370674 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8cdebb3a-03f8-44bb-860f-b3fe4d7afac8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:46.377657 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cdebb3a-03f8-44bb-860f-b3fe4d7afac8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:46.378108 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cdebb3a-03f8-44bb-860f-b3fe4d7afac8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:46.378885 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cdebb3a-03f8-44bb-860f-b3fe4d7afac8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:46.379335 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cdebb3a-03f8-44bb-860f-b3fe4d7afac8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:46.409248 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8cdebb3a-03f8-44bb-860f-b3fe4d7afac8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043931 Apr 06 16:45:46.409810 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 504/1029] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:46 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:46.809402 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4893e9ba-111d-4101-a106-8bb2ee6902d4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:46.810331 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4893e9ba-111d-4101-a106-8bb2ee6902d4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:46.816954 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4893e9ba-111d-4101-a106-8bb2ee6902d4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:46.817410 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4893e9ba-111d-4101-a106-8bb2ee6902d4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:46.818581 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4893e9ba-111d-4101-a106-8bb2ee6902d4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:46.819028 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4893e9ba-111d-4101-a106-8bb2ee6902d4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:46.852916 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4893e9ba-111d-4101-a106-8bb2ee6902d4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047505 Apr 06 16:45:46.853538 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 526/1030] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:46 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:47.428559 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-071a3028-2b6f-4d8e-b88b-c25bc63d30c0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:47.429820 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-071a3028-2b6f-4d8e-b88b-c25bc63d30c0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:47.437549 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-071a3028-2b6f-4d8e-b88b-c25bc63d30c0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:47.438192 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-071a3028-2b6f-4d8e-b88b-c25bc63d30c0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:47.439342 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-071a3028-2b6f-4d8e-b88b-c25bc63d30c0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:47.439979 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-071a3028-2b6f-4d8e-b88b-c25bc63d30c0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:47.472051 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-071a3028-2b6f-4d8e-b88b-c25bc63d30c0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051911 Apr 06 16:45:47.472621 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 505/1031] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:47 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:47.869963 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2ecd1fba-0531-403d-ae86-33916f6ec1ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:47.871514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2ecd1fba-0531-403d-ae86-33916f6ec1ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:47.882435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ecd1fba-0531-403d-ae86-33916f6ec1ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:47.882942 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ecd1fba-0531-403d-ae86-33916f6ec1ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:47.883577 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ecd1fba-0531-403d-ae86-33916f6ec1ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:47.884007 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ecd1fba-0531-403d-ae86-33916f6ec1ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:47.914132 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2ecd1fba-0531-403d-ae86-33916f6ec1ed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051472 Apr 06 16:45:47.914722 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 527/1032] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:47 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:48.484532 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e63ca28a-e5a7-48e7-a890-d7252f0b8577 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:48.485498 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e63ca28a-e5a7-48e7-a890-d7252f0b8577 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:48.492712 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e63ca28a-e5a7-48e7-a890-d7252f0b8577 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:48.493167 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e63ca28a-e5a7-48e7-a890-d7252f0b8577 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:48.493937 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e63ca28a-e5a7-48e7-a890-d7252f0b8577 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:48.494381 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e63ca28a-e5a7-48e7-a890-d7252f0b8577 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:48.523431 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e63ca28a-e5a7-48e7-a890-d7252f0b8577 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043041 Apr 06 16:45:48.524017 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 506/1033] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:48 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:48.931414 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0923e6da-e03f-406c-a8b0-8753d18a5497 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:48.932371 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0923e6da-e03f-406c-a8b0-8753d18a5497 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:48.939205 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0923e6da-e03f-406c-a8b0-8753d18a5497 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:48.939649 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0923e6da-e03f-406c-a8b0-8753d18a5497 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:48.940400 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0923e6da-e03f-406c-a8b0-8753d18a5497 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:48.940864 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0923e6da-e03f-406c-a8b0-8753d18a5497 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:48.971444 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0923e6da-e03f-406c-a8b0-8753d18a5497 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046443 Apr 06 16:45:48.972030 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 528/1034] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:48 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:49.537875 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-47b580b5-d816-42b9-b669-3952c267da7f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:49.538905 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-47b580b5-d816-42b9-b669-3952c267da7f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:49.547422 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-47b580b5-d816-42b9-b669-3952c267da7f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:49.547944 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-47b580b5-d816-42b9-b669-3952c267da7f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:49.548868 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-47b580b5-d816-42b9-b669-3952c267da7f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:49.549384 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-47b580b5-d816-42b9-b669-3952c267da7f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:49.589038 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-47b580b5-d816-42b9-b669-3952c267da7f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056641 Apr 06 16:45:49.589593 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 507/1035] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:49 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:49.985160 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-58ca1bed-2ae1-4766-8cd9-a7bfa9d21dbe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:49.986248 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-58ca1bed-2ae1-4766-8cd9-a7bfa9d21dbe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:49.995944 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58ca1bed-2ae1-4766-8cd9-a7bfa9d21dbe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:49.996603 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58ca1bed-2ae1-4766-8cd9-a7bfa9d21dbe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:49.997883 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58ca1bed-2ae1-4766-8cd9-a7bfa9d21dbe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:49.998426 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58ca1bed-2ae1-4766-8cd9-a7bfa9d21dbe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:50.031483 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-58ca1bed-2ae1-4766-8cd9-a7bfa9d21dbe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051040 Apr 06 16:45:50.032041 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 529/1036] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:49 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:50.605091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eb6f9aba-d1b2-436f-ac63-5bc385fc7592 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:50.606608 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eb6f9aba-d1b2-436f-ac63-5bc385fc7592 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:50.617080 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb6f9aba-d1b2-436f-ac63-5bc385fc7592 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:50.617809 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb6f9aba-d1b2-436f-ac63-5bc385fc7592 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:50.619057 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb6f9aba-d1b2-436f-ac63-5bc385fc7592 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:50.619832 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb6f9aba-d1b2-436f-ac63-5bc385fc7592 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:50.647900 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eb6f9aba-d1b2-436f-ac63-5bc385fc7592 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049891 Apr 06 16:45:50.648449 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 508/1037] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:50 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:51.046732 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-823289c7-5cf7-4f7c-b098-e5c8cae9b1d6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:51.047738 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-823289c7-5cf7-4f7c-b098-e5c8cae9b1d6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:51.054712 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-823289c7-5cf7-4f7c-b098-e5c8cae9b1d6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:51.055414 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-823289c7-5cf7-4f7c-b098-e5c8cae9b1d6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:51.056253 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-823289c7-5cf7-4f7c-b098-e5c8cae9b1d6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:51.056723 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-823289c7-5cf7-4f7c-b098-e5c8cae9b1d6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:51.087482 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-823289c7-5cf7-4f7c-b098-e5c8cae9b1d6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046701 Apr 06 16:45:51.088033 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 530/1038] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:51 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:51.662044 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-989d735e-e4e4-424d-af36-5a7174bf99bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:51.663193 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-989d735e-e4e4-424d-af36-5a7174bf99bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:51.671316 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-989d735e-e4e4-424d-af36-5a7174bf99bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:51.671803 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-989d735e-e4e4-424d-af36-5a7174bf99bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:51.672576 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-989d735e-e4e4-424d-af36-5a7174bf99bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:51.673064 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-989d735e-e4e4-424d-af36-5a7174bf99bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:51.705569 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-989d735e-e4e4-424d-af36-5a7174bf99bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048642 Apr 06 16:45:51.706127 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 509/1039] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:51 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:52.100472 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-de950fe9-5364-4b5b-a0fd-b8a6c516610b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:52.101493 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-de950fe9-5364-4b5b-a0fd-b8a6c516610b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:52.108980 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de950fe9-5364-4b5b-a0fd-b8a6c516610b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:52.109494 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de950fe9-5364-4b5b-a0fd-b8a6c516610b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:52.110435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de950fe9-5364-4b5b-a0fd-b8a6c516610b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:52.110929 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de950fe9-5364-4b5b-a0fd-b8a6c516610b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:52.142430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-de950fe9-5364-4b5b-a0fd-b8a6c516610b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046048 Apr 06 16:45:52.142988 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 531/1040] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:52 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:52.719266 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-78be52ef-5117-4e53-aaf1-591f942b87c9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:52.720509 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-78be52ef-5117-4e53-aaf1-591f942b87c9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:52.727795 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78be52ef-5117-4e53-aaf1-591f942b87c9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:52.728256 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78be52ef-5117-4e53-aaf1-591f942b87c9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:52.729190 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78be52ef-5117-4e53-aaf1-591f942b87c9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:52.729944 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78be52ef-5117-4e53-aaf1-591f942b87c9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:52.760209 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-78be52ef-5117-4e53-aaf1-591f942b87c9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046458 Apr 06 16:45:52.760780 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 510/1041] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:52 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:53.156985 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-99ddbbd2-3b5f-4d04-89d2-1b2c7a0df1e9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:53.157997 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-99ddbbd2-3b5f-4d04-89d2-1b2c7a0df1e9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:53.165577 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99ddbbd2-3b5f-4d04-89d2-1b2c7a0df1e9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:53.166226 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99ddbbd2-3b5f-4d04-89d2-1b2c7a0df1e9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:53.167183 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99ddbbd2-3b5f-4d04-89d2-1b2c7a0df1e9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:53.167612 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99ddbbd2-3b5f-4d04-89d2-1b2c7a0df1e9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:53.199224 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-99ddbbd2-3b5f-4d04-89d2-1b2c7a0df1e9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047957 Apr 06 16:45:53.199785 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 532/1042] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:53 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:53.773758 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f38ca3ee-0829-4e95-9a79-379e3a9904c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:53.774587 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f38ca3ee-0829-4e95-9a79-379e3a9904c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:53.781128 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f38ca3ee-0829-4e95-9a79-379e3a9904c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:53.781583 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f38ca3ee-0829-4e95-9a79-379e3a9904c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:53.782350 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f38ca3ee-0829-4e95-9a79-379e3a9904c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:53.782782 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f38ca3ee-0829-4e95-9a79-379e3a9904c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:53.811707 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f38ca3ee-0829-4e95-9a79-379e3a9904c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042808 Apr 06 16:45:53.812263 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 511/1043] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:53 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:54.212516 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-adeb37e5-0e3d-4d3e-aaa3-4454d80442b9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:54.213583 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-adeb37e5-0e3d-4d3e-aaa3-4454d80442b9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:54.220985 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adeb37e5-0e3d-4d3e-aaa3-4454d80442b9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:54.221486 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adeb37e5-0e3d-4d3e-aaa3-4454d80442b9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:54.222572 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adeb37e5-0e3d-4d3e-aaa3-4454d80442b9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:54.223110 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-adeb37e5-0e3d-4d3e-aaa3-4454d80442b9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:54.251925 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-adeb37e5-0e3d-4d3e-aaa3-4454d80442b9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043946 Apr 06 16:45:54.252475 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 533/1044] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:54 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:54.828452 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1eaf4359-54c4-4c2c-a816-253d1d677be7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:54.829851 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1eaf4359-54c4-4c2c-a816-253d1d677be7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:54.841474 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1eaf4359-54c4-4c2c-a816-253d1d677be7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:54.842262 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1eaf4359-54c4-4c2c-a816-253d1d677be7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:54.843502 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1eaf4359-54c4-4c2c-a816-253d1d677be7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:54.844228 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1eaf4359-54c4-4c2c-a816-253d1d677be7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:54.875069 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1eaf4359-54c4-4c2c-a816-253d1d677be7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053490 Apr 06 16:45:54.875625 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 512/1045] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:54 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:55.264096 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-961d267a-f3fe-43ab-95d0-40f7a2df6bd1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:55.265066 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-961d267a-f3fe-43ab-95d0-40f7a2df6bd1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:55.271806 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-961d267a-f3fe-43ab-95d0-40f7a2df6bd1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:55.272471 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-961d267a-f3fe-43ab-95d0-40f7a2df6bd1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:55.273476 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-961d267a-f3fe-43ab-95d0-40f7a2df6bd1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:55.273908 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-961d267a-f3fe-43ab-95d0-40f7a2df6bd1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:55.309837 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-961d267a-f3fe-43ab-95d0-40f7a2df6bd1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049688 Apr 06 16:45:55.310654 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 534/1046] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:55 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:55.887574 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-749f8dae-2888-4b23-8e91-a1a0993db944 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:55.888645 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-749f8dae-2888-4b23-8e91-a1a0993db944 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:55.895757 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-749f8dae-2888-4b23-8e91-a1a0993db944 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:55.896411 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-749f8dae-2888-4b23-8e91-a1a0993db944 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:55.897249 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-749f8dae-2888-4b23-8e91-a1a0993db944 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:55.897679 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-749f8dae-2888-4b23-8e91-a1a0993db944 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:55.927632 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-749f8dae-2888-4b23-8e91-a1a0993db944 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044387 Apr 06 16:45:55.928371 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 513/1047] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:55 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:56.323200 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b1cda69e-a821-4c7e-af89-2a24cd7ce99d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:56.325201 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b1cda69e-a821-4c7e-af89-2a24cd7ce99d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:56.332033 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1cda69e-a821-4c7e-af89-2a24cd7ce99d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:56.332500 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1cda69e-a821-4c7e-af89-2a24cd7ce99d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:56.333747 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1cda69e-a821-4c7e-af89-2a24cd7ce99d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:56.334187 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1cda69e-a821-4c7e-af89-2a24cd7ce99d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:56.368742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b1cda69e-a821-4c7e-af89-2a24cd7ce99d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049660 Apr 06 16:45:56.369342 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 535/1048] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:56 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:56.941236 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ccd97e1a-45f9-4b72-b707-74e1fe9d2a55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:56.942188 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ccd97e1a-45f9-4b72-b707-74e1fe9d2a55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:56.949464 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccd97e1a-45f9-4b72-b707-74e1fe9d2a55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:56.949903 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccd97e1a-45f9-4b72-b707-74e1fe9d2a55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:56.950735 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccd97e1a-45f9-4b72-b707-74e1fe9d2a55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:56.951172 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccd97e1a-45f9-4b72-b707-74e1fe9d2a55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:56.982549 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ccd97e1a-45f9-4b72-b707-74e1fe9d2a55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046316 Apr 06 16:45:56.983169 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 514/1049] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:56 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:57.381485 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6040c334-a8b0-49eb-a086-e7eb1b5ba897 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:57.382385 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6040c334-a8b0-49eb-a086-e7eb1b5ba897 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:57.388944 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6040c334-a8b0-49eb-a086-e7eb1b5ba897 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:57.389396 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6040c334-a8b0-49eb-a086-e7eb1b5ba897 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:57.390158 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6040c334-a8b0-49eb-a086-e7eb1b5ba897 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:57.390590 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6040c334-a8b0-49eb-a086-e7eb1b5ba897 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:57.420941 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6040c334-a8b0-49eb-a086-e7eb1b5ba897 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043871 Apr 06 16:45:57.421517 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 536/1050] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:57 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:57.995329 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c579b228-0b3e-4ca7-93d8-f855155c6424 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:57.996253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c579b228-0b3e-4ca7-93d8-f855155c6424 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:58.003076 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c579b228-0b3e-4ca7-93d8-f855155c6424 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:58.003529 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c579b228-0b3e-4ca7-93d8-f855155c6424 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:58.004448 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c579b228-0b3e-4ca7-93d8-f855155c6424 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:58.004961 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c579b228-0b3e-4ca7-93d8-f855155c6424 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:58.036635 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c579b228-0b3e-4ca7-93d8-f855155c6424 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045323 Apr 06 16:45:58.037304 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 515/1051] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:57 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:58.433900 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c1dcecd0-94e9-4eaf-ade4-ad4dc3e44ff4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:58.434796 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c1dcecd0-94e9-4eaf-ade4-ad4dc3e44ff4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:58.441434 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1dcecd0-94e9-4eaf-ade4-ad4dc3e44ff4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:58.441883 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1dcecd0-94e9-4eaf-ade4-ad4dc3e44ff4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:58.442648 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1dcecd0-94e9-4eaf-ade4-ad4dc3e44ff4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:58.443114 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1dcecd0-94e9-4eaf-ade4-ad4dc3e44ff4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:58.474396 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c1dcecd0-94e9-4eaf-ade4-ad4dc3e44ff4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044467 Apr 06 16:45:58.474992 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 537/1052] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:58 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:45:59.052369 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fbda013c-e541-4a5d-8170-040f1517f2d3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:59.053436 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fbda013c-e541-4a5d-8170-040f1517f2d3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:59.060330 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbda013c-e541-4a5d-8170-040f1517f2d3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:59.060814 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbda013c-e541-4a5d-8170-040f1517f2d3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:59.061589 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbda013c-e541-4a5d-8170-040f1517f2d3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:59.062023 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbda013c-e541-4a5d-8170-040f1517f2d3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:59.092448 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fbda013c-e541-4a5d-8170-040f1517f2d3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046850 Apr 06 16:45:59.093060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 516/1053] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:45:59 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:45:59.486856 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-610cda71-a449-462d-b20b-28930016101f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:45:59.487918 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-610cda71-a449-462d-b20b-28930016101f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:45:59.494581 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-610cda71-a449-462d-b20b-28930016101f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:59.495014 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-610cda71-a449-462d-b20b-28930016101f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:59.495774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-610cda71-a449-462d-b20b-28930016101f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:45:59.496197 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-610cda71-a449-462d-b20b-28930016101f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:45:59.525306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-610cda71-a449-462d-b20b-28930016101f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042433 Apr 06 16:45:59.525860 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 538/1054] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:45:59 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:46:00.106903 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-05a1fbe9-cf05-4243-a3df-3bf5c61a780a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:00.107746 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-05a1fbe9-cf05-4243-a3df-3bf5c61a780a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:00.114541 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05a1fbe9-cf05-4243-a3df-3bf5c61a780a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:00.114991 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05a1fbe9-cf05-4243-a3df-3bf5c61a780a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:00.115747 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05a1fbe9-cf05-4243-a3df-3bf5c61a780a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:00.116189 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05a1fbe9-cf05-4243-a3df-3bf5c61a780a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:00.145928 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-05a1fbe9-cf05-4243-a3df-3bf5c61a780a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044353 Apr 06 16:46:00.146500 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 517/1055] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:00 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:00.542412 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0b6c00b4-03ec-45be-a15b-29849c289293 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:00.543971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0b6c00b4-03ec-45be-a15b-29849c289293 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:00.554149 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b6c00b4-03ec-45be-a15b-29849c289293 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:00.554592 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b6c00b4-03ec-45be-a15b-29849c289293 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:00.555364 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b6c00b4-03ec-45be-a15b-29849c289293 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:00.555821 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b6c00b4-03ec-45be-a15b-29849c289293 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:00.586805 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0b6c00b4-03ec-45be-a15b-29849c289293 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051919 Apr 06 16:46:00.587362 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 539/1056] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:00 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:01.164498 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1ad59712-79f7-48e0-803e-86817349b566 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:01.166027 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1ad59712-79f7-48e0-803e-86817349b566 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:01.176883 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ad59712-79f7-48e0-803e-86817349b566 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:01.177637 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ad59712-79f7-48e0-803e-86817349b566 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:01.179065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ad59712-79f7-48e0-803e-86817349b566 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:01.179519 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ad59712-79f7-48e0-803e-86817349b566 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:01.209866 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1ad59712-79f7-48e0-803e-86817349b566 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052468 Apr 06 16:46:01.210421 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 518/1057] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:01 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:01.604322 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-02af31f1-ea2d-4ee3-ad5d-b3f2c85547c5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:01.605547 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-02af31f1-ea2d-4ee3-ad5d-b3f2c85547c5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:01.612543 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02af31f1-ea2d-4ee3-ad5d-b3f2c85547c5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:01.613031 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02af31f1-ea2d-4ee3-ad5d-b3f2c85547c5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:01.613793 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02af31f1-ea2d-4ee3-ad5d-b3f2c85547c5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:01.614562 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02af31f1-ea2d-4ee3-ad5d-b3f2c85547c5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:01.643234 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-02af31f1-ea2d-4ee3-ad5d-b3f2c85547c5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044719 Apr 06 16:46:01.643801 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 540/1058] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:01 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:02.222572 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d2f05ada-9655-4803-94af-42cc26467ad1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:02.223495 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d2f05ada-9655-4803-94af-42cc26467ad1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:02.230411 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2f05ada-9655-4803-94af-42cc26467ad1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:02.230867 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2f05ada-9655-4803-94af-42cc26467ad1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:02.231641 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2f05ada-9655-4803-94af-42cc26467ad1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:02.232073 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2f05ada-9655-4803-94af-42cc26467ad1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:02.262308 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d2f05ada-9655-4803-94af-42cc26467ad1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043744 Apr 06 16:46:02.262846 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 519/1059] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:02 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:02.655942 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9ea4e29c-105b-4537-9f1b-43f013f22a16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:02.657102 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9ea4e29c-105b-4537-9f1b-43f013f22a16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:02.663541 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ea4e29c-105b-4537-9f1b-43f013f22a16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:02.664057 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ea4e29c-105b-4537-9f1b-43f013f22a16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:02.665218 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ea4e29c-105b-4537-9f1b-43f013f22a16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:02.665825 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ea4e29c-105b-4537-9f1b-43f013f22a16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:02.701855 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9ea4e29c-105b-4537-9f1b-43f013f22a16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050169 Apr 06 16:46:02.702446 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 541/1060] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:02 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:03.279377 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-551ed85c-8009-41d7-ade4-c07b917291ec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:03.280736 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-551ed85c-8009-41d7-ade4-c07b917291ec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:03.291002 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-551ed85c-8009-41d7-ade4-c07b917291ec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:03.291433 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-551ed85c-8009-41d7-ade4-c07b917291ec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:03.292206 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-551ed85c-8009-41d7-ade4-c07b917291ec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:03.292637 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-551ed85c-8009-41d7-ade4-c07b917291ec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:03.322565 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-551ed85c-8009-41d7-ade4-c07b917291ec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050736 Apr 06 16:46:03.323120 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 520/1061] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:03 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:03.718773 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1326b726-c570-4006-9b98-133fe55225de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:03.720201 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1326b726-c570-4006-9b98-133fe55225de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:03.729362 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1326b726-c570-4006-9b98-133fe55225de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:03.729823 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1326b726-c570-4006-9b98-133fe55225de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:03.730572 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1326b726-c570-4006-9b98-133fe55225de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:03.731010 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1326b726-c570-4006-9b98-133fe55225de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:03.762123 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1326b726-c570-4006-9b98-133fe55225de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049922 Apr 06 16:46:03.763109 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 542/1062] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:03 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:04.335076 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-245ea3cc-aa0b-4202-868a-c16456c03efe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:04.336191 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-245ea3cc-aa0b-4202-868a-c16456c03efe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:04.345251 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-245ea3cc-aa0b-4202-868a-c16456c03efe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:04.345905 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-245ea3cc-aa0b-4202-868a-c16456c03efe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:04.346949 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-245ea3cc-aa0b-4202-868a-c16456c03efe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:04.347610 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-245ea3cc-aa0b-4202-868a-c16456c03efe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:04.380004 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-245ea3cc-aa0b-4202-868a-c16456c03efe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048929 Apr 06 16:46:04.380641 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 521/1063] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:04 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:04.780300 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e8e3d2f6-da45-4ed2-8620-f2e75b35d510 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:04.781823 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e8e3d2f6-da45-4ed2-8620-f2e75b35d510 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:04.791659 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8e3d2f6-da45-4ed2-8620-f2e75b35d510 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:04.792102 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8e3d2f6-da45-4ed2-8620-f2e75b35d510 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:04.792910 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8e3d2f6-da45-4ed2-8620-f2e75b35d510 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:04.793340 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8e3d2f6-da45-4ed2-8620-f2e75b35d510 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:04.823295 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e8e3d2f6-da45-4ed2-8620-f2e75b35d510 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050226 Apr 06 16:46:04.823856 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 543/1064] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:04 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:05.393582 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-15697945-8f4a-4b07-a175-8611174d62ed tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:05.394548 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-15697945-8f4a-4b07-a175-8611174d62ed tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:05.402949 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15697945-8f4a-4b07-a175-8611174d62ed tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:05.403420 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15697945-8f4a-4b07-a175-8611174d62ed tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:05.404225 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15697945-8f4a-4b07-a175-8611174d62ed tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:05.404700 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15697945-8f4a-4b07-a175-8611174d62ed tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:05.443890 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-15697945-8f4a-4b07-a175-8611174d62ed tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054288 Apr 06 16:46:05.444636 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 522/1065] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:05 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:05.838204 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-585ceccd-7980-46de-bcf5-3582c1816719 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:05.839125 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-585ceccd-7980-46de-bcf5-3582c1816719 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:05.847350 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-585ceccd-7980-46de-bcf5-3582c1816719 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:05.847889 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-585ceccd-7980-46de-bcf5-3582c1816719 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:05.848955 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-585ceccd-7980-46de-bcf5-3582c1816719 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:05.849387 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-585ceccd-7980-46de-bcf5-3582c1816719 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:05.879777 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-585ceccd-7980-46de-bcf5-3582c1816719 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046818 Apr 06 16:46:05.880378 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 544/1066] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:05 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:06.456730 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ac1f0d98-873b-41ee-bd87-d2803d038e6c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:06.457686 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ac1f0d98-873b-41ee-bd87-d2803d038e6c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:06.465091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac1f0d98-873b-41ee-bd87-d2803d038e6c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:06.465657 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac1f0d98-873b-41ee-bd87-d2803d038e6c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:06.466715 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac1f0d98-873b-41ee-bd87-d2803d038e6c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:06.467400 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac1f0d98-873b-41ee-bd87-d2803d038e6c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:06.507795 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ac1f0d98-873b-41ee-bd87-d2803d038e6c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055104 Apr 06 16:46:06.508342 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 523/1067] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:06 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:06.892775 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-32703dc8-cdc6-4f2a-8674-41e762ef04aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:06.893876 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-32703dc8-cdc6-4f2a-8674-41e762ef04aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:06.901829 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32703dc8-cdc6-4f2a-8674-41e762ef04aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:06.902384 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32703dc8-cdc6-4f2a-8674-41e762ef04aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:06.903319 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32703dc8-cdc6-4f2a-8674-41e762ef04aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:06.903846 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32703dc8-cdc6-4f2a-8674-41e762ef04aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:06.934142 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-32703dc8-cdc6-4f2a-8674-41e762ef04aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046405 Apr 06 16:46:06.934692 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 545/1068] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:06 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:07.524273 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9b8ea084-e11b-4d8c-82e6-0bde0323d7a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:07.525669 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9b8ea084-e11b-4d8c-82e6-0bde0323d7a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:07.536335 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b8ea084-e11b-4d8c-82e6-0bde0323d7a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:07.537140 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b8ea084-e11b-4d8c-82e6-0bde0323d7a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:07.538400 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b8ea084-e11b-4d8c-82e6-0bde0323d7a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:07.539115 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b8ea084-e11b-4d8c-82e6-0bde0323d7a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:07.569087 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9b8ea084-e11b-4d8c-82e6-0bde0323d7a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051640 Apr 06 16:46:07.569644 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 524/1069] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:07 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:07.950097 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c26e033c-ae72-48f7-83b5-69277619e67d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:07.951234 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c26e033c-ae72-48f7-83b5-69277619e67d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:07.960738 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c26e033c-ae72-48f7-83b5-69277619e67d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:07.961511 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c26e033c-ae72-48f7-83b5-69277619e67d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:07.962631 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c26e033c-ae72-48f7-83b5-69277619e67d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:07.963213 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c26e033c-ae72-48f7-83b5-69277619e67d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:07.997454 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c26e033c-ae72-48f7-83b5-69277619e67d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053850 Apr 06 16:46:07.998016 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 546/1070] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:07 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:08.582282 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-27072700-b039-427f-9be7-4559f6d35d20 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:08.583292 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-27072700-b039-427f-9be7-4559f6d35d20 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:08.590915 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27072700-b039-427f-9be7-4559f6d35d20 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:08.591371 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27072700-b039-427f-9be7-4559f6d35d20 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:08.592128 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27072700-b039-427f-9be7-4559f6d35d20 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:08.592561 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27072700-b039-427f-9be7-4559f6d35d20 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:08.623966 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-27072700-b039-427f-9be7-4559f6d35d20 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046170 Apr 06 16:46:08.624533 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 525/1071] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:08 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:09.013497 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-32b50010-5f11-4861-ae2c-f6db1a0b40c0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:09.014423 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-32b50010-5f11-4861-ae2c-f6db1a0b40c0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:09.020794 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32b50010-5f11-4861-ae2c-f6db1a0b40c0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:09.021246 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32b50010-5f11-4861-ae2c-f6db1a0b40c0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:09.022001 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32b50010-5f11-4861-ae2c-f6db1a0b40c0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:09.022444 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-32b50010-5f11-4861-ae2c-f6db1a0b40c0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:09.053578 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-32b50010-5f11-4861-ae2c-f6db1a0b40c0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044896 Apr 06 16:46:09.054135 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 547/1072] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:09 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:09.639962 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8e040da8-8c98-498b-a86b-a69f83df08a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:09.640919 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8e040da8-8c98-498b-a86b-a69f83df08a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:09.647937 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e040da8-8c98-498b-a86b-a69f83df08a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:09.648387 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e040da8-8c98-498b-a86b-a69f83df08a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:09.649194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e040da8-8c98-498b-a86b-a69f83df08a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:09.649623 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e040da8-8c98-498b-a86b-a69f83df08a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:09.680996 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8e040da8-8c98-498b-a86b-a69f83df08a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045073 Apr 06 16:46:09.681788 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 526/1073] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:09 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:10.069722 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-da06f636-172d-4af7-a10c-18711ba9dabd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:10.071069 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-da06f636-172d-4af7-a10c-18711ba9dabd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:10.081571 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-da06f636-172d-4af7-a10c-18711ba9dabd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:10.082344 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-da06f636-172d-4af7-a10c-18711ba9dabd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:10.083599 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-da06f636-172d-4af7-a10c-18711ba9dabd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:10.084323 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-da06f636-172d-4af7-a10c-18711ba9dabd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:10.116844 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-da06f636-172d-4af7-a10c-18711ba9dabd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053998 Apr 06 16:46:10.117416 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 548/1074] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:10 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:10.697348 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a25d0186-8c21-4446-a07a-d7479d4e8f3d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:10.698493 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a25d0186-8c21-4446-a07a-d7479d4e8f3d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:10.705949 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a25d0186-8c21-4446-a07a-d7479d4e8f3d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:10.706406 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a25d0186-8c21-4446-a07a-d7479d4e8f3d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:10.707177 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a25d0186-8c21-4446-a07a-d7479d4e8f3d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:10.707615 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a25d0186-8c21-4446-a07a-d7479d4e8f3d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:10.737010 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a25d0186-8c21-4446-a07a-d7479d4e8f3d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046172 Apr 06 16:46:10.737565 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 527/1075] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:10 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:11.129861 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dee80b9d-6a24-4325-9f3b-aba3fd102359 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:11.130769 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dee80b9d-6a24-4325-9f3b-aba3fd102359 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:11.142577 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dee80b9d-6a24-4325-9f3b-aba3fd102359 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:11.143028 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dee80b9d-6a24-4325-9f3b-aba3fd102359 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:11.143789 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dee80b9d-6a24-4325-9f3b-aba3fd102359 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:11.144214 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dee80b9d-6a24-4325-9f3b-aba3fd102359 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:11.175207 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dee80b9d-6a24-4325-9f3b-aba3fd102359 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049382 Apr 06 16:46:11.175845 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 549/1076] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:11 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:11.754332 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-505c5208-1d61-4999-b171-e8cacc0a2ba8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:11.755469 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-505c5208-1d61-4999-b171-e8cacc0a2ba8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:11.764728 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-505c5208-1d61-4999-b171-e8cacc0a2ba8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:11.765196 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-505c5208-1d61-4999-b171-e8cacc0a2ba8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:11.765966 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-505c5208-1d61-4999-b171-e8cacc0a2ba8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:11.766401 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-505c5208-1d61-4999-b171-e8cacc0a2ba8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:11.795359 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-505c5208-1d61-4999-b171-e8cacc0a2ba8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048542 Apr 06 16:46:11.795921 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 528/1077] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:11 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:12.188165 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6fdb7e71-85f4-4c53-b9e8-985dffcb3256 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:12.189255 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6fdb7e71-85f4-4c53-b9e8-985dffcb3256 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:12.197403 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fdb7e71-85f4-4c53-b9e8-985dffcb3256 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:12.198078 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fdb7e71-85f4-4c53-b9e8-985dffcb3256 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:12.199109 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fdb7e71-85f4-4c53-b9e8-985dffcb3256 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:12.199766 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6fdb7e71-85f4-4c53-b9e8-985dffcb3256 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:12.233260 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6fdb7e71-85f4-4c53-b9e8-985dffcb3256 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049326 Apr 06 16:46:12.233819 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 550/1078] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:12 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:12.807720 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9a9ef578-16b3-4eab-8cb5-2af855607700 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:12.808581 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9a9ef578-16b3-4eab-8cb5-2af855607700 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:12.817161 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a9ef578-16b3-4eab-8cb5-2af855607700 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:12.817921 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a9ef578-16b3-4eab-8cb5-2af855607700 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:12.819037 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a9ef578-16b3-4eab-8cb5-2af855607700 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:12.819469 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a9ef578-16b3-4eab-8cb5-2af855607700 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:12.853793 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9a9ef578-16b3-4eab-8cb5-2af855607700 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050367 Apr 06 16:46:12.854374 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 529/1079] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:12 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:13.247710 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4cfda43e-0493-4b0a-abac-11189d5f3d52 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:13.248701 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4cfda43e-0493-4b0a-abac-11189d5f3d52 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:13.257561 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cfda43e-0493-4b0a-abac-11189d5f3d52 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:13.258273 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cfda43e-0493-4b0a-abac-11189d5f3d52 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:13.259489 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cfda43e-0493-4b0a-abac-11189d5f3d52 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:13.260124 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cfda43e-0493-4b0a-abac-11189d5f3d52 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:13.305650 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4cfda43e-0493-4b0a-abac-11189d5f3d52 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062002 Apr 06 16:46:13.306240 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 551/1080] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:13 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:13.869810 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-75c784d6-4381-4249-b04f-b7a29058ceea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:13.870925 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-75c784d6-4381-4249-b04f-b7a29058ceea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:13.881215 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75c784d6-4381-4249-b04f-b7a29058ceea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:13.881916 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75c784d6-4381-4249-b04f-b7a29058ceea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:13.883170 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75c784d6-4381-4249-b04f-b7a29058ceea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:13.883876 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75c784d6-4381-4249-b04f-b7a29058ceea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:13.919603 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-75c784d6-4381-4249-b04f-b7a29058ceea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056466 Apr 06 16:46:13.920200 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 530/1081] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:13 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:14.319514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-52c6687b-f781-4a6d-9051-caf0a163b2fc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:14.320336 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-52c6687b-f781-4a6d-9051-caf0a163b2fc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:14.326796 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52c6687b-f781-4a6d-9051-caf0a163b2fc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:14.327252 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52c6687b-f781-4a6d-9051-caf0a163b2fc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:14.328047 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52c6687b-f781-4a6d-9051-caf0a163b2fc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:14.328468 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52c6687b-f781-4a6d-9051-caf0a163b2fc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:14.358106 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-52c6687b-f781-4a6d-9051-caf0a163b2fc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042721 Apr 06 16:46:14.358679 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 552/1082] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:14 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:14.936720 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d5b97f54-9e7c-41ff-b91f-647cef99e42c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:14.937683 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d5b97f54-9e7c-41ff-b91f-647cef99e42c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:14.944380 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5b97f54-9e7c-41ff-b91f-647cef99e42c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:14.944866 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5b97f54-9e7c-41ff-b91f-647cef99e42c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:14.945636 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5b97f54-9e7c-41ff-b91f-647cef99e42c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:14.946069 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5b97f54-9e7c-41ff-b91f-647cef99e42c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:14.976078 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d5b97f54-9e7c-41ff-b91f-647cef99e42c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045095 Apr 06 16:46:14.976719 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 531/1083] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:14 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:15.370824 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-846d0550-d10c-4a2e-b10c-238f1e66b2ad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:15.371742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-846d0550-d10c-4a2e-b10c-238f1e66b2ad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:15.378476 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-846d0550-d10c-4a2e-b10c-238f1e66b2ad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:15.378927 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-846d0550-d10c-4a2e-b10c-238f1e66b2ad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:15.379695 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-846d0550-d10c-4a2e-b10c-238f1e66b2ad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:15.380290 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-846d0550-d10c-4a2e-b10c-238f1e66b2ad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:15.409313 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-846d0550-d10c-4a2e-b10c-238f1e66b2ad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042490 Apr 06 16:46:15.409863 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 553/1084] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:15 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:15.992940 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c0965841-601e-40fe-8d06-2fd4f23adf4b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:15.994357 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c0965841-601e-40fe-8d06-2fd4f23adf4b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:16.005158 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0965841-601e-40fe-8d06-2fd4f23adf4b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:16.005914 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0965841-601e-40fe-8d06-2fd4f23adf4b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:16.007180 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0965841-601e-40fe-8d06-2fd4f23adf4b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:16.007903 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0965841-601e-40fe-8d06-2fd4f23adf4b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:16.040257 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c0965841-601e-40fe-8d06-2fd4f23adf4b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054561 Apr 06 16:46:16.040840 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 532/1085] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:15 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:16.421825 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4a9073f9-b152-4a5c-8b62-dc2baa54ee7f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:16.422755 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4a9073f9-b152-4a5c-8b62-dc2baa54ee7f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:16.429251 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a9073f9-b152-4a5c-8b62-dc2baa54ee7f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:16.429694 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a9073f9-b152-4a5c-8b62-dc2baa54ee7f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:16.430461 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a9073f9-b152-4a5c-8b62-dc2baa54ee7f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:16.430893 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a9073f9-b152-4a5c-8b62-dc2baa54ee7f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:16.461831 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4a9073f9-b152-4a5c-8b62-dc2baa54ee7f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044189 Apr 06 16:46:16.462387 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 554/1086] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:16 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:17.058012 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7eb52f7a-83c6-4be4-8dc1-d51ad5887191 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:17.059612 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7eb52f7a-83c6-4be4-8dc1-d51ad5887191 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:17.070387 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7eb52f7a-83c6-4be4-8dc1-d51ad5887191 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:17.071097 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7eb52f7a-83c6-4be4-8dc1-d51ad5887191 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:17.072369 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7eb52f7a-83c6-4be4-8dc1-d51ad5887191 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:17.073155 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7eb52f7a-83c6-4be4-8dc1-d51ad5887191 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:17.103189 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7eb52f7a-83c6-4be4-8dc1-d51ad5887191 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052186 Apr 06 16:46:17.103735 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 533/1087] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:17 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:17.479741 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6d866cac-53f6-456e-bd1b-af1a8de74a3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:17.481234 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6d866cac-53f6-456e-bd1b-af1a8de74a3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:17.487955 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d866cac-53f6-456e-bd1b-af1a8de74a3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:17.488412 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d866cac-53f6-456e-bd1b-af1a8de74a3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:17.489573 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d866cac-53f6-456e-bd1b-af1a8de74a3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:17.490007 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d866cac-53f6-456e-bd1b-af1a8de74a3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:17.520140 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6d866cac-53f6-456e-bd1b-af1a8de74a3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047336 Apr 06 16:46:17.520708 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 555/1088] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:17 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:18.119789 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-02ccfb33-f483-42bb-af9d-4bde9e4a499b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:18.120988 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-02ccfb33-f483-42bb-af9d-4bde9e4a499b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:18.130194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02ccfb33-f483-42bb-af9d-4bde9e4a499b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:18.130699 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02ccfb33-f483-42bb-af9d-4bde9e4a499b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:18.131846 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02ccfb33-f483-42bb-af9d-4bde9e4a499b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:18.132224 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02ccfb33-f483-42bb-af9d-4bde9e4a499b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:18.167535 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-02ccfb33-f483-42bb-af9d-4bde9e4a499b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053062 Apr 06 16:46:18.168086 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 534/1089] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:18 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:18.536210 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1a45eb2e-0051-48d1-85db-b6ce1f6cca08 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:18.537750 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1a45eb2e-0051-48d1-85db-b6ce1f6cca08 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:18.546451 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a45eb2e-0051-48d1-85db-b6ce1f6cca08 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:18.546902 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a45eb2e-0051-48d1-85db-b6ce1f6cca08 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:18.547670 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a45eb2e-0051-48d1-85db-b6ce1f6cca08 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:18.548101 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a45eb2e-0051-48d1-85db-b6ce1f6cca08 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:18.576965 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1a45eb2e-0051-48d1-85db-b6ce1f6cca08 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047443 Apr 06 16:46:18.577521 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 556/1090] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:18 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:19.180385 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6b401cf2-9f1a-4b78-89e5-4ece016c95c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:19.181333 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6b401cf2-9f1a-4b78-89e5-4ece016c95c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:19.188620 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b401cf2-9f1a-4b78-89e5-4ece016c95c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:19.189100 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b401cf2-9f1a-4b78-89e5-4ece016c95c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:19.189866 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b401cf2-9f1a-4b78-89e5-4ece016c95c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:19.190305 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b401cf2-9f1a-4b78-89e5-4ece016c95c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:19.220087 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6b401cf2-9f1a-4b78-89e5-4ece016c95c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043769 Apr 06 16:46:19.220671 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 535/1091] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:19 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:19.593071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d20750a4-fd8a-48a4-9d39-3b4a84565628 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:19.594018 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d20750a4-fd8a-48a4-9d39-3b4a84565628 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:19.601550 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d20750a4-fd8a-48a4-9d39-3b4a84565628 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:19.602079 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d20750a4-fd8a-48a4-9d39-3b4a84565628 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:19.603011 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d20750a4-fd8a-48a4-9d39-3b4a84565628 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:19.603518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d20750a4-fd8a-48a4-9d39-3b4a84565628 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:19.635684 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d20750a4-fd8a-48a4-9d39-3b4a84565628 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049068 Apr 06 16:46:19.636256 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 557/1092] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:19 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:20.234930 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b4948cf3-66a5-4f0c-91b7-84d5421d7d6b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:20.235858 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b4948cf3-66a5-4f0c-91b7-84d5421d7d6b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:20.244038 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4948cf3-66a5-4f0c-91b7-84d5421d7d6b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:20.244563 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4948cf3-66a5-4f0c-91b7-84d5421d7d6b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:20.245506 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4948cf3-66a5-4f0c-91b7-84d5421d7d6b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:20.246006 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4948cf3-66a5-4f0c-91b7-84d5421d7d6b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:20.275048 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b4948cf3-66a5-4f0c-91b7-84d5421d7d6b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046499 Apr 06 16:46:20.275602 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 536/1093] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:20 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:20.651793 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b6382bd4-98b7-4579-a13f-21648a8a5afa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:20.653317 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b6382bd4-98b7-4579-a13f-21648a8a5afa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:20.663806 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6382bd4-98b7-4579-a13f-21648a8a5afa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:20.664536 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6382bd4-98b7-4579-a13f-21648a8a5afa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:20.665837 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6382bd4-98b7-4579-a13f-21648a8a5afa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:20.666549 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b6382bd4-98b7-4579-a13f-21648a8a5afa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:20.697195 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b6382bd4-98b7-4579-a13f-21648a8a5afa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052388 Apr 06 16:46:20.697944 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 558/1094] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:20 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:21.288282 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8b3d4e35-e052-4f46-adc9-bfb52fbd97d4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:21.289195 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8b3d4e35-e052-4f46-adc9-bfb52fbd97d4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:21.296308 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b3d4e35-e052-4f46-adc9-bfb52fbd97d4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:21.296779 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b3d4e35-e052-4f46-adc9-bfb52fbd97d4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:21.297536 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b3d4e35-e052-4f46-adc9-bfb52fbd97d4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:21.297972 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b3d4e35-e052-4f46-adc9-bfb52fbd97d4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:21.329050 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8b3d4e35-e052-4f46-adc9-bfb52fbd97d4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045042 Apr 06 16:46:21.329624 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 537/1095] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:21 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:21.715380 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ed459dbe-c643-487f-9687-242a8d7100f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:21.716986 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ed459dbe-c643-487f-9687-242a8d7100f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:21.724546 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed459dbe-c643-487f-9687-242a8d7100f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:21.725033 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed459dbe-c643-487f-9687-242a8d7100f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:21.725903 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed459dbe-c643-487f-9687-242a8d7100f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:21.726372 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed459dbe-c643-487f-9687-242a8d7100f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:21.758789 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ed459dbe-c643-487f-9687-242a8d7100f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050617 Apr 06 16:46:21.759447 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 559/1096] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:21 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:22.344612 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-631f8d96-224c-451d-9233-a6260a74e5bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:22.345584 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-631f8d96-224c-451d-9233-a6260a74e5bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:22.352418 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-631f8d96-224c-451d-9233-a6260a74e5bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:22.352890 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-631f8d96-224c-451d-9233-a6260a74e5bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:22.353713 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-631f8d96-224c-451d-9233-a6260a74e5bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:22.354116 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-631f8d96-224c-451d-9233-a6260a74e5bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:22.383874 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-631f8d96-224c-451d-9233-a6260a74e5bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045352 Apr 06 16:46:22.384441 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 538/1097] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:22 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:22.775076 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-270ba654-446e-4b77-801f-f5c44b3e3099 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:22.776089 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-270ba654-446e-4b77-801f-f5c44b3e3099 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:22.785556 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-270ba654-446e-4b77-801f-f5c44b3e3099 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:22.786160 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-270ba654-446e-4b77-801f-f5c44b3e3099 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:22.787242 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-270ba654-446e-4b77-801f-f5c44b3e3099 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:22.787824 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-270ba654-446e-4b77-801f-f5c44b3e3099 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:22.822433 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-270ba654-446e-4b77-801f-f5c44b3e3099 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053769 Apr 06 16:46:22.823003 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 560/1098] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:22 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:23.397691 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-efa77a17-1ec8-4e1c-9725-f8de1f6d1f36 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:23.398832 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-efa77a17-1ec8-4e1c-9725-f8de1f6d1f36 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:23.408156 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efa77a17-1ec8-4e1c-9725-f8de1f6d1f36 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:23.409087 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efa77a17-1ec8-4e1c-9725-f8de1f6d1f36 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:23.410331 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efa77a17-1ec8-4e1c-9725-f8de1f6d1f36 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:23.411041 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efa77a17-1ec8-4e1c-9725-f8de1f6d1f36 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:23.613660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-efa77a17-1ec8-4e1c-9725-f8de1f6d1f36 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.220690 Apr 06 16:46:23.614211 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 539/1099] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:23 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:23.838163 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ed369e9e-2181-4607-a798-2c1faf99e689 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:23.839335 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ed369e9e-2181-4607-a798-2c1faf99e689 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:23.847824 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed369e9e-2181-4607-a798-2c1faf99e689 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:23.848271 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed369e9e-2181-4607-a798-2c1faf99e689 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:23.849083 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed369e9e-2181-4607-a798-2c1faf99e689 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:23.849516 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed369e9e-2181-4607-a798-2c1faf99e689 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:23.880357 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ed369e9e-2181-4607-a798-2c1faf99e689 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048038 Apr 06 16:46:23.881701 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 561/1100] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:23 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:24.628709 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-00614e09-c58f-4535-b95e-636ecbdba7d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:24.629634 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-00614e09-c58f-4535-b95e-636ecbdba7d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:24.636265 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00614e09-c58f-4535-b95e-636ecbdba7d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:24.636722 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00614e09-c58f-4535-b95e-636ecbdba7d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:24.637515 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00614e09-c58f-4535-b95e-636ecbdba7d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:24.637947 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00614e09-c58f-4535-b95e-636ecbdba7d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:24.668513 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-00614e09-c58f-4535-b95e-636ecbdba7d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045339 Apr 06 16:46:24.669088 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 540/1101] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:24 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:24.893114 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-731c754e-b77c-4202-97d7-7173256fb65c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:24.894032 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-731c754e-b77c-4202-97d7-7173256fb65c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:24.900875 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-731c754e-b77c-4202-97d7-7173256fb65c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:24.901322 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-731c754e-b77c-4202-97d7-7173256fb65c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:24.902248 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-731c754e-b77c-4202-97d7-7173256fb65c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:24.902709 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-731c754e-b77c-4202-97d7-7173256fb65c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:24.939024 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-731c754e-b77c-4202-97d7-7173256fb65c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050658 Apr 06 16:46:24.939842 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 562/1102] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:24 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:25.684726 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6bdd59e3-46f3-4f1c-b606-2cca1ab36eb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:25.685899 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6bdd59e3-46f3-4f1c-b606-2cca1ab36eb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:25.695477 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bdd59e3-46f3-4f1c-b606-2cca1ab36eb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:25.696048 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bdd59e3-46f3-4f1c-b606-2cca1ab36eb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:25.697129 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bdd59e3-46f3-4f1c-b606-2cca1ab36eb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:25.697704 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bdd59e3-46f3-4f1c-b606-2cca1ab36eb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:25.728105 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6bdd59e3-46f3-4f1c-b606-2cca1ab36eb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048548 Apr 06 16:46:25.728675 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 541/1103] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:25 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:25.951867 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e8ee9877-bfbc-4ae9-9e10-cbd9693dbf98 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:25.952888 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e8ee9877-bfbc-4ae9-9e10-cbd9693dbf98 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:25.959305 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8ee9877-bfbc-4ae9-9e10-cbd9693dbf98 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:25.959743 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8ee9877-bfbc-4ae9-9e10-cbd9693dbf98 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:25.960504 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8ee9877-bfbc-4ae9-9e10-cbd9693dbf98 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:25.960961 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8ee9877-bfbc-4ae9-9e10-cbd9693dbf98 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:25.990393 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e8ee9877-bfbc-4ae9-9e10-cbd9693dbf98 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042992 Apr 06 16:46:25.990993 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 563/1104] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:25 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:26.742612 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a43c8d84-1db8-4ad8-b343-deb56d856287 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:26.743551 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a43c8d84-1db8-4ad8-b343-deb56d856287 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:26.750240 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a43c8d84-1db8-4ad8-b343-deb56d856287 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:26.750660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a43c8d84-1db8-4ad8-b343-deb56d856287 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:26.751528 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a43c8d84-1db8-4ad8-b343-deb56d856287 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:26.751953 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a43c8d84-1db8-4ad8-b343-deb56d856287 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:26.780442 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a43c8d84-1db8-4ad8-b343-deb56d856287 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042281 Apr 06 16:46:26.780985 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 542/1105] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:26 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:27.006409 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3741256e-ca6f-4662-83bc-8298f6354fdb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:27.007244 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3741256e-ca6f-4662-83bc-8298f6354fdb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:27.013512 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3741256e-ca6f-4662-83bc-8298f6354fdb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:27.013963 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3741256e-ca6f-4662-83bc-8298f6354fdb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:27.014719 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3741256e-ca6f-4662-83bc-8298f6354fdb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:27.015150 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3741256e-ca6f-4662-83bc-8298f6354fdb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:27.044452 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3741256e-ca6f-4662-83bc-8298f6354fdb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045533 Apr 06 16:46:27.045046 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 564/1106] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:26 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:27.799547 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1ba59deb-cb69-463c-a261-9f2c38ce4d50 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:27.800473 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1ba59deb-cb69-463c-a261-9f2c38ce4d50 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:27.807320 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ba59deb-cb69-463c-a261-9f2c38ce4d50 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:27.807780 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ba59deb-cb69-463c-a261-9f2c38ce4d50 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:27.808547 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ba59deb-cb69-463c-a261-9f2c38ce4d50 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:27.809012 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ba59deb-cb69-463c-a261-9f2c38ce4d50 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:27.838984 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1ba59deb-cb69-463c-a261-9f2c38ce4d50 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046267 Apr 06 16:46:27.839521 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 543/1107] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:27 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:28.060165 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4f7bfe61-4bba-437a-972a-4d9f43a14e64 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:28.061613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4f7bfe61-4bba-437a-972a-4d9f43a14e64 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:28.071910 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f7bfe61-4bba-437a-972a-4d9f43a14e64 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:28.072658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f7bfe61-4bba-437a-972a-4d9f43a14e64 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:28.073929 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f7bfe61-4bba-437a-972a-4d9f43a14e64 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:28.074636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f7bfe61-4bba-437a-972a-4d9f43a14e64 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:28.106617 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4f7bfe61-4bba-437a-972a-4d9f43a14e64 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053314 Apr 06 16:46:28.107194 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 565/1108] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:28 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:28.855545 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-45f68d95-2e6d-4c27-9759-3d6d7fb45c7a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:28.857064 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-45f68d95-2e6d-4c27-9759-3d6d7fb45c7a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:28.866218 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45f68d95-2e6d-4c27-9759-3d6d7fb45c7a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:28.866666 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45f68d95-2e6d-4c27-9759-3d6d7fb45c7a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:28.867407 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45f68d95-2e6d-4c27-9759-3d6d7fb45c7a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:28.868007 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45f68d95-2e6d-4c27-9759-3d6d7fb45c7a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:28.900975 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-45f68d95-2e6d-4c27-9759-3d6d7fb45c7a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052366 Apr 06 16:46:28.901530 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 544/1109] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:28 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:29.119460 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-10601df5-d189-4bbb-bed3-8f1ddcd78a2a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:29.120379 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-10601df5-d189-4bbb-bed3-8f1ddcd78a2a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:29.126971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10601df5-d189-4bbb-bed3-8f1ddcd78a2a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:29.127420 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10601df5-d189-4bbb-bed3-8f1ddcd78a2a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:29.128592 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10601df5-d189-4bbb-bed3-8f1ddcd78a2a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:29.129062 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10601df5-d189-4bbb-bed3-8f1ddcd78a2a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:29.157457 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-10601df5-d189-4bbb-bed3-8f1ddcd78a2a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042011 Apr 06 16:46:29.158014 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 566/1110] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:29 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:29.913324 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4b415274-b4bd-4960-b3c6-208e6f80524c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:29.914218 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4b415274-b4bd-4960-b3c6-208e6f80524c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:29.920900 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b415274-b4bd-4960-b3c6-208e6f80524c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:29.921348 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b415274-b4bd-4960-b3c6-208e6f80524c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:29.922103 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b415274-b4bd-4960-b3c6-208e6f80524c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:29.922569 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b415274-b4bd-4960-b3c6-208e6f80524c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:29.955565 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4b415274-b4bd-4960-b3c6-208e6f80524c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046337 Apr 06 16:46:29.956108 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 545/1111] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:29 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:30.171622 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bd7d22f9-ead8-4443-871b-32b0cf6bf7ae tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:30.172471 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bd7d22f9-ead8-4443-871b-32b0cf6bf7ae tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:30.179326 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd7d22f9-ead8-4443-871b-32b0cf6bf7ae tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:30.179780 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd7d22f9-ead8-4443-871b-32b0cf6bf7ae tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:30.180544 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd7d22f9-ead8-4443-871b-32b0cf6bf7ae tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:30.181017 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd7d22f9-ead8-4443-871b-32b0cf6bf7ae tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:30.211216 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bd7d22f9-ead8-4443-871b-32b0cf6bf7ae tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043866 Apr 06 16:46:30.211786 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 567/1112] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:30 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:30.971036 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e03950ce-28e3-4332-af31-d21bb3650e37 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:30.972310 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e03950ce-28e3-4332-af31-d21bb3650e37 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:30.981803 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e03950ce-28e3-4332-af31-d21bb3650e37 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:30.982449 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e03950ce-28e3-4332-af31-d21bb3650e37 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:30.983629 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e03950ce-28e3-4332-af31-d21bb3650e37 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:30.984151 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e03950ce-28e3-4332-af31-d21bb3650e37 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:31.015661 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e03950ce-28e3-4332-af31-d21bb3650e37 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050488 Apr 06 16:46:31.016271 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 546/1113] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:30 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:31.225966 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d84aa89b-0c0f-48e7-b53b-01220fe6bf32 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:31.226808 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d84aa89b-0c0f-48e7-b53b-01220fe6bf32 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:31.233667 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d84aa89b-0c0f-48e7-b53b-01220fe6bf32 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:31.234115 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d84aa89b-0c0f-48e7-b53b-01220fe6bf32 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:31.234882 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d84aa89b-0c0f-48e7-b53b-01220fe6bf32 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:31.235311 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d84aa89b-0c0f-48e7-b53b-01220fe6bf32 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:31.265838 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d84aa89b-0c0f-48e7-b53b-01220fe6bf32 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045858 Apr 06 16:46:31.266398 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 568/1114] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:31 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:32.032178 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eb6e1996-b4fc-40c4-a479-59cff953845a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:32.033525 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eb6e1996-b4fc-40c4-a479-59cff953845a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:32.041526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb6e1996-b4fc-40c4-a479-59cff953845a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:32.041973 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb6e1996-b4fc-40c4-a479-59cff953845a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:32.042723 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb6e1996-b4fc-40c4-a479-59cff953845a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:32.043143 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb6e1996-b4fc-40c4-a479-59cff953845a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:32.071285 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eb6e1996-b4fc-40c4-a479-59cff953845a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045845 Apr 06 16:46:32.071807 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 547/1115] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:32 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:32.278053 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4a584e4d-fb6f-4acc-8c45-87a0fcc8de72 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:32.279008 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4a584e4d-fb6f-4acc-8c45-87a0fcc8de72 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:32.286431 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a584e4d-fb6f-4acc-8c45-87a0fcc8de72 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:32.286870 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a584e4d-fb6f-4acc-8c45-87a0fcc8de72 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:32.287753 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a584e4d-fb6f-4acc-8c45-87a0fcc8de72 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:32.288268 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a584e4d-fb6f-4acc-8c45-87a0fcc8de72 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:32.329687 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4a584e4d-fb6f-4acc-8c45-87a0fcc8de72 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055175 Apr 06 16:46:32.330608 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 569/1116] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:32 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:46:33.083674 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1539e12a-6b55-4f14-9a55-471df56e6972 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:33.084502 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1539e12a-6b55-4f14-9a55-471df56e6972 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:33.091299 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1539e12a-6b55-4f14-9a55-471df56e6972 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:33.091750 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1539e12a-6b55-4f14-9a55-471df56e6972 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:33.092520 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1539e12a-6b55-4f14-9a55-471df56e6972 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:33.092995 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1539e12a-6b55-4f14-9a55-471df56e6972 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:33.122399 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1539e12a-6b55-4f14-9a55-471df56e6972 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043035 Apr 06 16:46:33.122947 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 548/1117] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:33 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:33.344304 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5eab4861-2d90-451e-b1f4-6942364118f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:33.345195 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5eab4861-2d90-451e-b1f4-6942364118f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:33.351756 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5eab4861-2d90-451e-b1f4-6942364118f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:33.352261 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5eab4861-2d90-451e-b1f4-6942364118f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:33.353099 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5eab4861-2d90-451e-b1f4-6942364118f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:33.353529 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5eab4861-2d90-451e-b1f4-6942364118f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:33.383128 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5eab4861-2d90-451e-b1f4-6942364118f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042919 Apr 06 16:46:33.383789 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 570/1118] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:33 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:34.135302 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-886d9ddb-388b-46c8-8fff-c464cd159f74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:34.136232 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-886d9ddb-388b-46c8-8fff-c464cd159f74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:34.142746 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-886d9ddb-388b-46c8-8fff-c464cd159f74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:34.143202 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-886d9ddb-388b-46c8-8fff-c464cd159f74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:34.143977 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-886d9ddb-388b-46c8-8fff-c464cd159f74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:34.144410 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-886d9ddb-388b-46c8-8fff-c464cd159f74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:34.173992 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-886d9ddb-388b-46c8-8fff-c464cd159f74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043177 Apr 06 16:46:34.174538 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 549/1119] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:34 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:34.398029 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-19b694df-7fb0-4710-b5db-fe8c3b71b2cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:34.399045 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-19b694df-7fb0-4710-b5db-fe8c3b71b2cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:34.406555 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19b694df-7fb0-4710-b5db-fe8c3b71b2cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:34.407011 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19b694df-7fb0-4710-b5db-fe8c3b71b2cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:34.407806 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19b694df-7fb0-4710-b5db-fe8c3b71b2cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:34.408238 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19b694df-7fb0-4710-b5db-fe8c3b71b2cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:34.438543 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-19b694df-7fb0-4710-b5db-fe8c3b71b2cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044707 Apr 06 16:46:34.439097 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 571/1120] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:34 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:35.190328 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fca92261-6903-4d9c-8c5d-e29f6e16a69c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:35.191484 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fca92261-6903-4d9c-8c5d-e29f6e16a69c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:35.201103 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fca92261-6903-4d9c-8c5d-e29f6e16a69c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:35.201702 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fca92261-6903-4d9c-8c5d-e29f6e16a69c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:35.202879 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fca92261-6903-4d9c-8c5d-e29f6e16a69c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:35.203563 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fca92261-6903-4d9c-8c5d-e29f6e16a69c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:35.235538 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fca92261-6903-4d9c-8c5d-e29f6e16a69c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051841 Apr 06 16:46:35.236099 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 550/1121] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:35 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:35.451247 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-050064c8-7992-433c-a1e5-aa9504a000b4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:35.452196 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-050064c8-7992-433c-a1e5-aa9504a000b4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:35.458965 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-050064c8-7992-433c-a1e5-aa9504a000b4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:35.459406 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-050064c8-7992-433c-a1e5-aa9504a000b4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:35.460161 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-050064c8-7992-433c-a1e5-aa9504a000b4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:35.460586 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-050064c8-7992-433c-a1e5-aa9504a000b4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:35.490030 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-050064c8-7992-433c-a1e5-aa9504a000b4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043080 Apr 06 16:46:35.494232 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 572/1122] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:35 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:36.251685 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-262f6653-c38f-44fe-b516-ef9132482e7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:36.253097 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-262f6653-c38f-44fe-b516-ef9132482e7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:36.262578 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-262f6653-c38f-44fe-b516-ef9132482e7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:36.263033 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-262f6653-c38f-44fe-b516-ef9132482e7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:36.263805 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-262f6653-c38f-44fe-b516-ef9132482e7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:36.264237 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-262f6653-c38f-44fe-b516-ef9132482e7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:36.303192 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-262f6653-c38f-44fe-b516-ef9132482e7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057534 Apr 06 16:46:36.303752 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 551/1123] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:36 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:36.502598 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8892239d-ec2c-473b-a166-a2826211f2ac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:36.503529 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8892239d-ec2c-473b-a166-a2826211f2ac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:36.510081 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8892239d-ec2c-473b-a166-a2826211f2ac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:36.510528 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8892239d-ec2c-473b-a166-a2826211f2ac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:36.511299 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8892239d-ec2c-473b-a166-a2826211f2ac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:36.511732 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8892239d-ec2c-473b-a166-a2826211f2ac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:36.540573 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8892239d-ec2c-473b-a166-a2826211f2ac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042063 Apr 06 16:46:36.541173 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 573/1124] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:36 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:37.316467 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9e6e8016-2b24-4bc2-ac01-4e8e9ab6588b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:37.317338 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9e6e8016-2b24-4bc2-ac01-4e8e9ab6588b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:37.324305 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e6e8016-2b24-4bc2-ac01-4e8e9ab6588b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:37.324797 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e6e8016-2b24-4bc2-ac01-4e8e9ab6588b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:37.325559 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e6e8016-2b24-4bc2-ac01-4e8e9ab6588b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:37.326000 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e6e8016-2b24-4bc2-ac01-4e8e9ab6588b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:37.355888 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9e6e8016-2b24-4bc2-ac01-4e8e9ab6588b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044113 Apr 06 16:46:37.356460 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 552/1125] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:37 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:37.558923 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-944980b6-57e1-472e-a284-7bc939819ace tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:37.560396 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-944980b6-57e1-472e-a284-7bc939819ace tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:37.567878 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-944980b6-57e1-472e-a284-7bc939819ace tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:37.568250 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-944980b6-57e1-472e-a284-7bc939819ace tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:37.569041 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-944980b6-57e1-472e-a284-7bc939819ace tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:37.569463 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-944980b6-57e1-472e-a284-7bc939819ace tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:37.598337 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-944980b6-57e1-472e-a284-7bc939819ace tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046157 Apr 06 16:46:37.598890 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 574/1126] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:37 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:38.368525 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-021c9116-0aaf-44d4-a01a-64350a04f7ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:38.369473 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-021c9116-0aaf-44d4-a01a-64350a04f7ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:38.376352 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-021c9116-0aaf-44d4-a01a-64350a04f7ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:38.376831 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-021c9116-0aaf-44d4-a01a-64350a04f7ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:38.377586 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-021c9116-0aaf-44d4-a01a-64350a04f7ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:38.378014 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-021c9116-0aaf-44d4-a01a-64350a04f7ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:38.407969 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-021c9116-0aaf-44d4-a01a-64350a04f7ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043442 Apr 06 16:46:38.408524 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 553/1127] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:38 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:38.614411 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cc63f111-60ed-429a-b250-589c4e3f4cb7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:38.615561 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cc63f111-60ed-429a-b250-589c4e3f4cb7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:38.621709 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc63f111-60ed-429a-b250-589c4e3f4cb7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:38.622149 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc63f111-60ed-429a-b250-589c4e3f4cb7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:38.623157 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc63f111-60ed-429a-b250-589c4e3f4cb7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:38.623304 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc63f111-60ed-429a-b250-589c4e3f4cb7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:38.651890 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cc63f111-60ed-429a-b250-589c4e3f4cb7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042386 Apr 06 16:46:38.652496 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 575/1128] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:38 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:39.420625 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7ec630c9-7de9-4681-a5d8-441b8d4f9272 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:39.421584 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7ec630c9-7de9-4681-a5d8-441b8d4f9272 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:39.428343 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ec630c9-7de9-4681-a5d8-441b8d4f9272 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:39.428831 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ec630c9-7de9-4681-a5d8-441b8d4f9272 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:39.429604 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ec630c9-7de9-4681-a5d8-441b8d4f9272 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:39.430039 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ec630c9-7de9-4681-a5d8-441b8d4f9272 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:39.459060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7ec630c9-7de9-4681-a5d8-441b8d4f9272 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042586 Apr 06 16:46:39.459614 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 554/1129] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:39 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:39.665876 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5dbdba66-4fef-4314-a6f5-6c2b008c05df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:39.666823 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5dbdba66-4fef-4314-a6f5-6c2b008c05df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:39.674148 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5dbdba66-4fef-4314-a6f5-6c2b008c05df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:39.674603 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5dbdba66-4fef-4314-a6f5-6c2b008c05df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:39.675358 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5dbdba66-4fef-4314-a6f5-6c2b008c05df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:39.675781 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5dbdba66-4fef-4314-a6f5-6c2b008c05df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:39.710576 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5dbdba66-4fef-4314-a6f5-6c2b008c05df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049819 Apr 06 16:46:39.711106 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 576/1130] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:39 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:40.474682 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f1a18c3c-ef2c-43b8-8bdd-7bba3d3e9adb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:40.475603 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f1a18c3c-ef2c-43b8-8bdd-7bba3d3e9adb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:40.483698 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1a18c3c-ef2c-43b8-8bdd-7bba3d3e9adb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:40.484425 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1a18c3c-ef2c-43b8-8bdd-7bba3d3e9adb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:40.484931 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1a18c3c-ef2c-43b8-8bdd-7bba3d3e9adb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:40.485343 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1a18c3c-ef2c-43b8-8bdd-7bba3d3e9adb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:40.516930 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f1a18c3c-ef2c-43b8-8bdd-7bba3d3e9adb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047902 Apr 06 16:46:40.517481 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 555/1131] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:40 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:40.728075 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a8cc42d4-3e65-4d57-9ff7-046d63b92d73 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:40.729504 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a8cc42d4-3e65-4d57-9ff7-046d63b92d73 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:40.739439 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8cc42d4-3e65-4d57-9ff7-046d63b92d73 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:40.740228 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8cc42d4-3e65-4d57-9ff7-046d63b92d73 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:40.741063 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8cc42d4-3e65-4d57-9ff7-046d63b92d73 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:40.741501 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8cc42d4-3e65-4d57-9ff7-046d63b92d73 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:40.770109 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a8cc42d4-3e65-4d57-9ff7-046d63b92d73 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048257 Apr 06 16:46:40.770659 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 577/1132] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:40 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:41.534426 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-001822db-19f4-4207-976a-a22bec1514b3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:41.536108 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-001822db-19f4-4207-976a-a22bec1514b3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:41.546173 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-001822db-19f4-4207-976a-a22bec1514b3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:41.546904 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-001822db-19f4-4207-976a-a22bec1514b3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:41.548145 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-001822db-19f4-4207-976a-a22bec1514b3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:41.548895 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-001822db-19f4-4207-976a-a22bec1514b3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:41.578971 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-001822db-19f4-4207-976a-a22bec1514b3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051356 Apr 06 16:46:41.579510 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 556/1133] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:41 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:41.784756 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5f671612-db75-4b8b-83a1-8a35a99b2c77 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:41.786943 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5f671612-db75-4b8b-83a1-8a35a99b2c77 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:41.793864 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f671612-db75-4b8b-83a1-8a35a99b2c77 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:41.794323 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f671612-db75-4b8b-83a1-8a35a99b2c77 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:41.795148 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f671612-db75-4b8b-83a1-8a35a99b2c77 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:41.795580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f671612-db75-4b8b-83a1-8a35a99b2c77 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:41.824414 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5f671612-db75-4b8b-83a1-8a35a99b2c77 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045264 Apr 06 16:46:41.825018 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 578/1134] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:41 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:42.594128 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-08735052-739d-4c68-9ed7-d46f6b12cbe3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:42.595106 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-08735052-739d-4c68-9ed7-d46f6b12cbe3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:42.601370 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08735052-739d-4c68-9ed7-d46f6b12cbe3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:42.601824 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08735052-739d-4c68-9ed7-d46f6b12cbe3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:42.602595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08735052-739d-4c68-9ed7-d46f6b12cbe3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:42.603033 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08735052-739d-4c68-9ed7-d46f6b12cbe3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:42.638703 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-08735052-739d-4c68-9ed7-d46f6b12cbe3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049722 Apr 06 16:46:42.639466 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 557/1135] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:42 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:42.839711 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b593760b-2352-4768-8004-03755bba61c8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:42.840604 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b593760b-2352-4768-8004-03755bba61c8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:42.848016 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b593760b-2352-4768-8004-03755bba61c8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:42.848445 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b593760b-2352-4768-8004-03755bba61c8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:42.849277 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b593760b-2352-4768-8004-03755bba61c8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:42.849710 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b593760b-2352-4768-8004-03755bba61c8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:42.878911 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b593760b-2352-4768-8004-03755bba61c8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044498 Apr 06 16:46:42.879462 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 579/1136] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:42 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:43.655140 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6e43dc8d-1c26-4da1-ac84-fa6043297045 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:43.656075 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6e43dc8d-1c26-4da1-ac84-fa6043297045 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:43.662989 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e43dc8d-1c26-4da1-ac84-fa6043297045 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:43.663408 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e43dc8d-1c26-4da1-ac84-fa6043297045 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:43.664209 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e43dc8d-1c26-4da1-ac84-fa6043297045 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:43.664640 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e43dc8d-1c26-4da1-ac84-fa6043297045 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:43.694380 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6e43dc8d-1c26-4da1-ac84-fa6043297045 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045337 Apr 06 16:46:43.694926 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 558/1137] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:43 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:43.892293 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fa87631b-db52-47a2-b035-570ddbed7c31 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:43.893344 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fa87631b-db52-47a2-b035-570ddbed7c31 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:43.899885 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa87631b-db52-47a2-b035-570ddbed7c31 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:43.900338 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa87631b-db52-47a2-b035-570ddbed7c31 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:43.901221 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa87631b-db52-47a2-b035-570ddbed7c31 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:43.901680 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa87631b-db52-47a2-b035-570ddbed7c31 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:43.931439 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fa87631b-db52-47a2-b035-570ddbed7c31 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043392 Apr 06 16:46:43.931911 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 580/1138] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:43 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:44.708876 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-347a505e-5aa9-4a3e-8c19-ef8dc8a3f447 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:44.710258 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-347a505e-5aa9-4a3e-8c19-ef8dc8a3f447 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:44.720664 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-347a505e-5aa9-4a3e-8c19-ef8dc8a3f447 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:44.721403 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-347a505e-5aa9-4a3e-8c19-ef8dc8a3f447 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:44.722577 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-347a505e-5aa9-4a3e-8c19-ef8dc8a3f447 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:44.723228 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-347a505e-5aa9-4a3e-8c19-ef8dc8a3f447 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:44.763785 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-347a505e-5aa9-4a3e-8c19-ef8dc8a3f447 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058927 Apr 06 16:46:44.764498 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 559/1139] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:44 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:44.946959 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0eeac1c3-c138-493a-8fe8-e36909dc5100 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:44.948151 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0eeac1c3-c138-493a-8fe8-e36909dc5100 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:44.958102 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0eeac1c3-c138-493a-8fe8-e36909dc5100 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:44.958742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0eeac1c3-c138-493a-8fe8-e36909dc5100 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:44.960021 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0eeac1c3-c138-493a-8fe8-e36909dc5100 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:44.960411 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0eeac1c3-c138-493a-8fe8-e36909dc5100 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:44.992629 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0eeac1c3-c138-493a-8fe8-e36909dc5100 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051961 Apr 06 16:46:44.993210 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 581/1140] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:44 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:45.777078 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-84201461-9436-4594-903e-4e2fb0cde2f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:45.778103 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-84201461-9436-4594-903e-4e2fb0cde2f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:45.785646 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84201461-9436-4594-903e-4e2fb0cde2f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:45.786107 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84201461-9436-4594-903e-4e2fb0cde2f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:45.786882 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84201461-9436-4594-903e-4e2fb0cde2f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:45.787318 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84201461-9436-4594-903e-4e2fb0cde2f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:45.823584 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-84201461-9436-4594-903e-4e2fb0cde2f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051076 Apr 06 16:46:45.824174 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 560/1141] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:45 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:46.004584 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1667a0fa-6a65-435f-9da2-c2e7df6b35f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:46.005596 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1667a0fa-6a65-435f-9da2-c2e7df6b35f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:46.012332 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1667a0fa-6a65-435f-9da2-c2e7df6b35f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:46.012867 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1667a0fa-6a65-435f-9da2-c2e7df6b35f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:46.013638 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1667a0fa-6a65-435f-9da2-c2e7df6b35f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:46.014054 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1667a0fa-6a65-435f-9da2-c2e7df6b35f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:46.043436 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1667a0fa-6a65-435f-9da2-c2e7df6b35f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042927 Apr 06 16:46:46.043910 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 582/1142] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:45 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:46.839038 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-07d067dd-cd37-4d50-8b9f-204e06025338 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:46.840425 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-07d067dd-cd37-4d50-8b9f-204e06025338 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:46.850972 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07d067dd-cd37-4d50-8b9f-204e06025338 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:46.851601 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07d067dd-cd37-4d50-8b9f-204e06025338 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:46.852572 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07d067dd-cd37-4d50-8b9f-204e06025338 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:46.853096 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07d067dd-cd37-4d50-8b9f-204e06025338 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:46.888621 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-07d067dd-cd37-4d50-8b9f-204e06025338 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055001 Apr 06 16:46:46.889379 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 561/1143] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:46 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:47.056118 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a0d2aca2-2509-41a6-a848-f3ac5bd5fceb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:47.057092 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a0d2aca2-2509-41a6-a848-f3ac5bd5fceb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:47.064080 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0d2aca2-2509-41a6-a848-f3ac5bd5fceb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:47.064562 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0d2aca2-2509-41a6-a848-f3ac5bd5fceb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:47.065349 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0d2aca2-2509-41a6-a848-f3ac5bd5fceb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:47.065771 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0d2aca2-2509-41a6-a848-f3ac5bd5fceb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:47.096088 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a0d2aca2-2509-41a6-a848-f3ac5bd5fceb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044016 Apr 06 16:46:47.096562 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 583/1144] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:47 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:47.901686 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-57fcdb68-6701-4c7e-b686-bf14443a3aca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:47.902673 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-57fcdb68-6701-4c7e-b686-bf14443a3aca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:47.910238 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57fcdb68-6701-4c7e-b686-bf14443a3aca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:47.910688 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57fcdb68-6701-4c7e-b686-bf14443a3aca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:47.911459 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57fcdb68-6701-4c7e-b686-bf14443a3aca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:47.911888 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57fcdb68-6701-4c7e-b686-bf14443a3aca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:47.940989 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-57fcdb68-6701-4c7e-b686-bf14443a3aca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043980 Apr 06 16:46:47.941534 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 562/1145] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:47 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:48.110682 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-72be6934-e4cc-4372-8c9e-c7ecb0c7dc82 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:48.111669 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-72be6934-e4cc-4372-8c9e-c7ecb0c7dc82 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:48.118502 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72be6934-e4cc-4372-8c9e-c7ecb0c7dc82 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:48.118956 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72be6934-e4cc-4372-8c9e-c7ecb0c7dc82 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:48.119724 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72be6934-e4cc-4372-8c9e-c7ecb0c7dc82 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:48.120163 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72be6934-e4cc-4372-8c9e-c7ecb0c7dc82 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:48.150575 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-72be6934-e4cc-4372-8c9e-c7ecb0c7dc82 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045515 Apr 06 16:46:48.151859 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 584/1146] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:48 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:48.956617 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-37342f11-f0c2-4700-9615-bfde73dba126 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:48.957586 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-37342f11-f0c2-4700-9615-bfde73dba126 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:48.964489 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37342f11-f0c2-4700-9615-bfde73dba126 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:48.964964 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37342f11-f0c2-4700-9615-bfde73dba126 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:48.965721 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37342f11-f0c2-4700-9615-bfde73dba126 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:48.966150 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37342f11-f0c2-4700-9615-bfde73dba126 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:48.995965 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-37342f11-f0c2-4700-9615-bfde73dba126 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045232 Apr 06 16:46:48.996533 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 563/1147] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:48 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:49.164368 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f44a70b2-172d-469b-862b-7c0784067c8d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:49.165307 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f44a70b2-172d-469b-862b-7c0784067c8d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:49.171836 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f44a70b2-172d-469b-862b-7c0784067c8d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:49.172278 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f44a70b2-172d-469b-862b-7c0784067c8d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:49.173110 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f44a70b2-172d-469b-862b-7c0784067c8d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:49.173922 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f44a70b2-172d-469b-862b-7c0784067c8d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:49.207758 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f44a70b2-172d-469b-862b-7c0784067c8d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047292 Apr 06 16:46:49.208232 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 585/1148] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:49 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:50.012043 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8bed0fd3-64e1-4941-be02-c1e6756306ac tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:50.013432 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8bed0fd3-64e1-4941-be02-c1e6756306ac tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:50.022792 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8bed0fd3-64e1-4941-be02-c1e6756306ac tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:50.023509 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8bed0fd3-64e1-4941-be02-c1e6756306ac tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:50.024793 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8bed0fd3-64e1-4941-be02-c1e6756306ac tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:50.025438 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8bed0fd3-64e1-4941-be02-c1e6756306ac tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:50.056732 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8bed0fd3-64e1-4941-be02-c1e6756306ac tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051235 Apr 06 16:46:50.057311 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 564/1149] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:50 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:50.221807 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e93b0722-dfb8-4c0d-be31-79c1348f15cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:50.223090 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e93b0722-dfb8-4c0d-be31-79c1348f15cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:50.232604 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e93b0722-dfb8-4c0d-be31-79c1348f15cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:50.233404 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e93b0722-dfb8-4c0d-be31-79c1348f15cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:50.234660 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e93b0722-dfb8-4c0d-be31-79c1348f15cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:50.235350 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e93b0722-dfb8-4c0d-be31-79c1348f15cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:50.271297 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e93b0722-dfb8-4c0d-be31-79c1348f15cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053650 Apr 06 16:46:50.271845 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 586/1150] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:50 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:51.069144 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-406159ef-dce0-440f-a565-5db55c316bdc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:51.070011 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-406159ef-dce0-440f-a565-5db55c316bdc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:51.076936 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-406159ef-dce0-440f-a565-5db55c316bdc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:51.077391 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-406159ef-dce0-440f-a565-5db55c316bdc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:51.078166 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-406159ef-dce0-440f-a565-5db55c316bdc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:51.078599 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-406159ef-dce0-440f-a565-5db55c316bdc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:51.107842 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-406159ef-dce0-440f-a565-5db55c316bdc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042902 Apr 06 16:46:51.108400 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 565/1151] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:51 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:51.289320 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8c28b972-13e1-4528-943a-27ffac1ad681 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:51.290676 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8c28b972-13e1-4528-943a-27ffac1ad681 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:51.301114 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c28b972-13e1-4528-943a-27ffac1ad681 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:51.301675 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c28b972-13e1-4528-943a-27ffac1ad681 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:51.302448 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c28b972-13e1-4528-943a-27ffac1ad681 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:51.302881 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c28b972-13e1-4528-943a-27ffac1ad681 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:51.331611 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8c28b972-13e1-4528-943a-27ffac1ad681 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049180 Apr 06 16:46:51.332300 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 587/1152] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:51 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:52.124004 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cb6299f2-95aa-4784-a1cf-9cb2b0fd0611 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:52.125443 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cb6299f2-95aa-4784-a1cf-9cb2b0fd0611 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:52.133391 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb6299f2-95aa-4784-a1cf-9cb2b0fd0611 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:52.133843 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb6299f2-95aa-4784-a1cf-9cb2b0fd0611 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:52.134614 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb6299f2-95aa-4784-a1cf-9cb2b0fd0611 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:52.135047 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb6299f2-95aa-4784-a1cf-9cb2b0fd0611 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:52.164184 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cb6299f2-95aa-4784-a1cf-9cb2b0fd0611 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046716 Apr 06 16:46:52.164764 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 566/1153] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:52 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 06 16:46:52.347023 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-773ac70e-d760-431c-8d25-0f10a486668a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:52.348138 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-773ac70e-d760-431c-8d25-0f10a486668a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:52.354793 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-773ac70e-d760-431c-8d25-0f10a486668a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:52.355245 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-773ac70e-d760-431c-8d25-0f10a486668a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:52.356015 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-773ac70e-d760-431c-8d25-0f10a486668a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:52.356446 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-773ac70e-d760-431c-8d25-0f10a486668a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:52.392038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-773ac70e-d760-431c-8d25-0f10a486668a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051451 Apr 06 16:46:52.392485 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 588/1154] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:52 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:53.177759 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7bfc3ef8-adaf-4dd4-b462-578c19118431 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:53.178688 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7bfc3ef8-adaf-4dd4-b462-578c19118431 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:53.188902 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7bfc3ef8-adaf-4dd4-b462-578c19118431 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:53.189664 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7bfc3ef8-adaf-4dd4-b462-578c19118431 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:53.190734 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7bfc3ef8-adaf-4dd4-b462-578c19118431 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:53.191253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7bfc3ef8-adaf-4dd4-b462-578c19118431 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:53.220355 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7bfc3ef8-adaf-4dd4-b462-578c19118431 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047592 Apr 06 16:46:53.220952 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 567/1155] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:53 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:53.404210 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3d9bf71b-4847-4f14-8eac-b8e6c941782e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:53.405172 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3d9bf71b-4847-4f14-8eac-b8e6c941782e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:53.412553 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d9bf71b-4847-4f14-8eac-b8e6c941782e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:53.413042 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d9bf71b-4847-4f14-8eac-b8e6c941782e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:53.413838 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d9bf71b-4847-4f14-8eac-b8e6c941782e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:53.414268 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d9bf71b-4847-4f14-8eac-b8e6c941782e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:53.444053 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3d9bf71b-4847-4f14-8eac-b8e6c941782e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043773 Apr 06 16:46:53.444533 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 589/1156] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:53 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:54.234758 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-17e3eda3-2d88-4180-9d5b-8b4d9a644341 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:54.236074 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-17e3eda3-2d88-4180-9d5b-8b4d9a644341 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:54.244456 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17e3eda3-2d88-4180-9d5b-8b4d9a644341 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:54.244942 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17e3eda3-2d88-4180-9d5b-8b4d9a644341 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:54.245717 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17e3eda3-2d88-4180-9d5b-8b4d9a644341 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:54.246147 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17e3eda3-2d88-4180-9d5b-8b4d9a644341 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:54.275588 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-17e3eda3-2d88-4180-9d5b-8b4d9a644341 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047252 Apr 06 16:46:54.276148 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 568/1157] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:54 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:54.456279 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eccc498f-7a24-4e05-b9b2-99a8fbbdf76a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:54.457215 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eccc498f-7a24-4e05-b9b2-99a8fbbdf76a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:54.463766 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eccc498f-7a24-4e05-b9b2-99a8fbbdf76a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:54.464210 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eccc498f-7a24-4e05-b9b2-99a8fbbdf76a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:54.465003 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eccc498f-7a24-4e05-b9b2-99a8fbbdf76a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:54.465431 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eccc498f-7a24-4e05-b9b2-99a8fbbdf76a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:54.494513 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eccc498f-7a24-4e05-b9b2-99a8fbbdf76a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042309 Apr 06 16:46:54.495078 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 590/1158] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:54 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:55.288152 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b29bddbe-327d-4e45-b6d3-beda1021303b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:55.289086 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b29bddbe-327d-4e45-b6d3-beda1021303b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:55.295896 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b29bddbe-327d-4e45-b6d3-beda1021303b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:55.296347 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b29bddbe-327d-4e45-b6d3-beda1021303b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:55.297161 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b29bddbe-327d-4e45-b6d3-beda1021303b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:55.297595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b29bddbe-327d-4e45-b6d3-beda1021303b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:55.329594 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b29bddbe-327d-4e45-b6d3-beda1021303b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045577 Apr 06 16:46:55.330588 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 569/1159] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:55 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:55.510808 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ccb2206b-af47-4b53-bf0c-d3de58ef4af2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:55.512321 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ccb2206b-af47-4b53-bf0c-d3de58ef4af2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:55.522030 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccb2206b-af47-4b53-bf0c-d3de58ef4af2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:55.522968 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccb2206b-af47-4b53-bf0c-d3de58ef4af2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:55.523825 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccb2206b-af47-4b53-bf0c-d3de58ef4af2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:55.524255 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccb2206b-af47-4b53-bf0c-d3de58ef4af2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:55.552377 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ccb2206b-af47-4b53-bf0c-d3de58ef4af2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048534 Apr 06 16:46:55.552885 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 591/1160] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:55 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:56.345062 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-62a014f7-16dc-460d-aaf3-7594087f5c1b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:56.346255 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-62a014f7-16dc-460d-aaf3-7594087f5c1b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:56.353925 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62a014f7-16dc-460d-aaf3-7594087f5c1b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:56.354378 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62a014f7-16dc-460d-aaf3-7594087f5c1b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:56.355147 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62a014f7-16dc-460d-aaf3-7594087f5c1b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:56.355572 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62a014f7-16dc-460d-aaf3-7594087f5c1b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:56.386031 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-62a014f7-16dc-460d-aaf3-7594087f5c1b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047330 Apr 06 16:46:56.386862 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 570/1161] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:56 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:56.566186 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9f37b90a-d572-4a4e-8435-6a053c16ba53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:56.567565 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9f37b90a-d572-4a4e-8435-6a053c16ba53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:56.576355 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f37b90a-d572-4a4e-8435-6a053c16ba53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:56.577149 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f37b90a-d572-4a4e-8435-6a053c16ba53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:56.578405 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f37b90a-d572-4a4e-8435-6a053c16ba53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:56.579127 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f37b90a-d572-4a4e-8435-6a053c16ba53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:56.611949 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9f37b90a-d572-4a4e-8435-6a053c16ba53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051511 Apr 06 16:46:56.612817 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 592/1162] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:56 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:57.398355 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dafe4f9d-30ff-4c95-817c-55ce20d87550 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:57.399269 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dafe4f9d-30ff-4c95-817c-55ce20d87550 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:57.406289 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dafe4f9d-30ff-4c95-817c-55ce20d87550 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:57.406734 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dafe4f9d-30ff-4c95-817c-55ce20d87550 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:57.407489 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dafe4f9d-30ff-4c95-817c-55ce20d87550 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:57.407915 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dafe4f9d-30ff-4c95-817c-55ce20d87550 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:57.444871 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dafe4f9d-30ff-4c95-817c-55ce20d87550 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050537 Apr 06 16:46:57.445402 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 571/1163] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:57 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:57.627672 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c8c548d9-58af-4e71-b979-9d7bf48c9e4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:57.629204 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c8c548d9-58af-4e71-b979-9d7bf48c9e4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:57.638056 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8c548d9-58af-4e71-b979-9d7bf48c9e4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:57.638487 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8c548d9-58af-4e71-b979-9d7bf48c9e4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:57.639266 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8c548d9-58af-4e71-b979-9d7bf48c9e4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:57.639672 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8c548d9-58af-4e71-b979-9d7bf48c9e4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:57.668095 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c8c548d9-58af-4e71-b979-9d7bf48c9e4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047027 Apr 06 16:46:57.668630 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 593/1164] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:57 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:58.458453 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a0e0d829-a101-4434-ad3d-259f3a92a844 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:58.459403 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a0e0d829-a101-4434-ad3d-259f3a92a844 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:58.467011 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0e0d829-a101-4434-ad3d-259f3a92a844 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:58.467507 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0e0d829-a101-4434-ad3d-259f3a92a844 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:58.468325 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0e0d829-a101-4434-ad3d-259f3a92a844 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:58.468851 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0e0d829-a101-4434-ad3d-259f3a92a844 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:58.498409 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a0e0d829-a101-4434-ad3d-259f3a92a844 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044410 Apr 06 16:46:58.498961 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 572/1165] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:58 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:58.680148 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ed858d17-1a1d-4c04-b5a0-e833914b50cd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:58.681163 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ed858d17-1a1d-4c04-b5a0-e833914b50cd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:58.687893 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed858d17-1a1d-4c04-b5a0-e833914b50cd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:58.688341 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed858d17-1a1d-4c04-b5a0-e833914b50cd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:58.689152 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed858d17-1a1d-4c04-b5a0-e833914b50cd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:58.689583 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed858d17-1a1d-4c04-b5a0-e833914b50cd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:58.726407 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ed858d17-1a1d-4c04-b5a0-e833914b50cd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050352 Apr 06 16:46:58.726961 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 594/1166] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:58 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:46:59.513140 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b4b93450-23fe-42a7-9760-2586e4f99080 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:59.514233 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b4b93450-23fe-42a7-9760-2586e4f99080 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:59.523583 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4b93450-23fe-42a7-9760-2586e4f99080 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:59.524161 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4b93450-23fe-42a7-9760-2586e4f99080 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:59.525094 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4b93450-23fe-42a7-9760-2586e4f99080 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:59.525600 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4b93450-23fe-42a7-9760-2586e4f99080 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:59.561117 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b4b93450-23fe-42a7-9760-2586e4f99080 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053813 Apr 06 16:46:59.561674 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 573/1167] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:46:59 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:46:59.741560 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0eca04bc-66c0-4aa5-b74d-8a5b262fd8f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:46:59.742655 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0eca04bc-66c0-4aa5-b74d-8a5b262fd8f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:46:59.750459 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0eca04bc-66c0-4aa5-b74d-8a5b262fd8f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:59.750906 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0eca04bc-66c0-4aa5-b74d-8a5b262fd8f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:59.751669 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0eca04bc-66c0-4aa5-b74d-8a5b262fd8f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:46:59.752098 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0eca04bc-66c0-4aa5-b74d-8a5b262fd8f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:46:59.782256 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0eca04bc-66c0-4aa5-b74d-8a5b262fd8f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046863 Apr 06 16:46:59.782729 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 595/1168] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:46:59 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:00.577497 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-11f309a5-3dcf-4886-9c6f-9954f0639ce4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:00.578343 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-11f309a5-3dcf-4886-9c6f-9954f0639ce4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:00.585247 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11f309a5-3dcf-4886-9c6f-9954f0639ce4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:00.585701 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11f309a5-3dcf-4886-9c6f-9954f0639ce4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:00.586466 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11f309a5-3dcf-4886-9c6f-9954f0639ce4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:00.586902 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11f309a5-3dcf-4886-9c6f-9954f0639ce4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:00.617659 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-11f309a5-3dcf-4886-9c6f-9954f0639ce4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045034 Apr 06 16:47:00.618212 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 574/1169] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:00 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:00.796966 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8c7befe7-e4fb-430f-8aab-3eb5a38e9e5b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:00.798619 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8c7befe7-e4fb-430f-8aab-3eb5a38e9e5b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:00.805618 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c7befe7-e4fb-430f-8aab-3eb5a38e9e5b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:00.806062 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c7befe7-e4fb-430f-8aab-3eb5a38e9e5b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:00.806853 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c7befe7-e4fb-430f-8aab-3eb5a38e9e5b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:00.807279 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c7befe7-e4fb-430f-8aab-3eb5a38e9e5b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:00.837367 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8c7befe7-e4fb-430f-8aab-3eb5a38e9e5b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044733 Apr 06 16:47:00.837832 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 596/1170] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:00 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:01.633425 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-97d36b4d-2a3c-48a2-bf02-aa7bbd5437f6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:01.634625 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-97d36b4d-2a3c-48a2-bf02-aa7bbd5437f6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:01.644348 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97d36b4d-2a3c-48a2-bf02-aa7bbd5437f6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:01.644978 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97d36b4d-2a3c-48a2-bf02-aa7bbd5437f6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:01.646089 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97d36b4d-2a3c-48a2-bf02-aa7bbd5437f6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:01.646597 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97d36b4d-2a3c-48a2-bf02-aa7bbd5437f6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:01.678839 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-97d36b4d-2a3c-48a2-bf02-aa7bbd5437f6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051854 Apr 06 16:47:01.679410 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 575/1171] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:01 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:01.850397 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8b33ea8b-7ebe-4bd2-97e7-7f640fa61c94 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:01.851342 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8b33ea8b-7ebe-4bd2-97e7-7f640fa61c94 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:01.857735 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b33ea8b-7ebe-4bd2-97e7-7f640fa61c94 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:01.858174 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b33ea8b-7ebe-4bd2-97e7-7f640fa61c94 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:01.858951 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b33ea8b-7ebe-4bd2-97e7-7f640fa61c94 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:01.859350 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b33ea8b-7ebe-4bd2-97e7-7f640fa61c94 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:01.891839 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8b33ea8b-7ebe-4bd2-97e7-7f640fa61c94 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045330 Apr 06 16:47:01.892285 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 597/1172] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:01 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:02.692048 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0d185b8d-9a58-4173-9a06-3a7f866a4842 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:02.693121 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0d185b8d-9a58-4173-9a06-3a7f866a4842 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:02.700039 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d185b8d-9a58-4173-9a06-3a7f866a4842 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:02.700492 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d185b8d-9a58-4173-9a06-3a7f866a4842 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:02.701313 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d185b8d-9a58-4173-9a06-3a7f866a4842 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:02.701743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d185b8d-9a58-4173-9a06-3a7f866a4842 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:02.735102 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0d185b8d-9a58-4173-9a06-3a7f866a4842 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046932 Apr 06 16:47:02.735686 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 576/1173] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:02 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:02.903262 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e2eef6e5-b91d-4f26-a189-e0416d3e18a7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:02.904294 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e2eef6e5-b91d-4f26-a189-e0416d3e18a7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:02.912187 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2eef6e5-b91d-4f26-a189-e0416d3e18a7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:02.912654 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2eef6e5-b91d-4f26-a189-e0416d3e18a7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:02.913958 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2eef6e5-b91d-4f26-a189-e0416d3e18a7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:02.914541 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2eef6e5-b91d-4f26-a189-e0416d3e18a7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:02.945557 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e2eef6e5-b91d-4f26-a189-e0416d3e18a7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046413 Apr 06 16:47:02.946142 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 598/1174] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:02 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:03.750341 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f267fd13-05c8-4da4-a861-3fb92583a8c4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:03.751520 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f267fd13-05c8-4da4-a861-3fb92583a8c4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:03.759057 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f267fd13-05c8-4da4-a861-3fb92583a8c4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:03.759537 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f267fd13-05c8-4da4-a861-3fb92583a8c4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:03.760309 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f267fd13-05c8-4da4-a861-3fb92583a8c4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:03.760776 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f267fd13-05c8-4da4-a861-3fb92583a8c4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:03.790166 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f267fd13-05c8-4da4-a861-3fb92583a8c4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044893 Apr 06 16:47:03.790724 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 577/1175] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:03 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:03.960548 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-18c7742b-1b38-4ef3-be85-3fed3717b303 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:03.961729 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-18c7742b-1b38-4ef3-be85-3fed3717b303 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:03.969984 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18c7742b-1b38-4ef3-be85-3fed3717b303 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:03.970734 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18c7742b-1b38-4ef3-be85-3fed3717b303 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:03.972006 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18c7742b-1b38-4ef3-be85-3fed3717b303 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:03.972630 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18c7742b-1b38-4ef3-be85-3fed3717b303 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:03.988939 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 16:47:03.989175 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 16:47:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments (ip 10.222.0.64) !!! Apr 06 16:47:04.011831 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-18c7742b-1b38-4ef3-be85-3fed3717b303 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056841 Apr 06 16:47:04.013062 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 599/1176] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:03 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:04.802474 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bf8a58cb-7c8c-46f9-9a28-80d40636d4ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:04.803395 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bf8a58cb-7c8c-46f9-9a28-80d40636d4ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:04.810819 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf8a58cb-7c8c-46f9-9a28-80d40636d4ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:04.811265 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf8a58cb-7c8c-46f9-9a28-80d40636d4ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:04.812033 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf8a58cb-7c8c-46f9-9a28-80d40636d4ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:04.812451 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf8a58cb-7c8c-46f9-9a28-80d40636d4ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:04.843773 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bf8a58cb-7c8c-46f9-9a28-80d40636d4ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045366 Apr 06 16:47:04.844320 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 578/1177] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:04 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:05.026661 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fa2236fb-827a-4a96-b0ef-ca4e1c64a1fe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:05.027592 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fa2236fb-827a-4a96-b0ef-ca4e1c64a1fe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:05.034142 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa2236fb-827a-4a96-b0ef-ca4e1c64a1fe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:05.034591 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa2236fb-827a-4a96-b0ef-ca4e1c64a1fe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:05.035350 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa2236fb-827a-4a96-b0ef-ca4e1c64a1fe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:05.035778 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa2236fb-827a-4a96-b0ef-ca4e1c64a1fe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:05.066064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fa2236fb-827a-4a96-b0ef-ca4e1c64a1fe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043792 Apr 06 16:47:05.066431 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 600/1178] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:05 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:05.857948 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cb808369-ad37-4985-a01e-4d52661a920f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:05.858807 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cb808369-ad37-4985-a01e-4d52661a920f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:05.865987 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb808369-ad37-4985-a01e-4d52661a920f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:05.866524 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb808369-ad37-4985-a01e-4d52661a920f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:05.867282 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb808369-ad37-4985-a01e-4d52661a920f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:05.867741 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb808369-ad37-4985-a01e-4d52661a920f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:05.897638 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cb808369-ad37-4985-a01e-4d52661a920f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044751 Apr 06 16:47:05.898332 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 579/1179] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:05 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:06.078554 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1baf0ac8-b8df-461d-8194-11a71dd46ce3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:06.079612 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1baf0ac8-b8df-461d-8194-11a71dd46ce3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:06.085792 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1baf0ac8-b8df-461d-8194-11a71dd46ce3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:06.086257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1baf0ac8-b8df-461d-8194-11a71dd46ce3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:06.087017 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1baf0ac8-b8df-461d-8194-11a71dd46ce3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:06.087448 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1baf0ac8-b8df-461d-8194-11a71dd46ce3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:06.124527 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1baf0ac8-b8df-461d-8194-11a71dd46ce3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049881 Apr 06 16:47:06.125109 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 601/1180] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:06 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:06.913615 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e6678dae-0e7f-4807-a8aa-61b747411506 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:06.914562 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e6678dae-0e7f-4807-a8aa-61b747411506 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:06.921427 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6678dae-0e7f-4807-a8aa-61b747411506 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:06.921897 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6678dae-0e7f-4807-a8aa-61b747411506 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:06.922653 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6678dae-0e7f-4807-a8aa-61b747411506 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:06.923088 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6678dae-0e7f-4807-a8aa-61b747411506 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:06.952606 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e6678dae-0e7f-4807-a8aa-61b747411506 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045374 Apr 06 16:47:06.953222 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 580/1181] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:06 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:07.141105 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6648eb31-2939-4e88-8940-7b648162dbd9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:07.142510 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6648eb31-2939-4e88-8940-7b648162dbd9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:07.151013 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6648eb31-2939-4e88-8940-7b648162dbd9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:07.151727 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6648eb31-2939-4e88-8940-7b648162dbd9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:07.152502 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6648eb31-2939-4e88-8940-7b648162dbd9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:07.152972 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6648eb31-2939-4e88-8940-7b648162dbd9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:07.181862 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6648eb31-2939-4e88-8940-7b648162dbd9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046503 Apr 06 16:47:07.182398 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 602/1182] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:07 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:07.967622 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-64415869-b813-4838-b455-615e7fe31c8c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:07.968575 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-64415869-b813-4838-b455-615e7fe31c8c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:07.975671 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64415869-b813-4838-b455-615e7fe31c8c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:07.976126 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64415869-b813-4838-b455-615e7fe31c8c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:07.976945 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64415869-b813-4838-b455-615e7fe31c8c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:07.977384 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64415869-b813-4838-b455-615e7fe31c8c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:08.009151 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-64415869-b813-4838-b455-615e7fe31c8c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046852 Apr 06 16:47:08.009721 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 581/1183] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:07 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:08.197491 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a46a0639-7509-43ac-bd01-a1eb704541f1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:08.198604 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a46a0639-7509-43ac-bd01-a1eb704541f1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:08.206324 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a46a0639-7509-43ac-bd01-a1eb704541f1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:08.206773 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a46a0639-7509-43ac-bd01-a1eb704541f1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:08.207538 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a46a0639-7509-43ac-bd01-a1eb704541f1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:08.207970 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a46a0639-7509-43ac-bd01-a1eb704541f1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:08.237960 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a46a0639-7509-43ac-bd01-a1eb704541f1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045754 Apr 06 16:47:08.238446 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 603/1184] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:08 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:09.023093 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1cf6fa70-8795-46c3-a8f5-8797dec94fde tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:09.023998 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1cf6fa70-8795-46c3-a8f5-8797dec94fde tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:09.031554 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cf6fa70-8795-46c3-a8f5-8797dec94fde tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:09.032135 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cf6fa70-8795-46c3-a8f5-8797dec94fde tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:09.033118 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cf6fa70-8795-46c3-a8f5-8797dec94fde tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:09.033619 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cf6fa70-8795-46c3-a8f5-8797dec94fde tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:09.066145 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1cf6fa70-8795-46c3-a8f5-8797dec94fde tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047664 Apr 06 16:47:09.066724 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 582/1185] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:09 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:09.252842 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ca00a99b-cef9-4ef8-ba2a-6b806dab07e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:09.253797 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ca00a99b-cef9-4ef8-ba2a-6b806dab07e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:09.260412 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca00a99b-cef9-4ef8-ba2a-6b806dab07e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:09.260889 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca00a99b-cef9-4ef8-ba2a-6b806dab07e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:09.261652 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca00a99b-cef9-4ef8-ba2a-6b806dab07e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:09.262081 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca00a99b-cef9-4ef8-ba2a-6b806dab07e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:09.292340 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ca00a99b-cef9-4ef8-ba2a-6b806dab07e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045283 Apr 06 16:47:09.293139 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 604/1186] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:09 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:10.081433 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-42306a32-6696-452f-bc98-d3b6bbace088 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:10.082488 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-42306a32-6696-452f-bc98-d3b6bbace088 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:10.092033 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42306a32-6696-452f-bc98-d3b6bbace088 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:10.092736 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42306a32-6696-452f-bc98-d3b6bbace088 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:10.093982 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42306a32-6696-452f-bc98-d3b6bbace088 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:10.094411 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42306a32-6696-452f-bc98-d3b6bbace088 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:10.125883 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-42306a32-6696-452f-bc98-d3b6bbace088 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050284 Apr 06 16:47:10.126447 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 583/1187] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:10 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 06 16:47:10.307492 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0a7fdd0b-caee-4b14-997b-70494e75f5fe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:10.308596 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0a7fdd0b-caee-4b14-997b-70494e75f5fe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:10.317187 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a7fdd0b-caee-4b14-997b-70494e75f5fe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:10.317658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a7fdd0b-caee-4b14-997b-70494e75f5fe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:10.318450 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a7fdd0b-caee-4b14-997b-70494e75f5fe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:10.318871 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a7fdd0b-caee-4b14-997b-70494e75f5fe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:10.349473 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0a7fdd0b-caee-4b14-997b-70494e75f5fe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047940 Apr 06 16:47:10.349933 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 605/1188] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:10 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:11.139022 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9f562fd4-96ae-4dd6-9e86-6107bbdcea00 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:11.139969 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9f562fd4-96ae-4dd6-9e86-6107bbdcea00 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:11.146745 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f562fd4-96ae-4dd6-9e86-6107bbdcea00 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:11.147212 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f562fd4-96ae-4dd6-9e86-6107bbdcea00 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:11.147985 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f562fd4-96ae-4dd6-9e86-6107bbdcea00 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:11.148378 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f562fd4-96ae-4dd6-9e86-6107bbdcea00 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:11.178597 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9f562fd4-96ae-4dd6-9e86-6107bbdcea00 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043658 Apr 06 16:47:11.179406 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 584/1189] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:11 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:11.362817 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4f3e4866-3735-4b35-89a6-cee0efaa0a55 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:11.363798 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4f3e4866-3735-4b35-89a6-cee0efaa0a55 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:11.370466 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f3e4866-3735-4b35-89a6-cee0efaa0a55 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:11.370954 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f3e4866-3735-4b35-89a6-cee0efaa0a55 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:11.371828 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f3e4866-3735-4b35-89a6-cee0efaa0a55 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:11.372295 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f3e4866-3735-4b35-89a6-cee0efaa0a55 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:11.403306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4f3e4866-3735-4b35-89a6-cee0efaa0a55 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045305 Apr 06 16:47:11.403783 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 606/1190] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:11 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:12.191677 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c8a6d5f0-e392-43a5-8525-71d6ad1ba421 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:12.192608 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c8a6d5f0-e392-43a5-8525-71d6ad1ba421 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:12.198773 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8a6d5f0-e392-43a5-8525-71d6ad1ba421 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:12.199225 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8a6d5f0-e392-43a5-8525-71d6ad1ba421 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:12.200168 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8a6d5f0-e392-43a5-8525-71d6ad1ba421 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:12.200168 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8a6d5f0-e392-43a5-8525-71d6ad1ba421 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:12.229785 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c8a6d5f0-e392-43a5-8525-71d6ad1ba421 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042686 Apr 06 16:47:12.230346 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 585/1191] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:12 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:12.415198 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dc044595-892b-4a10-bfac-4042ff6f5e83 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:12.416140 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dc044595-892b-4a10-bfac-4042ff6f5e83 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:12.422576 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc044595-892b-4a10-bfac-4042ff6f5e83 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:12.423018 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc044595-892b-4a10-bfac-4042ff6f5e83 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:12.423781 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc044595-892b-4a10-bfac-4042ff6f5e83 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:12.424206 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc044595-892b-4a10-bfac-4042ff6f5e83 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:12.453487 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dc044595-892b-4a10-bfac-4042ff6f5e83 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042225 Apr 06 16:47:12.453951 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 607/1192] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:12 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:12.907361 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 16:47:12.907550 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 16:47:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 16:47:13.241872 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0bf3f7c2-c03d-47c3-946c-82fe7064f667 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:13.242704 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0bf3f7c2-c03d-47c3-946c-82fe7064f667 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:13.249528 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0bf3f7c2-c03d-47c3-946c-82fe7064f667 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:13.249962 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0bf3f7c2-c03d-47c3-946c-82fe7064f667 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:13.250739 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0bf3f7c2-c03d-47c3-946c-82fe7064f667 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:13.251169 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0bf3f7c2-c03d-47c3-946c-82fe7064f667 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:13.281245 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0bf3f7c2-c03d-47c3-946c-82fe7064f667 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044209 Apr 06 16:47:13.281869 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 586/1193] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:13 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:13.466133 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cbdae19d-4849-4c7f-bf46-8b82fa83e6c2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:13.467048 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cbdae19d-4849-4c7f-bf46-8b82fa83e6c2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:13.473859 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbdae19d-4849-4c7f-bf46-8b82fa83e6c2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:13.474310 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbdae19d-4849-4c7f-bf46-8b82fa83e6c2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:13.475091 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbdae19d-4849-4c7f-bf46-8b82fa83e6c2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:13.475521 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbdae19d-4849-4c7f-bf46-8b82fa83e6c2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:13.506346 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cbdae19d-4849-4c7f-bf46-8b82fa83e6c2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044182 Apr 06 16:47:13.506828 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 608/1194] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:13 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:14.293719 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-18491f60-6d53-42bf-b042-f17d563198bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:14.294509 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-18491f60-6d53-42bf-b042-f17d563198bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:14.306570 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18491f60-6d53-42bf-b042-f17d563198bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:14.307014 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18491f60-6d53-42bf-b042-f17d563198bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:14.307790 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18491f60-6d53-42bf-b042-f17d563198bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:14.308236 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18491f60-6d53-42bf-b042-f17d563198bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:14.350932 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-18491f60-6d53-42bf-b042-f17d563198bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061277 Apr 06 16:47:14.351739 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 587/1195] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:14 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:14.518956 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d23c1100-3188-4198-87d1-6d966f5d80c0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:14.520964 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d23c1100-3188-4198-87d1-6d966f5d80c0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:14.527532 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d23c1100-3188-4198-87d1-6d966f5d80c0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:14.528007 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d23c1100-3188-4198-87d1-6d966f5d80c0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:14.528818 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d23c1100-3188-4198-87d1-6d966f5d80c0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:14.529256 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d23c1100-3188-4198-87d1-6d966f5d80c0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:14.562212 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d23c1100-3188-4198-87d1-6d966f5d80c0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047530 Apr 06 16:47:14.562671 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 609/1196] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:14 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:15.363868 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5c78854d-da35-41f5-bc73-7da7042f354f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:15.364828 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5c78854d-da35-41f5-bc73-7da7042f354f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:15.371631 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c78854d-da35-41f5-bc73-7da7042f354f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:15.372084 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c78854d-da35-41f5-bc73-7da7042f354f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:15.372898 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c78854d-da35-41f5-bc73-7da7042f354f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:15.373322 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c78854d-da35-41f5-bc73-7da7042f354f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:15.405417 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5c78854d-da35-41f5-bc73-7da7042f354f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045966 Apr 06 16:47:15.405975 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 588/1197] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:15 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:15.574510 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7d6c1bc0-e9d9-4534-8356-4b69745dbaa2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:15.575469 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7d6c1bc0-e9d9-4534-8356-4b69745dbaa2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:15.581966 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d6c1bc0-e9d9-4534-8356-4b69745dbaa2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:15.582352 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d6c1bc0-e9d9-4534-8356-4b69745dbaa2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:15.583232 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d6c1bc0-e9d9-4534-8356-4b69745dbaa2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:15.583667 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d6c1bc0-e9d9-4534-8356-4b69745dbaa2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:15.775326 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7d6c1bc0-e9d9-4534-8356-4b69745dbaa2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.204823 Apr 06 16:47:15.775885 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 610/1198] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:15 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:16.417756 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2892e6b1-a3a5-443d-819c-a6861566ac00 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:16.418724 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2892e6b1-a3a5-443d-819c-a6861566ac00 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:16.425911 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2892e6b1-a3a5-443d-819c-a6861566ac00 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:16.426362 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2892e6b1-a3a5-443d-819c-a6861566ac00 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:16.427152 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2892e6b1-a3a5-443d-819c-a6861566ac00 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:16.427579 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2892e6b1-a3a5-443d-819c-a6861566ac00 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:16.457026 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2892e6b1-a3a5-443d-819c-a6861566ac00 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043249 Apr 06 16:47:16.457583 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 589/1199] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:16 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:16.787878 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-97a24009-ffe7-4c57-9656-7a5979dfeaac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:16.788840 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-97a24009-ffe7-4c57-9656-7a5979dfeaac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:16.795368 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97a24009-ffe7-4c57-9656-7a5979dfeaac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:16.795903 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97a24009-ffe7-4c57-9656-7a5979dfeaac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:16.796578 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97a24009-ffe7-4c57-9656-7a5979dfeaac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:16.797043 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97a24009-ffe7-4c57-9656-7a5979dfeaac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:16.826388 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-97a24009-ffe7-4c57-9656-7a5979dfeaac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042951 Apr 06 16:47:16.827048 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 611/1200] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:16 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:17.468663 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5acc051c-fb65-442f-8764-389d0ddc2ad2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:17.469699 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5acc051c-fb65-442f-8764-389d0ddc2ad2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:17.476800 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5acc051c-fb65-442f-8764-389d0ddc2ad2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:17.477275 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5acc051c-fb65-442f-8764-389d0ddc2ad2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:17.478045 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5acc051c-fb65-442f-8764-389d0ddc2ad2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:17.478483 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5acc051c-fb65-442f-8764-389d0ddc2ad2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:17.508376 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5acc051c-fb65-442f-8764-389d0ddc2ad2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043730 Apr 06 16:47:17.508973 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 590/1201] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:17 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:17.839022 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-17ff5ca6-b67b-42f0-8a52-d7cac1fd7c12 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:17.839857 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-17ff5ca6-b67b-42f0-8a52-d7cac1fd7c12 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:17.846395 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17ff5ca6-b67b-42f0-8a52-d7cac1fd7c12 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:17.847091 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17ff5ca6-b67b-42f0-8a52-d7cac1fd7c12 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:17.847810 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17ff5ca6-b67b-42f0-8a52-d7cac1fd7c12 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:17.848239 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17ff5ca6-b67b-42f0-8a52-d7cac1fd7c12 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:17.878536 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-17ff5ca6-b67b-42f0-8a52-d7cac1fd7c12 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043602 Apr 06 16:47:17.879211 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 612/1202] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:17 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:18.520467 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d7ff0ecf-f53e-487d-9291-75e6f548b59f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:18.521454 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d7ff0ecf-f53e-487d-9291-75e6f548b59f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:18.528263 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7ff0ecf-f53e-487d-9291-75e6f548b59f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:18.528735 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7ff0ecf-f53e-487d-9291-75e6f548b59f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:18.529518 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7ff0ecf-f53e-487d-9291-75e6f548b59f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:18.529947 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7ff0ecf-f53e-487d-9291-75e6f548b59f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:18.560442 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d7ff0ecf-f53e-487d-9291-75e6f548b59f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044478 Apr 06 16:47:18.561040 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 591/1203] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:18 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:18.896418 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a027fe5d-2105-4596-b1d9-1a1eacf6dfcd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:18.897619 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a027fe5d-2105-4596-b1d9-1a1eacf6dfcd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:18.903902 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a027fe5d-2105-4596-b1d9-1a1eacf6dfcd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:18.904341 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a027fe5d-2105-4596-b1d9-1a1eacf6dfcd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:18.905131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a027fe5d-2105-4596-b1d9-1a1eacf6dfcd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:18.905549 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a027fe5d-2105-4596-b1d9-1a1eacf6dfcd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:18.935756 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a027fe5d-2105-4596-b1d9-1a1eacf6dfcd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048548 Apr 06 16:47:18.936336 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 613/1204] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:18 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:19.573135 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a2b91bd5-4981-4ef7-b898-c1b2ccf41818 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:19.574042 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a2b91bd5-4981-4ef7-b898-c1b2ccf41818 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:19.580857 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2b91bd5-4981-4ef7-b898-c1b2ccf41818 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:19.581433 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2b91bd5-4981-4ef7-b898-c1b2ccf41818 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:19.582387 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2b91bd5-4981-4ef7-b898-c1b2ccf41818 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:19.582825 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2b91bd5-4981-4ef7-b898-c1b2ccf41818 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:19.613486 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a2b91bd5-4981-4ef7-b898-c1b2ccf41818 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044571 Apr 06 16:47:19.614140 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 592/1205] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:19 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:19.948297 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-122ea4e4-2966-4738-8ecd-ea71769a57f9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:19.949240 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-122ea4e4-2966-4738-8ecd-ea71769a57f9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:19.955548 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-122ea4e4-2966-4738-8ecd-ea71769a57f9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:19.956084 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-122ea4e4-2966-4738-8ecd-ea71769a57f9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:19.956900 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-122ea4e4-2966-4738-8ecd-ea71769a57f9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:19.957332 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-122ea4e4-2966-4738-8ecd-ea71769a57f9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:19.994540 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-122ea4e4-2966-4738-8ecd-ea71769a57f9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050692 Apr 06 16:47:19.995104 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 614/1206] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:19 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:20.626101 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0d1719ef-e43e-45d7-aa2f-c19d8a765a6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:20.627021 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0d1719ef-e43e-45d7-aa2f-c19d8a765a6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:20.634030 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d1719ef-e43e-45d7-aa2f-c19d8a765a6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:20.634475 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d1719ef-e43e-45d7-aa2f-c19d8a765a6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:20.635371 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d1719ef-e43e-45d7-aa2f-c19d8a765a6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:20.635797 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d1719ef-e43e-45d7-aa2f-c19d8a765a6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:20.666425 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0d1719ef-e43e-45d7-aa2f-c19d8a765a6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044329 Apr 06 16:47:20.666965 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 593/1207] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:20 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 06 16:47:21.007143 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-46ac90ba-5e48-4fa2-a805-fce6aa9f5169 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:21.007979 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-46ac90ba-5e48-4fa2-a805-fce6aa9f5169 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:21.014502 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46ac90ba-5e48-4fa2-a805-fce6aa9f5169 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:21.014940 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46ac90ba-5e48-4fa2-a805-fce6aa9f5169 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:21.015708 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46ac90ba-5e48-4fa2-a805-fce6aa9f5169 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:21.016131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46ac90ba-5e48-4fa2-a805-fce6aa9f5169 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:21.046757 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-46ac90ba-5e48-4fa2-a805-fce6aa9f5169 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044113 Apr 06 16:47:21.047312 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 615/1208] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:21 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:21.679092 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f55d5da8-e522-4dae-b500-ba91732033f8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:21.680036 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f55d5da8-e522-4dae-b500-ba91732033f8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:21.686851 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f55d5da8-e522-4dae-b500-ba91732033f8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:21.687272 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f55d5da8-e522-4dae-b500-ba91732033f8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:21.688060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f55d5da8-e522-4dae-b500-ba91732033f8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:21.688481 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f55d5da8-e522-4dae-b500-ba91732033f8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:21.718247 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f55d5da8-e522-4dae-b500-ba91732033f8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043238 Apr 06 16:47:21.718788 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 594/1209] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:21 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:22.058815 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e29ed9ec-8e9a-4d32-9acf-c0d6cf2757e2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:22.059712 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e29ed9ec-8e9a-4d32-9acf-c0d6cf2757e2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:22.068259 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e29ed9ec-8e9a-4d32-9acf-c0d6cf2757e2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:22.068723 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e29ed9ec-8e9a-4d32-9acf-c0d6cf2757e2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:22.071029 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e29ed9ec-8e9a-4d32-9acf-c0d6cf2757e2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:22.071471 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e29ed9ec-8e9a-4d32-9acf-c0d6cf2757e2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:22.102333 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e29ed9ec-8e9a-4d32-9acf-c0d6cf2757e2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047690 Apr 06 16:47:22.102905 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 616/1210] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:22 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:22.730802 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-41c6f82d-461c-469b-9b6f-bb7e4383bb55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:22.731713 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-41c6f82d-461c-469b-9b6f-bb7e4383bb55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:22.739139 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41c6f82d-461c-469b-9b6f-bb7e4383bb55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:22.739583 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41c6f82d-461c-469b-9b6f-bb7e4383bb55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:22.740377 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41c6f82d-461c-469b-9b6f-bb7e4383bb55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:22.740829 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41c6f82d-461c-469b-9b6f-bb7e4383bb55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:22.770858 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-41c6f82d-461c-469b-9b6f-bb7e4383bb55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044112 Apr 06 16:47:22.771410 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 595/1211] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:22 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:23.115180 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d2577115-9eb6-4561-bab1-5400b35a2b79 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:23.115999 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d2577115-9eb6-4561-bab1-5400b35a2b79 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:23.122253 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2577115-9eb6-4561-bab1-5400b35a2b79 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:23.122675 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2577115-9eb6-4561-bab1-5400b35a2b79 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:23.123443 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2577115-9eb6-4561-bab1-5400b35a2b79 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:23.123872 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d2577115-9eb6-4561-bab1-5400b35a2b79 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:23.155529 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d2577115-9eb6-4561-bab1-5400b35a2b79 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045149 Apr 06 16:47:23.156099 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 617/1212] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:23 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:47:23.782619 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1e768a53-9629-425a-a73c-f8ddeba2e9be tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:23.783482 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1e768a53-9629-425a-a73c-f8ddeba2e9be tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:23.790424 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e768a53-9629-425a-a73c-f8ddeba2e9be tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:23.790878 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e768a53-9629-425a-a73c-f8ddeba2e9be tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:23.791639 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e768a53-9629-425a-a73c-f8ddeba2e9be tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:23.792097 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e768a53-9629-425a-a73c-f8ddeba2e9be tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:23.822206 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1e768a53-9629-425a-a73c-f8ddeba2e9be tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043719 Apr 06 16:47:23.822763 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 596/1213] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:23 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:24.167334 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7ff75c38-079f-4fc4-9d99-3c7d989b0da8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:24.168296 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7ff75c38-079f-4fc4-9d99-3c7d989b0da8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:24.174975 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ff75c38-079f-4fc4-9d99-3c7d989b0da8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:24.175456 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ff75c38-079f-4fc4-9d99-3c7d989b0da8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:24.176228 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ff75c38-079f-4fc4-9d99-3c7d989b0da8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:24.176656 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ff75c38-079f-4fc4-9d99-3c7d989b0da8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:24.206953 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7ff75c38-079f-4fc4-9d99-3c7d989b0da8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043595 Apr 06 16:47:24.207517 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 618/1214] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:24 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:24.835115 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7c5379da-ab96-445a-b3a3-c25a24833674 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:24.838152 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7c5379da-ab96-445a-b3a3-c25a24833674 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:24.842776 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c5379da-ab96-445a-b3a3-c25a24833674 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:24.843229 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c5379da-ab96-445a-b3a3-c25a24833674 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:24.844007 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c5379da-ab96-445a-b3a3-c25a24833674 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:24.844470 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c5379da-ab96-445a-b3a3-c25a24833674 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:24.874857 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7c5379da-ab96-445a-b3a3-c25a24833674 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044121 Apr 06 16:47:24.875430 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 597/1215] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:24 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:25.219181 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c94dc5f0-6adf-4cb4-aabc-aee83fdb4680 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:25.220121 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c94dc5f0-6adf-4cb4-aabc-aee83fdb4680 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:25.227026 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c94dc5f0-6adf-4cb4-aabc-aee83fdb4680 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:25.227476 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c94dc5f0-6adf-4cb4-aabc-aee83fdb4680 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:25.228257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c94dc5f0-6adf-4cb4-aabc-aee83fdb4680 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:25.228738 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c94dc5f0-6adf-4cb4-aabc-aee83fdb4680 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:25.259433 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c94dc5f0-6adf-4cb4-aabc-aee83fdb4680 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044199 Apr 06 16:47:25.260142 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 619/1216] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:25 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:25.886738 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-29d3bd36-ede4-4cae-9a88-214a5d266aeb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:25.887669 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-29d3bd36-ede4-4cae-9a88-214a5d266aeb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:25.894530 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29d3bd36-ede4-4cae-9a88-214a5d266aeb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:25.894978 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29d3bd36-ede4-4cae-9a88-214a5d266aeb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:25.895758 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29d3bd36-ede4-4cae-9a88-214a5d266aeb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:25.896190 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29d3bd36-ede4-4cae-9a88-214a5d266aeb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:25.926231 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-29d3bd36-ede4-4cae-9a88-214a5d266aeb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043465 Apr 06 16:47:25.926909 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 598/1217] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:25 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:26.272447 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dd8a974d-7635-44c2-906c-7aa6a72552dd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:26.273326 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dd8a974d-7635-44c2-906c-7aa6a72552dd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:26.279778 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd8a974d-7635-44c2-906c-7aa6a72552dd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:26.280222 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd8a974d-7635-44c2-906c-7aa6a72552dd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:26.281008 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd8a974d-7635-44c2-906c-7aa6a72552dd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:26.281438 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd8a974d-7635-44c2-906c-7aa6a72552dd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:26.311488 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dd8a974d-7635-44c2-906c-7aa6a72552dd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043623 Apr 06 16:47:26.312052 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 620/1218] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:26 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:26.938776 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-efd6df07-e4b0-41b2-bee3-2bb048607663 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:26.939664 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-efd6df07-e4b0-41b2-bee3-2bb048607663 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:26.946819 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efd6df07-e4b0-41b2-bee3-2bb048607663 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:26.947268 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efd6df07-e4b0-41b2-bee3-2bb048607663 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:26.948048 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efd6df07-e4b0-41b2-bee3-2bb048607663 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:26.948475 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efd6df07-e4b0-41b2-bee3-2bb048607663 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:26.980155 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-efd6df07-e4b0-41b2-bee3-2bb048607663 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045487 Apr 06 16:47:26.980731 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 599/1219] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:26 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:27.324798 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-468f2260-a0fd-4650-b208-615f0dea292d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:27.325638 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-468f2260-a0fd-4650-b208-615f0dea292d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:27.332868 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-468f2260-a0fd-4650-b208-615f0dea292d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:27.333311 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-468f2260-a0fd-4650-b208-615f0dea292d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:27.334137 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-468f2260-a0fd-4650-b208-615f0dea292d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:27.334539 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-468f2260-a0fd-4650-b208-615f0dea292d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:27.365496 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-468f2260-a0fd-4650-b208-615f0dea292d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045113 Apr 06 16:47:27.366092 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 621/1220] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:27 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:27.993032 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cf932113-9525-4420-ad3a-b75d60744eca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:27.994118 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cf932113-9525-4420-ad3a-b75d60744eca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:28.001247 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf932113-9525-4420-ad3a-b75d60744eca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:28.001896 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf932113-9525-4420-ad3a-b75d60744eca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:28.002784 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf932113-9525-4420-ad3a-b75d60744eca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:28.003244 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf932113-9525-4420-ad3a-b75d60744eca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:28.033217 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cf932113-9525-4420-ad3a-b75d60744eca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044702 Apr 06 16:47:28.034062 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 600/1221] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:27 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:28.378179 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4616900b-c7f6-4e1a-abf5-bae742a8dca9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:28.379198 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4616900b-c7f6-4e1a-abf5-bae742a8dca9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:28.385987 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4616900b-c7f6-4e1a-abf5-bae742a8dca9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:28.386435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4616900b-c7f6-4e1a-abf5-bae742a8dca9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:28.387197 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4616900b-c7f6-4e1a-abf5-bae742a8dca9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:28.387722 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4616900b-c7f6-4e1a-abf5-bae742a8dca9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:28.416538 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4616900b-c7f6-4e1a-abf5-bae742a8dca9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042492 Apr 06 16:47:28.417158 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 622/1222] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:28 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:29.046807 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9cc902c5-18c7-40d3-ae1f-71218bad160b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:29.047724 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9cc902c5-18c7-40d3-ae1f-71218bad160b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:29.054494 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9cc902c5-18c7-40d3-ae1f-71218bad160b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:29.054948 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9cc902c5-18c7-40d3-ae1f-71218bad160b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:29.055709 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9cc902c5-18c7-40d3-ae1f-71218bad160b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:29.056134 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9cc902c5-18c7-40d3-ae1f-71218bad160b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:29.086470 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9cc902c5-18c7-40d3-ae1f-71218bad160b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044114 Apr 06 16:47:29.086998 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 601/1223] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:29 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:29.429712 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-08659552-4236-427d-99d7-c095c7e3c256 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:29.430685 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-08659552-4236-427d-99d7-c095c7e3c256 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:29.437796 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08659552-4236-427d-99d7-c095c7e3c256 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:29.438239 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08659552-4236-427d-99d7-c095c7e3c256 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:29.439012 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08659552-4236-427d-99d7-c095c7e3c256 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:29.439443 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08659552-4236-427d-99d7-c095c7e3c256 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:29.469782 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-08659552-4236-427d-99d7-c095c7e3c256 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044420 Apr 06 16:47:29.470367 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 623/1224] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:29 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:30.099743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c8980536-ee6d-48b1-903c-f8960c188052 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:30.100581 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c8980536-ee6d-48b1-903c-f8960c188052 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:30.107619 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8980536-ee6d-48b1-903c-f8960c188052 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:30.108024 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8980536-ee6d-48b1-903c-f8960c188052 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:30.108961 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8980536-ee6d-48b1-903c-f8960c188052 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:30.109257 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8980536-ee6d-48b1-903c-f8960c188052 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:30.141225 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c8980536-ee6d-48b1-903c-f8960c188052 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046249 Apr 06 16:47:30.141729 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 602/1225] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:30 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:30.482160 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e5092d95-d801-4a67-aee9-7c687f0d5e0d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:30.483083 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e5092d95-d801-4a67-aee9-7c687f0d5e0d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:30.491049 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5092d95-d801-4a67-aee9-7c687f0d5e0d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:30.491475 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5092d95-d801-4a67-aee9-7c687f0d5e0d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:30.492181 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5092d95-d801-4a67-aee9-7c687f0d5e0d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:30.492717 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5092d95-d801-4a67-aee9-7c687f0d5e0d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:30.524467 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e5092d95-d801-4a67-aee9-7c687f0d5e0d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046232 Apr 06 16:47:30.525084 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 624/1226] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:30 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:31.156990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-74e98702-ae1d-44d3-b4dd-c4fc588da10d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:31.158264 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-74e98702-ae1d-44d3-b4dd-c4fc588da10d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:31.168100 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74e98702-ae1d-44d3-b4dd-c4fc588da10d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:31.168747 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74e98702-ae1d-44d3-b4dd-c4fc588da10d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:31.169972 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74e98702-ae1d-44d3-b4dd-c4fc588da10d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:31.170630 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74e98702-ae1d-44d3-b4dd-c4fc588da10d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:31.201602 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-74e98702-ae1d-44d3-b4dd-c4fc588da10d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051291 Apr 06 16:47:31.202161 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 603/1227] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:31 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:31.539129 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5ad84530-564e-4317-b5af-b1859e918fed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:31.539963 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5ad84530-564e-4317-b5af-b1859e918fed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:31.546442 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ad84530-564e-4317-b5af-b1859e918fed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:31.546896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ad84530-564e-4317-b5af-b1859e918fed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:31.547661 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ad84530-564e-4317-b5af-b1859e918fed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:31.548099 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ad84530-564e-4317-b5af-b1859e918fed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:31.577588 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5ad84530-564e-4317-b5af-b1859e918fed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042997 Apr 06 16:47:31.578133 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 625/1228] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:31 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:32.218099 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-345af05d-d522-4c88-b2dd-42b95938315c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:32.219760 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-345af05d-d522-4c88-b2dd-42b95938315c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:32.230832 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-345af05d-d522-4c88-b2dd-42b95938315c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:32.231571 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-345af05d-d522-4c88-b2dd-42b95938315c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:32.232888 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-345af05d-d522-4c88-b2dd-42b95938315c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:32.233617 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-345af05d-d522-4c88-b2dd-42b95938315c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:32.267219 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-345af05d-d522-4c88-b2dd-42b95938315c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055988 Apr 06 16:47:32.267769 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 604/1229] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:32 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:32.590645 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6e7b2d94-dc8e-4699-af4a-a4032dbfd7ce tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:32.591653 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6e7b2d94-dc8e-4699-af4a-a4032dbfd7ce tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:32.599114 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e7b2d94-dc8e-4699-af4a-a4032dbfd7ce tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:32.599566 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e7b2d94-dc8e-4699-af4a-a4032dbfd7ce tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:32.600411 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e7b2d94-dc8e-4699-af4a-a4032dbfd7ce tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:32.600894 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e7b2d94-dc8e-4699-af4a-a4032dbfd7ce tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:32.632081 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6e7b2d94-dc8e-4699-af4a-a4032dbfd7ce tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046779 Apr 06 16:47:32.632633 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 626/1230] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:32 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:33.282294 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c0b20be5-0cb4-42d6-b6b1-2d1616330ce2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:33.283140 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c0b20be5-0cb4-42d6-b6b1-2d1616330ce2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:33.291004 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0b20be5-0cb4-42d6-b6b1-2d1616330ce2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:33.291446 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0b20be5-0cb4-42d6-b6b1-2d1616330ce2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:33.292198 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0b20be5-0cb4-42d6-b6b1-2d1616330ce2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:33.292624 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0b20be5-0cb4-42d6-b6b1-2d1616330ce2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:33.322226 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c0b20be5-0cb4-42d6-b6b1-2d1616330ce2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046530 Apr 06 16:47:33.322790 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 605/1231] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:33 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:33.648011 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2122f8e4-8a4e-406b-b122-601e59eadb16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:33.648972 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2122f8e4-8a4e-406b-b122-601e59eadb16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:33.655414 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2122f8e4-8a4e-406b-b122-601e59eadb16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:33.655863 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2122f8e4-8a4e-406b-b122-601e59eadb16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:33.656664 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2122f8e4-8a4e-406b-b122-601e59eadb16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:33.657132 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2122f8e4-8a4e-406b-b122-601e59eadb16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:33.686271 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2122f8e4-8a4e-406b-b122-601e59eadb16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044743 Apr 06 16:47:33.686795 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 627/1232] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:33 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:34.334872 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-aed6fba5-511e-4041-89f2-842d404141bb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:34.335933 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-aed6fba5-511e-4041-89f2-842d404141bb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:34.342416 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aed6fba5-511e-4041-89f2-842d404141bb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:34.342895 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aed6fba5-511e-4041-89f2-842d404141bb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:34.343662 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aed6fba5-511e-4041-89f2-842d404141bb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:34.344101 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aed6fba5-511e-4041-89f2-842d404141bb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:34.373606 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-aed6fba5-511e-4041-89f2-842d404141bb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042839 Apr 06 16:47:34.374174 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 606/1233] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:34 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:34.700660 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9637cbec-0c67-44cf-b0ac-b4495233c19b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:34.701618 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9637cbec-0c67-44cf-b0ac-b4495233c19b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:34.708128 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9637cbec-0c67-44cf-b0ac-b4495233c19b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:34.708577 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9637cbec-0c67-44cf-b0ac-b4495233c19b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:34.709386 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9637cbec-0c67-44cf-b0ac-b4495233c19b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:34.709846 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9637cbec-0c67-44cf-b0ac-b4495233c19b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:34.739478 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9637cbec-0c67-44cf-b0ac-b4495233c19b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042854 Apr 06 16:47:34.740032 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 628/1234] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:34 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:35.385801 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-86ab1ed4-32ff-4f2b-9066-369f9a2b3ac6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:35.386726 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-86ab1ed4-32ff-4f2b-9066-369f9a2b3ac6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:35.393508 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86ab1ed4-32ff-4f2b-9066-369f9a2b3ac6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:35.393956 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86ab1ed4-32ff-4f2b-9066-369f9a2b3ac6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:35.394722 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86ab1ed4-32ff-4f2b-9066-369f9a2b3ac6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:35.395152 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86ab1ed4-32ff-4f2b-9066-369f9a2b3ac6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:35.424579 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-86ab1ed4-32ff-4f2b-9066-369f9a2b3ac6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042869 Apr 06 16:47:35.425179 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 607/1235] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:35 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:35.755611 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1df92594-1ee2-4082-91c9-816e4b80feb2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:35.757150 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1df92594-1ee2-4082-91c9-816e4b80feb2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:35.767490 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1df92594-1ee2-4082-91c9-816e4b80feb2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:35.768246 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1df92594-1ee2-4082-91c9-816e4b80feb2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:35.769560 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1df92594-1ee2-4082-91c9-816e4b80feb2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:35.770330 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1df92594-1ee2-4082-91c9-816e4b80feb2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:35.802345 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1df92594-1ee2-4082-91c9-816e4b80feb2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053555 Apr 06 16:47:35.802893 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 629/1236] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:35 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:36.436727 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7f862f53-94cc-42e1-b13e-fd66a93fd0a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:36.437679 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7f862f53-94cc-42e1-b13e-fd66a93fd0a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:36.444469 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f862f53-94cc-42e1-b13e-fd66a93fd0a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:36.444958 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f862f53-94cc-42e1-b13e-fd66a93fd0a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:36.445726 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f862f53-94cc-42e1-b13e-fd66a93fd0a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:36.446155 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f862f53-94cc-42e1-b13e-fd66a93fd0a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:36.476005 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7f862f53-94cc-42e1-b13e-fd66a93fd0a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043339 Apr 06 16:47:36.476534 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 608/1237] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:36 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:36.816175 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3af35e28-545c-4ff0-9d70-1353a8a297a1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:36.817347 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3af35e28-545c-4ff0-9d70-1353a8a297a1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:36.825115 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3af35e28-545c-4ff0-9d70-1353a8a297a1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:36.825561 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3af35e28-545c-4ff0-9d70-1353a8a297a1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:36.826328 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3af35e28-545c-4ff0-9d70-1353a8a297a1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:36.826754 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3af35e28-545c-4ff0-9d70-1353a8a297a1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:36.857993 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3af35e28-545c-4ff0-9d70-1353a8a297a1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046829 Apr 06 16:47:36.858550 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 630/1238] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:36 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:37.488834 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-07668695-3eab-49ed-ac61-81c84bb9009d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:37.489795 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-07668695-3eab-49ed-ac61-81c84bb9009d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:37.496643 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07668695-3eab-49ed-ac61-81c84bb9009d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:37.497220 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07668695-3eab-49ed-ac61-81c84bb9009d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:37.497990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07668695-3eab-49ed-ac61-81c84bb9009d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:37.498424 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07668695-3eab-49ed-ac61-81c84bb9009d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:37.528496 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-07668695-3eab-49ed-ac61-81c84bb9009d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044104 Apr 06 16:47:37.529015 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 609/1239] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:37 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:37.874731 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-982ccf61-d50b-420f-b683-35f91ead5348 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:37.876241 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-982ccf61-d50b-420f-b683-35f91ead5348 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:37.886612 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-982ccf61-d50b-420f-b683-35f91ead5348 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:37.887473 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-982ccf61-d50b-420f-b683-35f91ead5348 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:37.889127 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-982ccf61-d50b-420f-b683-35f91ead5348 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:37.889845 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-982ccf61-d50b-420f-b683-35f91ead5348 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:37.924347 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-982ccf61-d50b-420f-b683-35f91ead5348 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056472 Apr 06 16:47:37.924971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 631/1240] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:37 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:38.540173 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3e326daf-270d-480f-9da4-e147e3b36685 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:38.541135 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3e326daf-270d-480f-9da4-e147e3b36685 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:38.548015 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e326daf-270d-480f-9da4-e147e3b36685 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:38.548465 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e326daf-270d-480f-9da4-e147e3b36685 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:38.549279 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e326daf-270d-480f-9da4-e147e3b36685 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:38.549713 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e326daf-270d-480f-9da4-e147e3b36685 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:38.579337 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3e326daf-270d-480f-9da4-e147e3b36685 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043100 Apr 06 16:47:38.579813 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 610/1241] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:38 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:38.936049 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-56504d43-aa1d-4a5d-a0ae-68ad45fd822c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:38.936996 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-56504d43-aa1d-4a5d-a0ae-68ad45fd822c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:38.943411 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56504d43-aa1d-4a5d-a0ae-68ad45fd822c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:38.943855 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56504d43-aa1d-4a5d-a0ae-68ad45fd822c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:38.944621 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56504d43-aa1d-4a5d-a0ae-68ad45fd822c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:38.945065 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56504d43-aa1d-4a5d-a0ae-68ad45fd822c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:38.973773 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-56504d43-aa1d-4a5d-a0ae-68ad45fd822c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041764 Apr 06 16:47:38.974322 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 632/1242] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:38 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:39.591685 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bf801236-6026-4a4f-88bc-7a4c30d4cdbc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:39.592527 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bf801236-6026-4a4f-88bc-7a4c30d4cdbc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:39.599530 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf801236-6026-4a4f-88bc-7a4c30d4cdbc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:39.599987 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf801236-6026-4a4f-88bc-7a4c30d4cdbc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:39.600797 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf801236-6026-4a4f-88bc-7a4c30d4cdbc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:39.601243 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf801236-6026-4a4f-88bc-7a4c30d4cdbc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:39.631312 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bf801236-6026-4a4f-88bc-7a4c30d4cdbc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043933 Apr 06 16:47:39.631868 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 611/1243] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:39 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:39.987533 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6291f410-da87-4044-83b0-10cf9479428b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:39.988604 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6291f410-da87-4044-83b0-10cf9479428b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:39.996028 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6291f410-da87-4044-83b0-10cf9479428b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:39.996697 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6291f410-da87-4044-83b0-10cf9479428b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:39.997446 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6291f410-da87-4044-83b0-10cf9479428b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:39.997867 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6291f410-da87-4044-83b0-10cf9479428b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:40.026927 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6291f410-da87-4044-83b0-10cf9479428b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044486 Apr 06 16:47:40.027505 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 633/1244] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:39 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:40.644994 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8d0c5d2c-85ca-4071-85e1-2164f694f27c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:40.645918 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8d0c5d2c-85ca-4071-85e1-2164f694f27c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:40.652531 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d0c5d2c-85ca-4071-85e1-2164f694f27c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:40.653014 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d0c5d2c-85ca-4071-85e1-2164f694f27c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:40.653912 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d0c5d2c-85ca-4071-85e1-2164f694f27c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:40.654584 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d0c5d2c-85ca-4071-85e1-2164f694f27c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:40.695369 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8d0c5d2c-85ca-4071-85e1-2164f694f27c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054542 Apr 06 16:47:40.695918 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 612/1245] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:40 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:41.042401 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-238ee3b9-b39c-4cf9-8940-1212430464ee tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:41.043865 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-238ee3b9-b39c-4cf9-8940-1212430464ee tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:41.050923 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-238ee3b9-b39c-4cf9-8940-1212430464ee tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:41.051365 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-238ee3b9-b39c-4cf9-8940-1212430464ee tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:41.052123 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-238ee3b9-b39c-4cf9-8940-1212430464ee tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:41.052541 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-238ee3b9-b39c-4cf9-8940-1212430464ee tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:41.081308 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-238ee3b9-b39c-4cf9-8940-1212430464ee tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045614 Apr 06 16:47:41.081856 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 634/1246] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:41 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:41.708263 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0f541074-5f0b-414a-ba8b-d1b541037d86 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:41.709286 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0f541074-5f0b-414a-ba8b-d1b541037d86 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:41.717903 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f541074-5f0b-414a-ba8b-d1b541037d86 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:41.718354 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f541074-5f0b-414a-ba8b-d1b541037d86 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:41.719124 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f541074-5f0b-414a-ba8b-d1b541037d86 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:41.719560 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f541074-5f0b-414a-ba8b-d1b541037d86 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:41.749234 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0f541074-5f0b-414a-ba8b-d1b541037d86 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045219 Apr 06 16:47:41.749788 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 613/1247] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:41 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:42.096992 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ef06c2ce-8fc1-4359-879b-3d3756089ffc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:42.098534 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ef06c2ce-8fc1-4359-879b-3d3756089ffc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:42.108359 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef06c2ce-8fc1-4359-879b-3d3756089ffc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:42.108848 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef06c2ce-8fc1-4359-879b-3d3756089ffc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:42.109624 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef06c2ce-8fc1-4359-879b-3d3756089ffc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:42.110098 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef06c2ce-8fc1-4359-879b-3d3756089ffc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:42.139002 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ef06c2ce-8fc1-4359-879b-3d3756089ffc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048992 Apr 06 16:47:42.139562 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 635/1248] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:42 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:42.761770 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f9aada4b-cfa1-4d00-8e7e-c1eaf632557c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:42.762697 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f9aada4b-cfa1-4d00-8e7e-c1eaf632557c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:42.769881 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9aada4b-cfa1-4d00-8e7e-c1eaf632557c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:42.770333 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9aada4b-cfa1-4d00-8e7e-c1eaf632557c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:42.771062 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9aada4b-cfa1-4d00-8e7e-c1eaf632557c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:42.771527 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9aada4b-cfa1-4d00-8e7e-c1eaf632557c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:42.801265 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f9aada4b-cfa1-4d00-8e7e-c1eaf632557c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043415 Apr 06 16:47:42.801733 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 614/1249] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:42 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:43.151984 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7303ee92-8bb1-436e-af87-b9a632bb28c1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:43.153052 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7303ee92-8bb1-436e-af87-b9a632bb28c1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:43.160922 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7303ee92-8bb1-436e-af87-b9a632bb28c1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:43.161512 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7303ee92-8bb1-436e-af87-b9a632bb28c1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:43.162650 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7303ee92-8bb1-436e-af87-b9a632bb28c1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:43.163235 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7303ee92-8bb1-436e-af87-b9a632bb28c1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:43.199227 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7303ee92-8bb1-436e-af87-b9a632bb28c1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051703 Apr 06 16:47:43.199780 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 636/1250] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:43 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:43.813493 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bde71967-e73e-4873-a29d-ad21dff1c72d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:43.814419 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bde71967-e73e-4873-a29d-ad21dff1c72d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:43.821401 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bde71967-e73e-4873-a29d-ad21dff1c72d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:43.821851 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bde71967-e73e-4873-a29d-ad21dff1c72d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:43.822621 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bde71967-e73e-4873-a29d-ad21dff1c72d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:43.823055 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bde71967-e73e-4873-a29d-ad21dff1c72d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:43.851711 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bde71967-e73e-4873-a29d-ad21dff1c72d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042404 Apr 06 16:47:43.852259 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 615/1251] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:43 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:44.211585 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-46c02cf9-3216-4168-a1b7-5f84d72c2514 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:44.212529 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-46c02cf9-3216-4168-a1b7-5f84d72c2514 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:44.219955 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46c02cf9-3216-4168-a1b7-5f84d72c2514 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:44.220445 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46c02cf9-3216-4168-a1b7-5f84d72c2514 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:44.221314 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46c02cf9-3216-4168-a1b7-5f84d72c2514 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:44.221807 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46c02cf9-3216-4168-a1b7-5f84d72c2514 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:44.251929 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-46c02cf9-3216-4168-a1b7-5f84d72c2514 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044765 Apr 06 16:47:44.252478 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 637/1252] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:44 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:44.864301 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-35409855-0b51-47e4-85c4-6b51e605482c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:44.865251 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-35409855-0b51-47e4-85c4-6b51e605482c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:44.871743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35409855-0b51-47e4-85c4-6b51e605482c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:44.872203 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35409855-0b51-47e4-85c4-6b51e605482c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:44.873036 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35409855-0b51-47e4-85c4-6b51e605482c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:44.873520 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35409855-0b51-47e4-85c4-6b51e605482c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:44.903156 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-35409855-0b51-47e4-85c4-6b51e605482c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043370 Apr 06 16:47:44.903709 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 616/1253] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:44 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:45.269861 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-551c5540-e07f-4e8a-bd7c-b1086dd34342 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:45.271401 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-551c5540-e07f-4e8a-bd7c-b1086dd34342 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:45.281180 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-551c5540-e07f-4e8a-bd7c-b1086dd34342 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:45.281595 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-551c5540-e07f-4e8a-bd7c-b1086dd34342 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:45.282383 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-551c5540-e07f-4e8a-bd7c-b1086dd34342 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:45.282819 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-551c5540-e07f-4e8a-bd7c-b1086dd34342 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:45.312978 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-551c5540-e07f-4e8a-bd7c-b1086dd34342 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049802 Apr 06 16:47:45.313516 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 638/1254] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:45 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:45.919313 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c8018423-81bc-4622-b9c2-7efe6ba8c961 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:45.920513 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c8018423-81bc-4622-b9c2-7efe6ba8c961 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:45.930128 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8018423-81bc-4622-b9c2-7efe6ba8c961 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:45.930809 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8018423-81bc-4622-b9c2-7efe6ba8c961 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:45.932005 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8018423-81bc-4622-b9c2-7efe6ba8c961 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:45.932729 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8018423-81bc-4622-b9c2-7efe6ba8c961 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:45.963836 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c8018423-81bc-4622-b9c2-7efe6ba8c961 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051286 Apr 06 16:47:45.964434 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 617/1255] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:45 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:46.327009 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-168e85ca-1ca1-48c0-bc5e-cf8f00aca8c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:46.327962 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-168e85ca-1ca1-48c0-bc5e-cf8f00aca8c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:46.334524 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-168e85ca-1ca1-48c0-bc5e-cf8f00aca8c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:46.334980 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-168e85ca-1ca1-48c0-bc5e-cf8f00aca8c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:46.335752 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-168e85ca-1ca1-48c0-bc5e-cf8f00aca8c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:46.336185 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-168e85ca-1ca1-48c0-bc5e-cf8f00aca8c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:46.365359 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-168e85ca-1ca1-48c0-bc5e-cf8f00aca8c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043116 Apr 06 16:47:46.365914 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 639/1256] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:46 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:46.975665 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c41fd302-7aa0-4992-b819-f9d7a5023df8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:46.976590 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c41fd302-7aa0-4992-b819-f9d7a5023df8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:46.983457 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c41fd302-7aa0-4992-b819-f9d7a5023df8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:46.983910 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c41fd302-7aa0-4992-b819-f9d7a5023df8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:46.984690 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c41fd302-7aa0-4992-b819-f9d7a5023df8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:46.985153 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c41fd302-7aa0-4992-b819-f9d7a5023df8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:47.015824 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c41fd302-7aa0-4992-b819-f9d7a5023df8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044177 Apr 06 16:47:47.016377 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 618/1257] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:46 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:47.377812 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1eaff327-2603-443a-9b12-d0921a93ece5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:47.378734 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1eaff327-2603-443a-9b12-d0921a93ece5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:47.385379 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1eaff327-2603-443a-9b12-d0921a93ece5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:47.385834 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1eaff327-2603-443a-9b12-d0921a93ece5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:47.386707 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1eaff327-2603-443a-9b12-d0921a93ece5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:47.387135 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1eaff327-2603-443a-9b12-d0921a93ece5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:47.423056 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1eaff327-2603-443a-9b12-d0921a93ece5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049512 Apr 06 16:47:47.423635 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 640/1258] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:47 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:48.027798 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-08982fe4-8640-4862-b3a5-490b202af26b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:48.028761 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-08982fe4-8640-4862-b3a5-490b202af26b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:48.035660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08982fe4-8640-4862-b3a5-490b202af26b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:48.036105 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08982fe4-8640-4862-b3a5-490b202af26b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:48.036896 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08982fe4-8640-4862-b3a5-490b202af26b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:48.037325 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08982fe4-8640-4862-b3a5-490b202af26b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:48.067232 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-08982fe4-8640-4862-b3a5-490b202af26b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043388 Apr 06 16:47:48.067778 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 619/1259] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:48 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:48.439358 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ae4313a8-4f16-42f0-9572-39c3e7686545 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:48.440282 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ae4313a8-4f16-42f0-9572-39c3e7686545 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:48.447045 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae4313a8-4f16-42f0-9572-39c3e7686545 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:48.447498 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae4313a8-4f16-42f0-9572-39c3e7686545 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:48.448301 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae4313a8-4f16-42f0-9572-39c3e7686545 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:48.448765 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae4313a8-4f16-42f0-9572-39c3e7686545 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:48.478983 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ae4313a8-4f16-42f0-9572-39c3e7686545 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044709 Apr 06 16:47:48.479533 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 641/1260] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:48 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:49.079882 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-25e47139-9f31-45c3-a7ea-ca8bf05c1c77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:49.080829 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-25e47139-9f31-45c3-a7ea-ca8bf05c1c77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:49.087181 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25e47139-9f31-45c3-a7ea-ca8bf05c1c77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:49.087694 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25e47139-9f31-45c3-a7ea-ca8bf05c1c77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:49.088388 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25e47139-9f31-45c3-a7ea-ca8bf05c1c77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:49.088870 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25e47139-9f31-45c3-a7ea-ca8bf05c1c77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:49.118669 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-25e47139-9f31-45c3-a7ea-ca8bf05c1c77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042857 Apr 06 16:47:49.119241 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 620/1261] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:49 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:49.495902 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aff11108-9def-41b4-bb57-c4f42bc91034 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:49.497519 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aff11108-9def-41b4-bb57-c4f42bc91034 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:49.508132 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aff11108-9def-41b4-bb57-c4f42bc91034 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:49.508911 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aff11108-9def-41b4-bb57-c4f42bc91034 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:49.510260 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aff11108-9def-41b4-bb57-c4f42bc91034 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:49.510965 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aff11108-9def-41b4-bb57-c4f42bc91034 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:49.541264 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aff11108-9def-41b4-bb57-c4f42bc91034 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052162 Apr 06 16:47:49.541826 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 642/1262] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:49 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:50.131192 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-74aa0be4-4ac6-4793-b163-75fd1837ecab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:50.132093 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-74aa0be4-4ac6-4793-b163-75fd1837ecab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:50.138182 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74aa0be4-4ac6-4793-b163-75fd1837ecab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:50.138632 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74aa0be4-4ac6-4793-b163-75fd1837ecab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:50.139400 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74aa0be4-4ac6-4793-b163-75fd1837ecab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:50.139830 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74aa0be4-4ac6-4793-b163-75fd1837ecab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:50.169235 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-74aa0be4-4ac6-4793-b163-75fd1837ecab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042317 Apr 06 16:47:50.169705 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 621/1263] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:50 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:50.554773 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d62ee780-eb78-497d-b4a9-6a31404c54df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:50.555686 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d62ee780-eb78-497d-b4a9-6a31404c54df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:50.562535 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d62ee780-eb78-497d-b4a9-6a31404c54df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:50.562985 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d62ee780-eb78-497d-b4a9-6a31404c54df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:50.563732 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d62ee780-eb78-497d-b4a9-6a31404c54df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:50.564163 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d62ee780-eb78-497d-b4a9-6a31404c54df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:50.592996 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d62ee780-eb78-497d-b4a9-6a31404c54df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042181 Apr 06 16:47:50.593545 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 643/1264] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:50 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:51.181358 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-38f0db9e-8f2f-4759-9b83-1b5fa2cd5792 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:51.182440 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-38f0db9e-8f2f-4759-9b83-1b5fa2cd5792 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:51.189019 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38f0db9e-8f2f-4759-9b83-1b5fa2cd5792 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:51.189463 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38f0db9e-8f2f-4759-9b83-1b5fa2cd5792 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:51.190279 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38f0db9e-8f2f-4759-9b83-1b5fa2cd5792 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:51.190849 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38f0db9e-8f2f-4759-9b83-1b5fa2cd5792 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:51.221634 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-38f0db9e-8f2f-4759-9b83-1b5fa2cd5792 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044107 Apr 06 16:47:51.222168 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 622/1265] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:51 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:51.607064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c35e10af-5354-4f36-832e-8b2ffd5d68d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:51.608032 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c35e10af-5354-4f36-832e-8b2ffd5d68d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:51.615562 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c35e10af-5354-4f36-832e-8b2ffd5d68d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:51.616013 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c35e10af-5354-4f36-832e-8b2ffd5d68d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:51.616815 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c35e10af-5354-4f36-832e-8b2ffd5d68d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:51.617250 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c35e10af-5354-4f36-832e-8b2ffd5d68d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:51.646070 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c35e10af-5354-4f36-832e-8b2ffd5d68d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043858 Apr 06 16:47:51.646624 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 644/1266] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:51 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:52.235384 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1a428acd-7c16-47d8-8259-a2484cc258e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:52.236868 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1a428acd-7c16-47d8-8259-a2484cc258e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:52.243715 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a428acd-7c16-47d8-8259-a2484cc258e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:52.244145 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a428acd-7c16-47d8-8259-a2484cc258e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:52.244997 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a428acd-7c16-47d8-8259-a2484cc258e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:52.245433 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a428acd-7c16-47d8-8259-a2484cc258e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:52.275080 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1a428acd-7c16-47d8-8259-a2484cc258e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043682 Apr 06 16:47:52.275632 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 623/1267] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:52 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:52.661241 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-44a494dd-59cd-4870-ae06-fc9154c39337 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:52.662335 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-44a494dd-59cd-4870-ae06-fc9154c39337 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:52.670152 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44a494dd-59cd-4870-ae06-fc9154c39337 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:52.670672 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44a494dd-59cd-4870-ae06-fc9154c39337 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:52.671561 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44a494dd-59cd-4870-ae06-fc9154c39337 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:52.672060 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44a494dd-59cd-4870-ae06-fc9154c39337 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:52.704314 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-44a494dd-59cd-4870-ae06-fc9154c39337 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049252 Apr 06 16:47:52.705028 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 645/1268] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:52 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:53.287692 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-43d3bdcf-bd8a-4411-9fcc-0e8add4beea4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:53.288637 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-43d3bdcf-bd8a-4411-9fcc-0e8add4beea4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:53.295143 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43d3bdcf-bd8a-4411-9fcc-0e8add4beea4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:53.295610 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43d3bdcf-bd8a-4411-9fcc-0e8add4beea4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:53.296369 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43d3bdcf-bd8a-4411-9fcc-0e8add4beea4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:53.296838 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43d3bdcf-bd8a-4411-9fcc-0e8add4beea4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:53.325552 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-43d3bdcf-bd8a-4411-9fcc-0e8add4beea4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042428 Apr 06 16:47:53.326324 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 624/1269] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:53 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:53.720745 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-33ace900-8508-4010-92f5-cf99e8dbf1fb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:53.722854 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-33ace900-8508-4010-92f5-cf99e8dbf1fb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:53.733345 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33ace900-8508-4010-92f5-cf99e8dbf1fb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:53.734099 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33ace900-8508-4010-92f5-cf99e8dbf1fb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:53.735443 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33ace900-8508-4010-92f5-cf99e8dbf1fb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:53.736570 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33ace900-8508-4010-92f5-cf99e8dbf1fb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:53.767038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-33ace900-8508-4010-92f5-cf99e8dbf1fb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053026 Apr 06 16:47:53.768388 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 646/1270] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:53 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:47:54.337406 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-10426248-f9b7-4f0f-aa80-4356ece651f5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:54.338331 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-10426248-f9b7-4f0f-aa80-4356ece651f5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:54.345001 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10426248-f9b7-4f0f-aa80-4356ece651f5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:54.345418 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10426248-f9b7-4f0f-aa80-4356ece651f5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:54.346055 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10426248-f9b7-4f0f-aa80-4356ece651f5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:54.346483 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10426248-f9b7-4f0f-aa80-4356ece651f5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:54.376151 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-10426248-f9b7-4f0f-aa80-4356ece651f5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042765 Apr 06 16:47:54.376715 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 625/1271] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:54 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:54.785465 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4203ce3d-dfbf-4141-bddb-3da15a9b3dba tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:54.786302 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4203ce3d-dfbf-4141-bddb-3da15a9b3dba tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:54.793835 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4203ce3d-dfbf-4141-bddb-3da15a9b3dba tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:54.794271 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4203ce3d-dfbf-4141-bddb-3da15a9b3dba tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:54.795021 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4203ce3d-dfbf-4141-bddb-3da15a9b3dba tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:54.795449 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4203ce3d-dfbf-4141-bddb-3da15a9b3dba tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:54.831184 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4203ce3d-dfbf-4141-bddb-3da15a9b3dba tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053557 Apr 06 16:47:54.831741 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 647/1272] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:54 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:55.387640 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5ace8b12-fdd5-4b2a-aa14-100d636ff36e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:55.388553 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5ace8b12-fdd5-4b2a-aa14-100d636ff36e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:55.395598 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ace8b12-fdd5-4b2a-aa14-100d636ff36e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:55.395954 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ace8b12-fdd5-4b2a-aa14-100d636ff36e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:55.396748 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ace8b12-fdd5-4b2a-aa14-100d636ff36e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:55.397234 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ace8b12-fdd5-4b2a-aa14-100d636ff36e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:55.426887 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5ace8b12-fdd5-4b2a-aa14-100d636ff36e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043136 Apr 06 16:47:55.427927 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 626/1273] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:55 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:55.843745 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e67fc421-e407-4462-bb62-b59402a71a8f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:55.844718 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e67fc421-e407-4462-bb62-b59402a71a8f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:55.851724 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e67fc421-e407-4462-bb62-b59402a71a8f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:55.852170 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e67fc421-e407-4462-bb62-b59402a71a8f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:55.852957 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e67fc421-e407-4462-bb62-b59402a71a8f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:55.853380 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e67fc421-e407-4462-bb62-b59402a71a8f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:55.882618 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e67fc421-e407-4462-bb62-b59402a71a8f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043093 Apr 06 16:47:55.883158 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 648/1274] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:55 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:56.439545 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1697e4fa-d4ce-4c03-a078-5cfaf0a2a11d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:56.440495 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1697e4fa-d4ce-4c03-a078-5cfaf0a2a11d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:56.447717 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1697e4fa-d4ce-4c03-a078-5cfaf0a2a11d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:56.448172 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1697e4fa-d4ce-4c03-a078-5cfaf0a2a11d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:56.449305 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1697e4fa-d4ce-4c03-a078-5cfaf0a2a11d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:56.449748 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1697e4fa-d4ce-4c03-a078-5cfaf0a2a11d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:56.480175 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1697e4fa-d4ce-4c03-a078-5cfaf0a2a11d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044722 Apr 06 16:47:56.480745 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 627/1275] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:56 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:56.897549 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a5f1393b-af0b-4563-8ebb-7a321e8d8e61 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:56.898463 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a5f1393b-af0b-4563-8ebb-7a321e8d8e61 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:56.906178 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5f1393b-af0b-4563-8ebb-7a321e8d8e61 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:56.906627 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5f1393b-af0b-4563-8ebb-7a321e8d8e61 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:56.907392 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5f1393b-af0b-4563-8ebb-7a321e8d8e61 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:56.907896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5f1393b-af0b-4563-8ebb-7a321e8d8e61 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:56.941975 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a5f1393b-af0b-4563-8ebb-7a321e8d8e61 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049832 Apr 06 16:47:56.942716 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 649/1276] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:56 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:57.492720 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-676aebd6-d700-46d9-96df-16aed6e8de12 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:57.493672 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-676aebd6-d700-46d9-96df-16aed6e8de12 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:57.500214 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-676aebd6-d700-46d9-96df-16aed6e8de12 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:57.500659 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-676aebd6-d700-46d9-96df-16aed6e8de12 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:57.501609 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-676aebd6-d700-46d9-96df-16aed6e8de12 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:57.502231 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-676aebd6-d700-46d9-96df-16aed6e8de12 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:57.531921 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-676aebd6-d700-46d9-96df-16aed6e8de12 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043180 Apr 06 16:47:57.532494 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 628/1277] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:57 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:57.957431 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0f9d2f1b-0186-410e-b93d-40fa78971d38 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:57.958629 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0f9d2f1b-0186-410e-b93d-40fa78971d38 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:57.968310 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f9d2f1b-0186-410e-b93d-40fa78971d38 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:57.969140 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f9d2f1b-0186-410e-b93d-40fa78971d38 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:57.970561 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f9d2f1b-0186-410e-b93d-40fa78971d38 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:57.971317 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f9d2f1b-0186-410e-b93d-40fa78971d38 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:58.001738 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0f9d2f1b-0186-410e-b93d-40fa78971d38 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050017 Apr 06 16:47:58.002297 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 650/1278] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:57 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:58.543695 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a9730927-48c1-45e4-a39b-4d6a55aa9d51 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:58.544611 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a9730927-48c1-45e4-a39b-4d6a55aa9d51 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:58.551032 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9730927-48c1-45e4-a39b-4d6a55aa9d51 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:58.551476 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9730927-48c1-45e4-a39b-4d6a55aa9d51 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:58.552329 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9730927-48c1-45e4-a39b-4d6a55aa9d51 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:58.552650 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9730927-48c1-45e4-a39b-4d6a55aa9d51 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:58.583443 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a9730927-48c1-45e4-a39b-4d6a55aa9d51 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043710 Apr 06 16:47:58.584070 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 629/1279] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:58 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:47:59.015484 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e3ecec5c-a574-41ee-9280-46d2fce9d883 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:59.016820 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e3ecec5c-a574-41ee-9280-46d2fce9d883 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:59.023944 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3ecec5c-a574-41ee-9280-46d2fce9d883 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:59.024333 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3ecec5c-a574-41ee-9280-46d2fce9d883 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:59.025142 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3ecec5c-a574-41ee-9280-46d2fce9d883 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:59.025576 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3ecec5c-a574-41ee-9280-46d2fce9d883 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:59.056024 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e3ecec5c-a574-41ee-9280-46d2fce9d883 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045230 Apr 06 16:47:59.056604 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 651/1280] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:47:59 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:47:59.599780 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d846ba8f-1b1d-4400-b4b3-c522de1f9e56 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:47:59.600724 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d846ba8f-1b1d-4400-b4b3-c522de1f9e56 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:47:59.607807 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d846ba8f-1b1d-4400-b4b3-c522de1f9e56 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:59.607807 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d846ba8f-1b1d-4400-b4b3-c522de1f9e56 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:59.607807 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d846ba8f-1b1d-4400-b4b3-c522de1f9e56 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:47:59.607807 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d846ba8f-1b1d-4400-b4b3-c522de1f9e56 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:47:59.645863 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d846ba8f-1b1d-4400-b4b3-c522de1f9e56 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050270 Apr 06 16:47:59.646429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 630/1281] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:47:59 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:00.073805 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-54756deb-a8eb-46ad-9998-ee76c79432e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:00.075110 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-54756deb-a8eb-46ad-9998-ee76c79432e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:00.085698 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54756deb-a8eb-46ad-9998-ee76c79432e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:00.086309 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54756deb-a8eb-46ad-9998-ee76c79432e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:00.087569 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54756deb-a8eb-46ad-9998-ee76c79432e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:00.088273 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54756deb-a8eb-46ad-9998-ee76c79432e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:00.133518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-54756deb-a8eb-46ad-9998-ee76c79432e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066123 Apr 06 16:48:00.134088 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 652/1282] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:00 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:00.657577 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a0df9df7-6db8-4f14-bd10-b36f2932de77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:00.658500 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a0df9df7-6db8-4f14-bd10-b36f2932de77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:00.665445 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0df9df7-6db8-4f14-bd10-b36f2932de77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:00.665641 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0df9df7-6db8-4f14-bd10-b36f2932de77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:00.666475 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0df9df7-6db8-4f14-bd10-b36f2932de77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:00.666943 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0df9df7-6db8-4f14-bd10-b36f2932de77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:00.697362 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a0df9df7-6db8-4f14-bd10-b36f2932de77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043690 Apr 06 16:48:00.697969 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 631/1283] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:00 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:01.147506 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-02dab28f-5e4b-47b3-9414-d67eba5c70e5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:01.148432 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-02dab28f-5e4b-47b3-9414-d67eba5c70e5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:01.155082 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02dab28f-5e4b-47b3-9414-d67eba5c70e5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:01.155536 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02dab28f-5e4b-47b3-9414-d67eba5c70e5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:01.156317 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02dab28f-5e4b-47b3-9414-d67eba5c70e5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:01.156782 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02dab28f-5e4b-47b3-9414-d67eba5c70e5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:01.190644 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-02dab28f-5e4b-47b3-9414-d67eba5c70e5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048270 Apr 06 16:48:01.191191 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 653/1284] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:01 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:01.709788 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-030a4c11-7bda-440f-86a5-f5c37efb4905 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:01.710724 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-030a4c11-7bda-440f-86a5-f5c37efb4905 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:01.717378 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-030a4c11-7bda-440f-86a5-f5c37efb4905 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:01.717826 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-030a4c11-7bda-440f-86a5-f5c37efb4905 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:01.718595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-030a4c11-7bda-440f-86a5-f5c37efb4905 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:01.718999 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-030a4c11-7bda-440f-86a5-f5c37efb4905 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:01.749311 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-030a4c11-7bda-440f-86a5-f5c37efb4905 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043902 Apr 06 16:48:01.749863 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 632/1285] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:01 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:01.815006 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9fce7b85-917a-47c1-ad62-2633d0f35abc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:01.816064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9fce7b85-917a-47c1-ad62-2633d0f35abc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:01.822581 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fce7b85-917a-47c1-ad62-2633d0f35abc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:01.823037 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fce7b85-917a-47c1-ad62-2633d0f35abc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:01.823809 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fce7b85-917a-47c1-ad62-2633d0f35abc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:01.824246 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9fce7b85-917a-47c1-ad62-2633d0f35abc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:01.853589 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9fce7b85-917a-47c1-ad62-2633d0f35abc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042757 Apr 06 16:48:01.854154 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 654/1286] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:01 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:02.206454 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8ba5689d-9b34-46dd-bb62-c7d491d621ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:48:02.208255 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8ba5689d-9b34-46dd-bb62-c7d491d621ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:02.218185 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ba5689d-9b34-46dd-bb62-c7d491d621ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:02.218851 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ba5689d-9b34-46dd-bb62-c7d491d621ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:02.220131 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ba5689d-9b34-46dd-bb62-c7d491d621ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:02.220820 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ba5689d-9b34-46dd-bb62-c7d491d621ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:02.247653 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8ba5689d-9b34-46dd-bb62-c7d491d621ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [6c744826-37ea-4b6c-ab68-302880531280] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 06 16:48:02.761714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-82b23838-a9ab-4e51-8b53-c440e2148b83 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:02.762722 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-82b23838-a9ab-4e51-8b53-c440e2148b83 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:02.769255 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82b23838-a9ab-4e51-8b53-c440e2148b83 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:02.769810 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82b23838-a9ab-4e51-8b53-c440e2148b83 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:02.770580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82b23838-a9ab-4e51-8b53-c440e2148b83 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:02.771010 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82b23838-a9ab-4e51-8b53-c440e2148b83 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:02.800723 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-82b23838-a9ab-4e51-8b53-c440e2148b83 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043092 Apr 06 16:48:02.801496 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 655/1287] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:02 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:02.868142 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a594249d-18f1-4156-a33d-82bc55d53d9a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:02.869165 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a594249d-18f1-4156-a33d-82bc55d53d9a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:02.877721 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a594249d-18f1-4156-a33d-82bc55d53d9a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:02.878435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a594249d-18f1-4156-a33d-82bc55d53d9a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:02.879641 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a594249d-18f1-4156-a33d-82bc55d53d9a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:02.880752 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a594249d-18f1-4156-a33d-82bc55d53d9a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:02.914473 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a594249d-18f1-4156-a33d-82bc55d53d9a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050344 Apr 06 16:48:02.915010 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 656/1288] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:02 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:03.256616 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [None req-8ba5689d-9b34-46dd-bb62-c7d491d621ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [6c744826-37ea-4b6c-ab68-302880531280] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 60166. Apr 06 16:48:03.330189 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8ba5689d-9b34-46dd-bb62-c7d491d621ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "POST /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/action" status: 200 len: 41614 microversion: 2.1 time: 1.130200 Apr 06 16:48:03.330818 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 633/1289] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Apr 6 16:48:02 2022] POST /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c/action => generated 41614 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:03.815835 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ea60c700-5810-46b8-a284-7daf842151af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:03.816923 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ea60c700-5810-46b8-a284-7daf842151af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:03.823301 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea60c700-5810-46b8-a284-7daf842151af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:03.823802 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea60c700-5810-46b8-a284-7daf842151af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:03.824572 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea60c700-5810-46b8-a284-7daf842151af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:03.825031 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea60c700-5810-46b8-a284-7daf842151af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:03.864313 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ea60c700-5810-46b8-a284-7daf842151af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054692 Apr 06 16:48:03.864969 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 657/1290] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:03 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:03.931573 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c6f722b6-b51b-490d-b2c3-81914d92f0b3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:03.933281 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c6f722b6-b51b-490d-b2c3-81914d92f0b3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:03.943166 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6f722b6-b51b-490d-b2c3-81914d92f0b3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:03.943614 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6f722b6-b51b-490d-b2c3-81914d92f0b3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:03.944419 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6f722b6-b51b-490d-b2c3-81914d92f0b3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:03.944913 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6f722b6-b51b-490d-b2c3-81914d92f0b3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:03.975233 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c6f722b6-b51b-490d-b2c3-81914d92f0b3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051588 Apr 06 16:48:03.975782 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 634/1291] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:03 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:04.875625 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fc139abc-49dd-4022-a0db-82c2130d93cb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:04.876577 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fc139abc-49dd-4022-a0db-82c2130d93cb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:04.884226 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc139abc-49dd-4022-a0db-82c2130d93cb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:04.884701 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc139abc-49dd-4022-a0db-82c2130d93cb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:04.885475 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc139abc-49dd-4022-a0db-82c2130d93cb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:04.885898 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc139abc-49dd-4022-a0db-82c2130d93cb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:04.915813 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fc139abc-49dd-4022-a0db-82c2130d93cb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044154 Apr 06 16:48:04.916412 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 658/1292] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:04 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:04.987551 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fa9f6dab-115f-44db-8c17-dd739814c830 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:04.988471 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fa9f6dab-115f-44db-8c17-dd739814c830 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:04.995062 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa9f6dab-115f-44db-8c17-dd739814c830 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:04.995520 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa9f6dab-115f-44db-8c17-dd739814c830 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:04.996296 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa9f6dab-115f-44db-8c17-dd739814c830 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:04.996757 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa9f6dab-115f-44db-8c17-dd739814c830 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:05.031300 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fa9f6dab-115f-44db-8c17-dd739814c830 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048111 Apr 06 16:48:05.032074 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 635/1293] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:04 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:05.929623 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-68eb595d-056a-49cd-9df9-20480594ca2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:05.930553 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-68eb595d-056a-49cd-9df9-20480594ca2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:05.937047 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68eb595d-056a-49cd-9df9-20480594ca2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:05.937503 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68eb595d-056a-49cd-9df9-20480594ca2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:05.938263 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68eb595d-056a-49cd-9df9-20480594ca2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:05.938689 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68eb595d-056a-49cd-9df9-20480594ca2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:05.967577 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-68eb595d-056a-49cd-9df9-20480594ca2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042656 Apr 06 16:48:05.968421 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 659/1294] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:05 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:06.044649 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-81ca9076-dfe9-4d36-a312-d3230ddbd052 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:06.045612 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-81ca9076-dfe9-4d36-a312-d3230ddbd052 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:06.053385 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81ca9076-dfe9-4d36-a312-d3230ddbd052 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:06.053828 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81ca9076-dfe9-4d36-a312-d3230ddbd052 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:06.054597 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81ca9076-dfe9-4d36-a312-d3230ddbd052 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:06.055025 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81ca9076-dfe9-4d36-a312-d3230ddbd052 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:06.090437 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-81ca9076-dfe9-4d36-a312-d3230ddbd052 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044394 Apr 06 16:48:06.090437 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 636/1295] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:06 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:06.980043 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c114c6fd-8901-4f4f-849e-790517695baa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:06.981084 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c114c6fd-8901-4f4f-849e-790517695baa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:06.987828 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c114c6fd-8901-4f4f-849e-790517695baa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:06.988244 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c114c6fd-8901-4f4f-849e-790517695baa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:06.989599 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c114c6fd-8901-4f4f-849e-790517695baa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:06.990063 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c114c6fd-8901-4f4f-849e-790517695baa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:07.031179 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c114c6fd-8901-4f4f-849e-790517695baa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054821 Apr 06 16:48:07.032093 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 660/1296] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:06 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:07.097025 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3441958b-1737-4a48-921c-615225369fa9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:07.098183 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3441958b-1737-4a48-921c-615225369fa9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:07.104806 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3441958b-1737-4a48-921c-615225369fa9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:07.105259 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3441958b-1737-4a48-921c-615225369fa9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:07.106033 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3441958b-1737-4a48-921c-615225369fa9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:07.106927 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3441958b-1737-4a48-921c-615225369fa9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:07.137200 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3441958b-1737-4a48-921c-615225369fa9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044322 Apr 06 16:48:07.137756 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 637/1297] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:07 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:08.045220 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9bbc18f3-51fa-4b5e-913d-90385314fd30 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:08.046134 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9bbc18f3-51fa-4b5e-913d-90385314fd30 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:08.052897 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9bbc18f3-51fa-4b5e-913d-90385314fd30 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:08.053342 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9bbc18f3-51fa-4b5e-913d-90385314fd30 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:08.054092 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9bbc18f3-51fa-4b5e-913d-90385314fd30 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:08.054519 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9bbc18f3-51fa-4b5e-913d-90385314fd30 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:08.085398 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9bbc18f3-51fa-4b5e-913d-90385314fd30 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044225 Apr 06 16:48:08.086119 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 661/1298] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:08 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:08.151371 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a2db1ea3-fddf-4d27-9918-7bdf4d7845d1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:08.152650 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a2db1ea3-fddf-4d27-9918-7bdf4d7845d1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:08.162771 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2db1ea3-fddf-4d27-9918-7bdf4d7845d1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:08.163419 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2db1ea3-fddf-4d27-9918-7bdf4d7845d1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:08.164531 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2db1ea3-fddf-4d27-9918-7bdf4d7845d1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:08.165212 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2db1ea3-fddf-4d27-9918-7bdf4d7845d1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:08.198548 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a2db1ea3-fddf-4d27-9918-7bdf4d7845d1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053570 Apr 06 16:48:08.199110 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 638/1299] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:08 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:09.098049 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eb74fc2d-a20d-4ebe-a00c-4edb48ad8907 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:09.099258 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eb74fc2d-a20d-4ebe-a00c-4edb48ad8907 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:09.105553 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb74fc2d-a20d-4ebe-a00c-4edb48ad8907 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:09.106009 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb74fc2d-a20d-4ebe-a00c-4edb48ad8907 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:09.106837 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb74fc2d-a20d-4ebe-a00c-4edb48ad8907 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:09.107289 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb74fc2d-a20d-4ebe-a00c-4edb48ad8907 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:09.137866 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eb74fc2d-a20d-4ebe-a00c-4edb48ad8907 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044478 Apr 06 16:48:09.138428 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 662/1300] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:09 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:09.214448 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7db8883f-69e3-4bd3-abef-f6d11951878b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:09.216093 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7db8883f-69e3-4bd3-abef-f6d11951878b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:09.225768 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7db8883f-69e3-4bd3-abef-f6d11951878b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:09.226242 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7db8883f-69e3-4bd3-abef-f6d11951878b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:09.227016 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7db8883f-69e3-4bd3-abef-f6d11951878b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:09.227444 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7db8883f-69e3-4bd3-abef-f6d11951878b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:09.256831 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7db8883f-69e3-4bd3-abef-f6d11951878b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049252 Apr 06 16:48:09.257534 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 639/1301] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:09 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:10.150372 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1480618b-13d6-4c36-9689-8082dfef45a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:10.152083 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1480618b-13d6-4c36-9689-8082dfef45a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:10.158899 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1480618b-13d6-4c36-9689-8082dfef45a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:10.159262 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1480618b-13d6-4c36-9689-8082dfef45a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:10.160091 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1480618b-13d6-4c36-9689-8082dfef45a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:10.160521 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1480618b-13d6-4c36-9689-8082dfef45a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:10.189994 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1480618b-13d6-4c36-9689-8082dfef45a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044267 Apr 06 16:48:10.190519 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 663/1302] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:10 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:10.268834 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6e6f293a-bfe6-470e-a2c3-96399df19716 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:10.269831 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6e6f293a-bfe6-470e-a2c3-96399df19716 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:10.277327 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e6f293a-bfe6-470e-a2c3-96399df19716 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:10.277743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e6f293a-bfe6-470e-a2c3-96399df19716 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:10.278526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e6f293a-bfe6-470e-a2c3-96399df19716 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:10.278948 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e6f293a-bfe6-470e-a2c3-96399df19716 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:10.316899 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6e6f293a-bfe6-470e-a2c3-96399df19716 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046092 Apr 06 16:48:10.316899 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 640/1303] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:10 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:11.202576 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-faa24ad4-a642-4dbe-b8b2-c5cc291d3834 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:11.203496 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-faa24ad4-a642-4dbe-b8b2-c5cc291d3834 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:11.209724 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-faa24ad4-a642-4dbe-b8b2-c5cc291d3834 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:11.210219 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-faa24ad4-a642-4dbe-b8b2-c5cc291d3834 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:11.211025 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-faa24ad4-a642-4dbe-b8b2-c5cc291d3834 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:11.211455 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-faa24ad4-a642-4dbe-b8b2-c5cc291d3834 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:11.240834 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-faa24ad4-a642-4dbe-b8b2-c5cc291d3834 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042318 Apr 06 16:48:11.244811 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 664/1304] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:11 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:11.258095 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-45268c93-c6f0-4bbe-8ba1-ef08c2778f2a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:11.258593 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-45268c93-c6f0-4bbe-8ba1-ef08c2778f2a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:11.264663 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45268c93-c6f0-4bbe-8ba1-ef08c2778f2a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:11.265144 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45268c93-c6f0-4bbe-8ba1-ef08c2778f2a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:11.265922 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45268c93-c6f0-4bbe-8ba1-ef08c2778f2a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:11.266358 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45268c93-c6f0-4bbe-8ba1-ef08c2778f2a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:11.323774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-702d7b5f-0860-420b-96aa-57a9e20a80e7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:11.332400 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-702d7b5f-0860-420b-96aa-57a9e20a80e7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:11.339175 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-702d7b5f-0860-420b-96aa-57a9e20a80e7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:11.339698 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-702d7b5f-0860-420b-96aa-57a9e20a80e7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:11.341308 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-702d7b5f-0860-420b-96aa-57a9e20a80e7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:11.341759 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-702d7b5f-0860-420b-96aa-57a9e20a80e7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:11.362048 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-45268c93-c6f0-4bbe-8ba1-ef08c2778f2a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lazy-loading 'services' on Instance uuid c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 06 16:48:11.377977 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-702d7b5f-0860-420b-96aa-57a9e20a80e7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059372 Apr 06 16:48:11.378418 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 665/1305] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:11 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:48:11.466906 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-45268c93-c6f0-4bbe-8ba1-ef08c2778f2a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce/os-volume_attachments/42f3998f-930f-4f06-9e3a-0d0607de9bea" status: 202 len: 0 microversion: 2.1 time: 0.212689 Apr 06 16:48:11.467513 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 641/1306] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Apr 6 16:48:11 2022] DELETE /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce/os-volume_attachments/42f3998f-930f-4f06-9e3a-0d0607de9bea => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 06 16:48:12.256889 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8ea68445-fae5-4d73-ad01-5c7c9d173c23 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:12.257997 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8ea68445-fae5-4d73-ad01-5c7c9d173c23 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:12.264427 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ea68445-fae5-4d73-ad01-5c7c9d173c23 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:12.264917 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ea68445-fae5-4d73-ad01-5c7c9d173c23 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:12.265685 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ea68445-fae5-4d73-ad01-5c7c9d173c23 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:12.266235 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ea68445-fae5-4d73-ad01-5c7c9d173c23 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:12.296719 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8ea68445-fae5-4d73-ad01-5c7c9d173c23 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046427 Apr 06 16:48:12.297342 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 666/1307] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:12 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:12.390288 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2f14b250-75ac-4397-aab4-f455d342d595 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:12.391375 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2f14b250-75ac-4397-aab4-f455d342d595 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:12.398829 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f14b250-75ac-4397-aab4-f455d342d595 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:12.399275 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f14b250-75ac-4397-aab4-f455d342d595 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:12.400062 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f14b250-75ac-4397-aab4-f455d342d595 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:12.400493 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f14b250-75ac-4397-aab4-f455d342d595 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:12.431190 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2f14b250-75ac-4397-aab4-f455d342d595 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045298 Apr 06 16:48:12.431748 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 642/1308] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:12 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:13.308179 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-86b1933c-b7cb-4f66-bf1b-c985c1313dfa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:13.309243 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-86b1933c-b7cb-4f66-bf1b-c985c1313dfa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:13.317826 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86b1933c-b7cb-4f66-bf1b-c985c1313dfa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:13.318269 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86b1933c-b7cb-4f66-bf1b-c985c1313dfa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:13.319037 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86b1933c-b7cb-4f66-bf1b-c985c1313dfa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:13.319454 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86b1933c-b7cb-4f66-bf1b-c985c1313dfa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:13.350167 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-86b1933c-b7cb-4f66-bf1b-c985c1313dfa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046161 Apr 06 16:48:13.350740 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 667/1309] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:13 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 06 16:48:13.446790 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-82316e7a-9c12-45c7-b787-d5977da06779 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:13.447775 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-82316e7a-9c12-45c7-b787-d5977da06779 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:13.454571 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82316e7a-9c12-45c7-b787-d5977da06779 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:13.455026 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82316e7a-9c12-45c7-b787-d5977da06779 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:13.455808 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82316e7a-9c12-45c7-b787-d5977da06779 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:13.456230 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82316e7a-9c12-45c7-b787-d5977da06779 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:13.490276 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-82316e7a-9c12-45c7-b787-d5977da06779 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049701 Apr 06 16:48:13.490866 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 643/1310] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:13 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:14.363673 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dd2e2bb8-9c9d-4a0a-bde4-756755153559 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:14.365420 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dd2e2bb8-9c9d-4a0a-bde4-756755153559 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:14.375904 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd2e2bb8-9c9d-4a0a-bde4-756755153559 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:14.376624 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd2e2bb8-9c9d-4a0a-bde4-756755153559 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:14.377877 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd2e2bb8-9c9d-4a0a-bde4-756755153559 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:14.378612 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd2e2bb8-9c9d-4a0a-bde4-756755153559 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:14.415564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dd2e2bb8-9c9d-4a0a-bde4-756755153559 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057174 Apr 06 16:48:14.416254 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 668/1311] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:14 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:14.502439 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c8fd2e52-7895-404c-a439-9383d0ff816a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:14.503370 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c8fd2e52-7895-404c-a439-9383d0ff816a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:14.511986 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8fd2e52-7895-404c-a439-9383d0ff816a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:14.511986 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8fd2e52-7895-404c-a439-9383d0ff816a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:14.512826 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8fd2e52-7895-404c-a439-9383d0ff816a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:14.513270 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8fd2e52-7895-404c-a439-9383d0ff816a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:14.549763 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c8fd2e52-7895-404c-a439-9383d0ff816a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051471 Apr 06 16:48:14.550350 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 644/1312] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:14 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:15.427034 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a892df2d-fbfb-4df2-9375-c137b32e7fe5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:15.427997 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a892df2d-fbfb-4df2-9375-c137b32e7fe5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:15.434890 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a892df2d-fbfb-4df2-9375-c137b32e7fe5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:15.435316 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a892df2d-fbfb-4df2-9375-c137b32e7fe5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:15.436151 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a892df2d-fbfb-4df2-9375-c137b32e7fe5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:15.436581 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a892df2d-fbfb-4df2-9375-c137b32e7fe5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:15.475341 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a892df2d-fbfb-4df2-9375-c137b32e7fe5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052382 Apr 06 16:48:15.475942 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 669/1313] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:15 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:15.562553 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-05cb0f5e-8b87-4e2c-8924-4829c0a8c67a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:15.563523 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-05cb0f5e-8b87-4e2c-8924-4829c0a8c67a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:15.570141 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05cb0f5e-8b87-4e2c-8924-4829c0a8c67a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:15.570587 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05cb0f5e-8b87-4e2c-8924-4829c0a8c67a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:15.571669 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05cb0f5e-8b87-4e2c-8924-4829c0a8c67a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:15.572110 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05cb0f5e-8b87-4e2c-8924-4829c0a8c67a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:15.601599 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-05cb0f5e-8b87-4e2c-8924-4829c0a8c67a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043450 Apr 06 16:48:15.602292 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 645/1314] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:15 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:16.489684 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2b650ce3-8bea-4749-931d-6bdf1e479772 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:16.490992 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2b650ce3-8bea-4749-931d-6bdf1e479772 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:16.500208 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b650ce3-8bea-4749-931d-6bdf1e479772 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:16.501003 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b650ce3-8bea-4749-931d-6bdf1e479772 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:16.502446 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b650ce3-8bea-4749-931d-6bdf1e479772 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:16.502938 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b650ce3-8bea-4749-931d-6bdf1e479772 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:16.542042 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2b650ce3-8bea-4749-931d-6bdf1e479772 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058139 Apr 06 16:48:16.542614 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 670/1315] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:16 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:16.614556 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ed057c27-2c7e-4253-9a9c-3b61482945a4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:16.615388 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ed057c27-2c7e-4253-9a9c-3b61482945a4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:16.622343 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed057c27-2c7e-4253-9a9c-3b61482945a4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:16.622791 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed057c27-2c7e-4253-9a9c-3b61482945a4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:16.623560 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed057c27-2c7e-4253-9a9c-3b61482945a4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:16.623982 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed057c27-2c7e-4253-9a9c-3b61482945a4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:16.653771 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ed057c27-2c7e-4253-9a9c-3b61482945a4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043688 Apr 06 16:48:16.654361 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 646/1316] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:16 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:17.554514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1a7d3cc4-0a3b-43cf-aff9-4a2942a8c156 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:17.555546 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1a7d3cc4-0a3b-43cf-aff9-4a2942a8c156 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:17.563466 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a7d3cc4-0a3b-43cf-aff9-4a2942a8c156 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:17.563988 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a7d3cc4-0a3b-43cf-aff9-4a2942a8c156 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:17.565983 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a7d3cc4-0a3b-43cf-aff9-4a2942a8c156 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:17.566511 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a7d3cc4-0a3b-43cf-aff9-4a2942a8c156 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:17.599284 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1a7d3cc4-0a3b-43cf-aff9-4a2942a8c156 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049093 Apr 06 16:48:17.599857 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 671/1317] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:17 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:17.666819 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-62d14c2c-4cdb-4025-a1dd-73496e060a4a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:17.667743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-62d14c2c-4cdb-4025-a1dd-73496e060a4a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:17.674487 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62d14c2c-4cdb-4025-a1dd-73496e060a4a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:17.674933 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62d14c2c-4cdb-4025-a1dd-73496e060a4a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:17.675701 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62d14c2c-4cdb-4025-a1dd-73496e060a4a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:17.676124 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62d14c2c-4cdb-4025-a1dd-73496e060a4a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:17.705555 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-62d14c2c-4cdb-4025-a1dd-73496e060a4a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043031 Apr 06 16:48:17.706117 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 647/1318] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:17 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:18.612243 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8e27256d-7f94-47d3-875f-f5906f9747ea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:18.614213 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8e27256d-7f94-47d3-875f-f5906f9747ea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:18.621694 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e27256d-7f94-47d3-875f-f5906f9747ea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:18.622161 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e27256d-7f94-47d3-875f-f5906f9747ea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:18.622935 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e27256d-7f94-47d3-875f-f5906f9747ea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:18.623362 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e27256d-7f94-47d3-875f-f5906f9747ea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:18.655757 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8e27256d-7f94-47d3-875f-f5906f9747ea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047801 Apr 06 16:48:18.656315 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 672/1319] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:18 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:18.718024 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-15dcab83-9e1a-4325-9640-91ebd74a4680 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:18.719046 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-15dcab83-9e1a-4325-9640-91ebd74a4680 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:18.725906 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15dcab83-9e1a-4325-9640-91ebd74a4680 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:18.726355 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15dcab83-9e1a-4325-9640-91ebd74a4680 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:18.727262 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15dcab83-9e1a-4325-9640-91ebd74a4680 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:18.727700 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15dcab83-9e1a-4325-9640-91ebd74a4680 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:18.758859 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-15dcab83-9e1a-4325-9640-91ebd74a4680 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044902 Apr 06 16:48:18.759435 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 648/1320] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:18 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:19.667958 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-04c12ca4-f182-47c1-b2bd-8fd25da13b11 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:19.668930 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-04c12ca4-f182-47c1-b2bd-8fd25da13b11 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:19.675143 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04c12ca4-f182-47c1-b2bd-8fd25da13b11 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:19.675611 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04c12ca4-f182-47c1-b2bd-8fd25da13b11 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:19.676381 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04c12ca4-f182-47c1-b2bd-8fd25da13b11 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:19.676866 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04c12ca4-f182-47c1-b2bd-8fd25da13b11 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:19.706383 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-04c12ca4-f182-47c1-b2bd-8fd25da13b11 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042700 Apr 06 16:48:19.706936 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 673/1321] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:19 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:19.774738 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d417b67f-e18e-43ee-8468-2183628a0427 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:19.775860 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d417b67f-e18e-43ee-8468-2183628a0427 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:19.783657 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d417b67f-e18e-43ee-8468-2183628a0427 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:19.784250 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d417b67f-e18e-43ee-8468-2183628a0427 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:19.785200 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d417b67f-e18e-43ee-8468-2183628a0427 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:19.785710 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d417b67f-e18e-43ee-8468-2183628a0427 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:19.818377 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d417b67f-e18e-43ee-8468-2183628a0427 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050105 Apr 06 16:48:19.818924 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 649/1322] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:19 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:20.719712 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d690df13-fe84-4167-b450-a4bd8f5bca6c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:20.720714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d690df13-fe84-4167-b450-a4bd8f5bca6c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:20.728418 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d690df13-fe84-4167-b450-a4bd8f5bca6c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:20.728914 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d690df13-fe84-4167-b450-a4bd8f5bca6c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:20.729792 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d690df13-fe84-4167-b450-a4bd8f5bca6c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:20.730386 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d690df13-fe84-4167-b450-a4bd8f5bca6c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:20.764997 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d690df13-fe84-4167-b450-a4bd8f5bca6c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049884 Apr 06 16:48:20.765569 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 674/1323] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:20 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:20.830018 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-76c10365-e64f-45fb-906f-3c502d5b007a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:20.830941 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-76c10365-e64f-45fb-906f-3c502d5b007a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:20.838038 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76c10365-e64f-45fb-906f-3c502d5b007a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:20.838499 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76c10365-e64f-45fb-906f-3c502d5b007a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:20.839271 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76c10365-e64f-45fb-906f-3c502d5b007a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:20.839711 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76c10365-e64f-45fb-906f-3c502d5b007a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:20.871091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-76c10365-e64f-45fb-906f-3c502d5b007a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045037 Apr 06 16:48:20.871659 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 650/1324] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:20 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:21.777806 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-38313dd9-1372-44d2-9dbf-b19ac23b6826 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:21.778753 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-38313dd9-1372-44d2-9dbf-b19ac23b6826 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:21.789038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38313dd9-1372-44d2-9dbf-b19ac23b6826 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:21.789570 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38313dd9-1372-44d2-9dbf-b19ac23b6826 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:21.790627 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38313dd9-1372-44d2-9dbf-b19ac23b6826 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:21.791054 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38313dd9-1372-44d2-9dbf-b19ac23b6826 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:21.821239 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-38313dd9-1372-44d2-9dbf-b19ac23b6826 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047390 Apr 06 16:48:21.821817 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 675/1325] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:21 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:21.885604 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-86cab4f7-e26e-4a4b-a652-1dac0650ac19 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:21.886538 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-86cab4f7-e26e-4a4b-a652-1dac0650ac19 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:21.893637 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86cab4f7-e26e-4a4b-a652-1dac0650ac19 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:21.894091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86cab4f7-e26e-4a4b-a652-1dac0650ac19 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:21.894875 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86cab4f7-e26e-4a4b-a652-1dac0650ac19 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:21.895309 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86cab4f7-e26e-4a4b-a652-1dac0650ac19 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:21.925319 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-86cab4f7-e26e-4a4b-a652-1dac0650ac19 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043924 Apr 06 16:48:21.925921 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 651/1326] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:21 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:22.833016 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-12f75c6e-a985-4fe6-a051-67557440b6d2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:22.834633 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-12f75c6e-a985-4fe6-a051-67557440b6d2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:22.840577 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12f75c6e-a985-4fe6-a051-67557440b6d2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:22.841057 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12f75c6e-a985-4fe6-a051-67557440b6d2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:22.841821 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12f75c6e-a985-4fe6-a051-67557440b6d2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:22.842247 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12f75c6e-a985-4fe6-a051-67557440b6d2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:22.871576 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-12f75c6e-a985-4fe6-a051-67557440b6d2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042549 Apr 06 16:48:22.872146 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 676/1327] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:22 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:22.937478 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-112bd6c3-082f-48ca-846a-5bec3374e438 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:22.938598 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-112bd6c3-082f-48ca-846a-5bec3374e438 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:22.947128 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-112bd6c3-082f-48ca-846a-5bec3374e438 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:22.947863 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-112bd6c3-082f-48ca-846a-5bec3374e438 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:22.949209 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-112bd6c3-082f-48ca-846a-5bec3374e438 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:22.949934 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-112bd6c3-082f-48ca-846a-5bec3374e438 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:22.987761 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-112bd6c3-082f-48ca-846a-5bec3374e438 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054251 Apr 06 16:48:22.988337 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 652/1328] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:22 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:23.883776 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cd94a241-b692-4bc1-ba78-be77c0b36d93 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:23.884601 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cd94a241-b692-4bc1-ba78-be77c0b36d93 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:23.891072 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd94a241-b692-4bc1-ba78-be77c0b36d93 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:23.891519 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd94a241-b692-4bc1-ba78-be77c0b36d93 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:23.892352 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd94a241-b692-4bc1-ba78-be77c0b36d93 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:23.892838 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd94a241-b692-4bc1-ba78-be77c0b36d93 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:23.921870 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cd94a241-b692-4bc1-ba78-be77c0b36d93 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042293 Apr 06 16:48:23.922393 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 677/1329] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:23 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:24.003594 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7061a1b2-a15f-4a2c-85a0-b97e8c7c8995 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:24.004963 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7061a1b2-a15f-4a2c-85a0-b97e8c7c8995 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:24.012618 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7061a1b2-a15f-4a2c-85a0-b97e8c7c8995 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:24.013107 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7061a1b2-a15f-4a2c-85a0-b97e8c7c8995 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:24.013872 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7061a1b2-a15f-4a2c-85a0-b97e8c7c8995 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:24.014294 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7061a1b2-a15f-4a2c-85a0-b97e8c7c8995 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:24.043300 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7061a1b2-a15f-4a2c-85a0-b97e8c7c8995 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045345 Apr 06 16:48:24.043934 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 653/1330] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:23 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:24.933712 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-19e3d74f-dcf3-4336-af8a-44f77537d858 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:24.934636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-19e3d74f-dcf3-4336-af8a-44f77537d858 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:24.941135 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19e3d74f-dcf3-4336-af8a-44f77537d858 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:24.941584 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19e3d74f-dcf3-4336-af8a-44f77537d858 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:24.942530 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19e3d74f-dcf3-4336-af8a-44f77537d858 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:24.943195 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19e3d74f-dcf3-4336-af8a-44f77537d858 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:24.974153 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-19e3d74f-dcf3-4336-af8a-44f77537d858 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044360 Apr 06 16:48:24.974998 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 678/1331] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:24 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:25.057381 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a264d876-88cd-4d1d-ad09-ff2662f99f98 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:25.058542 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a264d876-88cd-4d1d-ad09-ff2662f99f98 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:25.065380 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a264d876-88cd-4d1d-ad09-ff2662f99f98 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:25.065904 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a264d876-88cd-4d1d-ad09-ff2662f99f98 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:25.066744 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a264d876-88cd-4d1d-ad09-ff2662f99f98 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:25.067263 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a264d876-88cd-4d1d-ad09-ff2662f99f98 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:25.097518 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a264d876-88cd-4d1d-ad09-ff2662f99f98 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045414 Apr 06 16:48:25.098076 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 654/1332] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:25 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:25.829734 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 16:48:25.829734 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 16:48:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 16:48:25.986874 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-70ef40d1-598e-42f6-86ef-d26a959745a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:25.987798 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-70ef40d1-598e-42f6-86ef-d26a959745a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:25.994402 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70ef40d1-598e-42f6-86ef-d26a959745a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:25.994857 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70ef40d1-598e-42f6-86ef-d26a959745a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:25.995639 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70ef40d1-598e-42f6-86ef-d26a959745a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:25.996075 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70ef40d1-598e-42f6-86ef-d26a959745a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:26.026112 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-70ef40d1-598e-42f6-86ef-d26a959745a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043611 Apr 06 16:48:26.026685 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 679/1333] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:25 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:26.110379 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-169813a6-bf46-47da-b63e-58f26aeac187 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:26.111209 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-169813a6-bf46-47da-b63e-58f26aeac187 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:26.117850 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-169813a6-bf46-47da-b63e-58f26aeac187 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:26.118310 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-169813a6-bf46-47da-b63e-58f26aeac187 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:26.119065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-169813a6-bf46-47da-b63e-58f26aeac187 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:26.119493 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-169813a6-bf46-47da-b63e-58f26aeac187 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:26.148492 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-169813a6-bf46-47da-b63e-58f26aeac187 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042572 Apr 06 16:48:26.149118 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 655/1334] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:26 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:27.038425 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a9320e3f-8822-4404-94ca-c62a8a3ec64d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:27.039668 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a9320e3f-8822-4404-94ca-c62a8a3ec64d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:27.046663 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9320e3f-8822-4404-94ca-c62a8a3ec64d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:27.047111 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9320e3f-8822-4404-94ca-c62a8a3ec64d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:27.047893 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9320e3f-8822-4404-94ca-c62a8a3ec64d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:27.048296 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9320e3f-8822-4404-94ca-c62a8a3ec64d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:27.081548 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a9320e3f-8822-4404-94ca-c62a8a3ec64d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047282 Apr 06 16:48:27.082132 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 680/1335] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:27 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:27.163320 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-88729900-d6b9-41de-a803-d8cf409ab0b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:27.164972 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-88729900-d6b9-41de-a803-d8cf409ab0b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:27.171658 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88729900-d6b9-41de-a803-d8cf409ab0b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:27.172107 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88729900-d6b9-41de-a803-d8cf409ab0b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:27.172918 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88729900-d6b9-41de-a803-d8cf409ab0b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:27.173354 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88729900-d6b9-41de-a803-d8cf409ab0b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:27.204817 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-88729900-d6b9-41de-a803-d8cf409ab0b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048026 Apr 06 16:48:27.205386 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 656/1336] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:27 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:28.093934 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d64cad37-1268-4a9b-ab45-a1cd2b33fe5d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:28.094840 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d64cad37-1268-4a9b-ab45-a1cd2b33fe5d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:28.101667 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d64cad37-1268-4a9b-ab45-a1cd2b33fe5d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:28.101893 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d64cad37-1268-4a9b-ab45-a1cd2b33fe5d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:28.102719 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d64cad37-1268-4a9b-ab45-a1cd2b33fe5d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:28.103148 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d64cad37-1268-4a9b-ab45-a1cd2b33fe5d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:28.133442 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d64cad37-1268-4a9b-ab45-a1cd2b33fe5d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043741 Apr 06 16:48:28.133989 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 681/1337] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:28 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:28.217599 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8d10bf3b-a2a2-4674-9962-206f57643ca7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:28.218523 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8d10bf3b-a2a2-4674-9962-206f57643ca7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:28.225431 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d10bf3b-a2a2-4674-9962-206f57643ca7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:28.225875 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d10bf3b-a2a2-4674-9962-206f57643ca7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:28.226645 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d10bf3b-a2a2-4674-9962-206f57643ca7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:28.227072 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d10bf3b-a2a2-4674-9962-206f57643ca7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:28.257702 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8d10bf3b-a2a2-4674-9962-206f57643ca7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043933 Apr 06 16:48:28.258254 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 657/1338] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:28 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:29.147220 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-100521ba-b0ff-460d-bbfc-71d5ffccc220 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:29.148133 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-100521ba-b0ff-460d-bbfc-71d5ffccc220 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:29.155190 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-100521ba-b0ff-460d-bbfc-71d5ffccc220 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:29.155635 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-100521ba-b0ff-460d-bbfc-71d5ffccc220 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:29.156420 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-100521ba-b0ff-460d-bbfc-71d5ffccc220 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:29.157140 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-100521ba-b0ff-460d-bbfc-71d5ffccc220 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:29.188023 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-100521ba-b0ff-460d-bbfc-71d5ffccc220 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045094 Apr 06 16:48:29.188572 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 682/1339] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:29 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:29.271522 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ce4a9a8d-d2c3-4945-b0f8-0dd8229fb808 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:29.273136 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ce4a9a8d-d2c3-4945-b0f8-0dd8229fb808 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:29.283858 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce4a9a8d-d2c3-4945-b0f8-0dd8229fb808 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:29.284557 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce4a9a8d-d2c3-4945-b0f8-0dd8229fb808 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:29.285852 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce4a9a8d-d2c3-4945-b0f8-0dd8229fb808 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:29.286540 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce4a9a8d-d2c3-4945-b0f8-0dd8229fb808 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:29.317672 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ce4a9a8d-d2c3-4945-b0f8-0dd8229fb808 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052445 Apr 06 16:48:29.318255 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 658/1340] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:29 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:30.200156 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-90e64a89-1201-4fea-8014-6e3bfab70458 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:30.201112 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-90e64a89-1201-4fea-8014-6e3bfab70458 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:30.207582 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90e64a89-1201-4fea-8014-6e3bfab70458 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:30.208033 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90e64a89-1201-4fea-8014-6e3bfab70458 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:30.208840 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90e64a89-1201-4fea-8014-6e3bfab70458 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:30.209272 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90e64a89-1201-4fea-8014-6e3bfab70458 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:30.239336 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-90e64a89-1201-4fea-8014-6e3bfab70458 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043154 Apr 06 16:48:30.239904 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 683/1341] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:30 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:30.329954 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6755ef1d-3d3d-4b39-a21c-791708d90136 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:30.331405 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6755ef1d-3d3d-4b39-a21c-791708d90136 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:30.337871 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6755ef1d-3d3d-4b39-a21c-791708d90136 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:30.338323 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6755ef1d-3d3d-4b39-a21c-791708d90136 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:30.339080 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6755ef1d-3d3d-4b39-a21c-791708d90136 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:30.339515 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6755ef1d-3d3d-4b39-a21c-791708d90136 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:30.370367 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6755ef1d-3d3d-4b39-a21c-791708d90136 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044512 Apr 06 16:48:30.370935 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 659/1342] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:30 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:31.252194 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e5562e6d-6d27-4ff6-87bd-3a4e7a3cb0c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:31.253191 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e5562e6d-6d27-4ff6-87bd-3a4e7a3cb0c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:31.260175 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5562e6d-6d27-4ff6-87bd-3a4e7a3cb0c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:31.260629 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5562e6d-6d27-4ff6-87bd-3a4e7a3cb0c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:31.261440 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5562e6d-6d27-4ff6-87bd-3a4e7a3cb0c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:31.261871 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5562e6d-6d27-4ff6-87bd-3a4e7a3cb0c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:31.294078 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e5562e6d-6d27-4ff6-87bd-3a4e7a3cb0c1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045861 Apr 06 16:48:31.294716 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 684/1343] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:31 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:31.382310 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-011f3da5-faae-4c23-bc35-b82e4deb688e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:31.383393 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-011f3da5-faae-4c23-bc35-b82e4deb688e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:31.390194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-011f3da5-faae-4c23-bc35-b82e4deb688e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:31.390641 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-011f3da5-faae-4c23-bc35-b82e4deb688e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:31.391406 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-011f3da5-faae-4c23-bc35-b82e4deb688e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:31.391835 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-011f3da5-faae-4c23-bc35-b82e4deb688e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:31.423192 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-011f3da5-faae-4c23-bc35-b82e4deb688e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044849 Apr 06 16:48:31.423780 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 660/1344] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:31 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:32.306535 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b7ed6044-81ef-48c7-9cbc-d8b8465ab3f1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:32.307574 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b7ed6044-81ef-48c7-9cbc-d8b8465ab3f1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:32.314220 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7ed6044-81ef-48c7-9cbc-d8b8465ab3f1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:32.314665 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7ed6044-81ef-48c7-9cbc-d8b8465ab3f1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:32.315532 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7ed6044-81ef-48c7-9cbc-d8b8465ab3f1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:32.315870 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7ed6044-81ef-48c7-9cbc-d8b8465ab3f1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:32.346616 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b7ed6044-81ef-48c7-9cbc-d8b8465ab3f1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044318 Apr 06 16:48:32.347180 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 685/1345] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:32 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:32.435781 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-96db07fa-91d3-4fb2-bb47-86746a015585 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:32.436963 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-96db07fa-91d3-4fb2-bb47-86746a015585 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:32.443910 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96db07fa-91d3-4fb2-bb47-86746a015585 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:32.444362 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96db07fa-91d3-4fb2-bb47-86746a015585 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:32.445273 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96db07fa-91d3-4fb2-bb47-86746a015585 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:32.445768 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96db07fa-91d3-4fb2-bb47-86746a015585 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:32.476463 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-96db07fa-91d3-4fb2-bb47-86746a015585 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044723 Apr 06 16:48:32.477163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 661/1346] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:32 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:33.359054 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-decbf5cc-96fb-4a3a-b65d-b1af675b4ae1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:33.360360 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-decbf5cc-96fb-4a3a-b65d-b1af675b4ae1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:33.366794 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-decbf5cc-96fb-4a3a-b65d-b1af675b4ae1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:33.367461 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-decbf5cc-96fb-4a3a-b65d-b1af675b4ae1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:33.368582 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-decbf5cc-96fb-4a3a-b65d-b1af675b4ae1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:33.369019 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-decbf5cc-96fb-4a3a-b65d-b1af675b4ae1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:33.402531 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-decbf5cc-96fb-4a3a-b65d-b1af675b4ae1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047440 Apr 06 16:48:33.403142 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 686/1347] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:33 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:33.490276 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d88c7d1e-a3be-4820-b6c7-29e5b504d22c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:33.491378 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d88c7d1e-a3be-4820-b6c7-29e5b504d22c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:33.498352 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d88c7d1e-a3be-4820-b6c7-29e5b504d22c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:33.498805 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d88c7d1e-a3be-4820-b6c7-29e5b504d22c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:33.499594 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d88c7d1e-a3be-4820-b6c7-29e5b504d22c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:33.500170 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d88c7d1e-a3be-4820-b6c7-29e5b504d22c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:33.531367 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d88c7d1e-a3be-4820-b6c7-29e5b504d22c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046607 Apr 06 16:48:33.531916 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 662/1348] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:33 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:34.415443 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c2a31f86-b8c8-42c2-aa70-31258f2e7b90 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:34.416478 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c2a31f86-b8c8-42c2-aa70-31258f2e7b90 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:34.423543 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2a31f86-b8c8-42c2-aa70-31258f2e7b90 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:34.424061 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2a31f86-b8c8-42c2-aa70-31258f2e7b90 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:34.425065 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2a31f86-b8c8-42c2-aa70-31258f2e7b90 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:34.425587 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2a31f86-b8c8-42c2-aa70-31258f2e7b90 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:34.456343 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c2a31f86-b8c8-42c2-aa70-31258f2e7b90 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046058 Apr 06 16:48:34.456890 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 687/1349] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:34 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:34.544106 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-74f1e410-d5ab-4f70-8df7-8c5bb49c0253 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:34.545095 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-74f1e410-d5ab-4f70-8df7-8c5bb49c0253 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:34.552341 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74f1e410-d5ab-4f70-8df7-8c5bb49c0253 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:34.552913 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74f1e410-d5ab-4f70-8df7-8c5bb49c0253 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:34.553690 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74f1e410-d5ab-4f70-8df7-8c5bb49c0253 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:34.554649 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74f1e410-d5ab-4f70-8df7-8c5bb49c0253 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:34.587194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-74f1e410-d5ab-4f70-8df7-8c5bb49c0253 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047096 Apr 06 16:48:34.587687 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 663/1350] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:34 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:35.470629 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-476c9123-caac-4503-a731-93c2f5f19252 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:35.471554 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-476c9123-caac-4503-a731-93c2f5f19252 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:35.477998 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-476c9123-caac-4503-a731-93c2f5f19252 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:35.478462 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-476c9123-caac-4503-a731-93c2f5f19252 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:35.479214 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-476c9123-caac-4503-a731-93c2f5f19252 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:35.479595 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-476c9123-caac-4503-a731-93c2f5f19252 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:35.510354 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-476c9123-caac-4503-a731-93c2f5f19252 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045120 Apr 06 16:48:35.510938 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 688/1351] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:35 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:35.601481 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3c6fa59d-e270-4f4f-8b44-97478a080e14 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:35.602508 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3c6fa59d-e270-4f4f-8b44-97478a080e14 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:35.609895 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c6fa59d-e270-4f4f-8b44-97478a080e14 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:35.610373 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c6fa59d-e270-4f4f-8b44-97478a080e14 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:35.611161 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c6fa59d-e270-4f4f-8b44-97478a080e14 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:35.611590 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c6fa59d-e270-4f4f-8b44-97478a080e14 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:35.643711 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3c6fa59d-e270-4f4f-8b44-97478a080e14 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046486 Apr 06 16:48:35.644313 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 664/1352] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:35 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:36.523991 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-52f1b020-0890-49ae-bcb4-3da115942d94 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:36.523991 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-52f1b020-0890-49ae-bcb4-3da115942d94 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:36.530410 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52f1b020-0890-49ae-bcb4-3da115942d94 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:36.530860 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52f1b020-0890-49ae-bcb4-3da115942d94 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:36.531631 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52f1b020-0890-49ae-bcb4-3da115942d94 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:36.532063 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52f1b020-0890-49ae-bcb4-3da115942d94 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:36.566843 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-52f1b020-0890-49ae-bcb4-3da115942d94 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047946 Apr 06 16:48:36.567459 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 689/1353] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:36 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:36.656136 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-35232a9b-a8e9-4185-a1f1-2cae777cb83f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:36.657128 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-35232a9b-a8e9-4185-a1f1-2cae777cb83f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:36.664114 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35232a9b-a8e9-4185-a1f1-2cae777cb83f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:36.665002 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35232a9b-a8e9-4185-a1f1-2cae777cb83f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:36.665791 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35232a9b-a8e9-4185-a1f1-2cae777cb83f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:36.666231 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35232a9b-a8e9-4185-a1f1-2cae777cb83f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:36.696144 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-35232a9b-a8e9-4185-a1f1-2cae777cb83f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043958 Apr 06 16:48:36.696814 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 665/1354] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:36 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:37.579389 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d12b93c1-1525-44a5-a17b-1c5e8de4bf0c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:37.580207 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d12b93c1-1525-44a5-a17b-1c5e8de4bf0c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:37.586807 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d12b93c1-1525-44a5-a17b-1c5e8de4bf0c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:37.587247 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d12b93c1-1525-44a5-a17b-1c5e8de4bf0c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:37.587990 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d12b93c1-1525-44a5-a17b-1c5e8de4bf0c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:37.588450 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d12b93c1-1525-44a5-a17b-1c5e8de4bf0c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:37.619496 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d12b93c1-1525-44a5-a17b-1c5e8de4bf0c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044292 Apr 06 16:48:37.620328 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 690/1355] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:37 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:37.710034 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-19bb7a4e-75e6-48c0-b66f-94e6ab636d40 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:37.710970 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-19bb7a4e-75e6-48c0-b66f-94e6ab636d40 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:37.718385 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19bb7a4e-75e6-48c0-b66f-94e6ab636d40 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:37.718842 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19bb7a4e-75e6-48c0-b66f-94e6ab636d40 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:37.719626 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19bb7a4e-75e6-48c0-b66f-94e6ab636d40 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:37.720070 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19bb7a4e-75e6-48c0-b66f-94e6ab636d40 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:37.752337 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-19bb7a4e-75e6-48c0-b66f-94e6ab636d40 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046325 Apr 06 16:48:37.753072 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 666/1356] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:37 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:38.117419 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 16:48:38.117669 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 16:48:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 16:48:38.631946 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-745b0a24-1945-4ab0-baee-843e441fa909 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:38.632810 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-745b0a24-1945-4ab0-baee-843e441fa909 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:38.639679 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-745b0a24-1945-4ab0-baee-843e441fa909 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:38.640132 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-745b0a24-1945-4ab0-baee-843e441fa909 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:38.641043 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-745b0a24-1945-4ab0-baee-843e441fa909 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:38.641483 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-745b0a24-1945-4ab0-baee-843e441fa909 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:38.672096 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-745b0a24-1945-4ab0-baee-843e441fa909 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044246 Apr 06 16:48:38.672674 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 691/1357] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:38 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:38.764992 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-07da86ad-c0e6-4b38-b07b-de8f3b0d101f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:38.765991 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-07da86ad-c0e6-4b38-b07b-de8f3b0d101f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:38.772730 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07da86ad-c0e6-4b38-b07b-de8f3b0d101f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:38.773196 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07da86ad-c0e6-4b38-b07b-de8f3b0d101f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:38.774075 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07da86ad-c0e6-4b38-b07b-de8f3b0d101f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:38.774655 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07da86ad-c0e6-4b38-b07b-de8f3b0d101f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:38.804650 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-07da86ad-c0e6-4b38-b07b-de8f3b0d101f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044040 Apr 06 16:48:38.805680 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 667/1358] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:38 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:39.688769 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7e758145-1069-4a2f-900b-87e136ebe72a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:39.690244 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7e758145-1069-4a2f-900b-87e136ebe72a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:39.699284 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e758145-1069-4a2f-900b-87e136ebe72a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:39.699735 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e758145-1069-4a2f-900b-87e136ebe72a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:39.700502 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e758145-1069-4a2f-900b-87e136ebe72a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:39.700969 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e758145-1069-4a2f-900b-87e136ebe72a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:39.732321 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7e758145-1069-4a2f-900b-87e136ebe72a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050517 Apr 06 16:48:39.732987 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 692/1359] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Apr 6 16:48:39 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:48:39.818284 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ea0729bc-da4f-42d4-9e31-fc0261a4952c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:39.819392 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ea0729bc-da4f-42d4-9e31-fc0261a4952c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:39.826094 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea0729bc-da4f-42d4-9e31-fc0261a4952c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:39.826534 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea0729bc-da4f-42d4-9e31-fc0261a4952c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:39.827259 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea0729bc-da4f-42d4-9e31-fc0261a4952c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:39.827711 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea0729bc-da4f-42d4-9e31-fc0261a4952c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:39.856930 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ea0729bc-da4f-42d4-9e31-fc0261a4952c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042616 Apr 06 16:48:39.857498 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 668/1360] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:39 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:40.746658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2af7c0dd-0eb6-446b-95dc-97bd42b1e23f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:48:40.747774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2af7c0dd-0eb6-446b-95dc-97bd42b1e23f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:40.754117 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2af7c0dd-0eb6-446b-95dc-97bd42b1e23f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:40.754570 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2af7c0dd-0eb6-446b-95dc-97bd42b1e23f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:40.755335 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2af7c0dd-0eb6-446b-95dc-97bd42b1e23f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:40.755773 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2af7c0dd-0eb6-446b-95dc-97bd42b1e23f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:40.794333 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2af7c0dd-0eb6-446b-95dc-97bd42b1e23f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [7fba79a3-51b0-4393-b1a4-1ddd315d83c8] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 06 16:48:40.871208 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-82b21db9-fcd0-4541-8166-9d9bb00cfec8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:40.872136 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-82b21db9-fcd0-4541-8166-9d9bb00cfec8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:40.878938 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82b21db9-fcd0-4541-8166-9d9bb00cfec8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:40.879386 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82b21db9-fcd0-4541-8166-9d9bb00cfec8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:40.880190 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82b21db9-fcd0-4541-8166-9d9bb00cfec8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:40.880624 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82b21db9-fcd0-4541-8166-9d9bb00cfec8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:40.910051 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-82b21db9-fcd0-4541-8166-9d9bb00cfec8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043211 Apr 06 16:48:40.910605 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 669/1361] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:40 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:41.803374 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [None req-2af7c0dd-0eb6-446b-95dc-97bd42b1e23f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [7fba79a3-51b0-4393-b1a4-1ddd315d83c8] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 60628. Apr 06 16:48:41.869671 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2af7c0dd-0eb6-446b-95dc-97bd42b1e23f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "POST /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/action" status: 200 len: 37920 microversion: 2.20 time: 1.127540 Apr 06 16:48:41.870335 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 693/1362] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Apr 6 16:48:40 2022] POST /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c/action => generated 37920 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 06 16:48:41.921783 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-de70e2e6-42fe-4331-ada6-c155ce13a8da tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:41.922724 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-de70e2e6-42fe-4331-ada6-c155ce13a8da tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:41.929209 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de70e2e6-42fe-4331-ada6-c155ce13a8da tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:41.929704 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de70e2e6-42fe-4331-ada6-c155ce13a8da tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:41.930695 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de70e2e6-42fe-4331-ada6-c155ce13a8da tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:41.931180 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de70e2e6-42fe-4331-ada6-c155ce13a8da tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:41.961678 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-de70e2e6-42fe-4331-ada6-c155ce13a8da tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043841 Apr 06 16:48:41.962252 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 670/1363] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:41 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:43.047234 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-99a081c8-bd1e-4809-94f4-1d088bf7aff1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:43.048301 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-99a081c8-bd1e-4809-94f4-1d088bf7aff1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:43.054953 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99a081c8-bd1e-4809-94f4-1d088bf7aff1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:43.055708 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99a081c8-bd1e-4809-94f4-1d088bf7aff1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:43.056488 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99a081c8-bd1e-4809-94f4-1d088bf7aff1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:43.056951 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99a081c8-bd1e-4809-94f4-1d088bf7aff1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:43.086515 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-99a081c8-bd1e-4809-94f4-1d088bf7aff1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116003 Apr 06 16:48:43.087537 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 694/1364] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:42 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:44.099867 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f0afe27b-1fc2-4c15-80f8-b8d06fb21b56 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:44.100826 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f0afe27b-1fc2-4c15-80f8-b8d06fb21b56 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:44.108021 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0afe27b-1fc2-4c15-80f8-b8d06fb21b56 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:44.108459 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0afe27b-1fc2-4c15-80f8-b8d06fb21b56 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:44.109766 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0afe27b-1fc2-4c15-80f8-b8d06fb21b56 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:44.110025 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0afe27b-1fc2-4c15-80f8-b8d06fb21b56 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:44.143137 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f0afe27b-1fc2-4c15-80f8-b8d06fb21b56 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047920 Apr 06 16:48:44.143695 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 671/1365] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:44 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:45.155245 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c690c9af-a77e-4276-a407-bd121ec0111d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:45.156158 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c690c9af-a77e-4276-a407-bd121ec0111d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:45.163473 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c690c9af-a77e-4276-a407-bd121ec0111d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:45.164021 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c690c9af-a77e-4276-a407-bd121ec0111d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:45.164896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c690c9af-a77e-4276-a407-bd121ec0111d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:45.165356 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c690c9af-a77e-4276-a407-bd121ec0111d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:45.195621 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c690c9af-a77e-4276-a407-bd121ec0111d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044212 Apr 06 16:48:45.196173 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 695/1366] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:45 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:46.207864 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1dc07290-275e-430b-bf35-caeef5f35440 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:46.208868 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1dc07290-275e-430b-bf35-caeef5f35440 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:46.221045 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dc07290-275e-430b-bf35-caeef5f35440 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:46.221510 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dc07290-275e-430b-bf35-caeef5f35440 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:46.222367 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dc07290-275e-430b-bf35-caeef5f35440 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:46.222729 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dc07290-275e-430b-bf35-caeef5f35440 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:46.256058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1dc07290-275e-430b-bf35-caeef5f35440 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052263 Apr 06 16:48:46.256632 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 672/1367] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:46 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:47.268025 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-59984c77-91b1-46a5-b3a6-cdc078704a09 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:47.269090 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-59984c77-91b1-46a5-b3a6-cdc078704a09 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:47.275877 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59984c77-91b1-46a5-b3a6-cdc078704a09 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:47.276335 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59984c77-91b1-46a5-b3a6-cdc078704a09 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:47.277121 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59984c77-91b1-46a5-b3a6-cdc078704a09 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:47.277548 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59984c77-91b1-46a5-b3a6-cdc078704a09 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:47.306753 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-59984c77-91b1-46a5-b3a6-cdc078704a09 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042984 Apr 06 16:48:47.307368 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 696/1368] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:47 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:48.318663 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c23499cd-65b9-4352-9cbe-fb15310b55f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:48.319590 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c23499cd-65b9-4352-9cbe-fb15310b55f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:48.326829 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c23499cd-65b9-4352-9cbe-fb15310b55f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:48.327271 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c23499cd-65b9-4352-9cbe-fb15310b55f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:48.328042 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c23499cd-65b9-4352-9cbe-fb15310b55f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:48.328468 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c23499cd-65b9-4352-9cbe-fb15310b55f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:48.358545 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c23499cd-65b9-4352-9cbe-fb15310b55f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043741 Apr 06 16:48:48.359108 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 673/1369] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:48 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:49.370835 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-17bed63d-2f6c-45e3-93a0-5f6a5e0cfcec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:49.371763 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-17bed63d-2f6c-45e3-93a0-5f6a5e0cfcec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:49.378645 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17bed63d-2f6c-45e3-93a0-5f6a5e0cfcec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:49.379093 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17bed63d-2f6c-45e3-93a0-5f6a5e0cfcec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:49.380143 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17bed63d-2f6c-45e3-93a0-5f6a5e0cfcec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:49.380329 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17bed63d-2f6c-45e3-93a0-5f6a5e0cfcec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:49.410258 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-17bed63d-2f6c-45e3-93a0-5f6a5e0cfcec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043517 Apr 06 16:48:49.410825 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 697/1370] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:49 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:50.423046 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f3ccfc5e-6348-48e3-b7d5-67111cd17889 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:50.423985 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f3ccfc5e-6348-48e3-b7d5-67111cd17889 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:50.431164 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3ccfc5e-6348-48e3-b7d5-67111cd17889 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:50.431607 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3ccfc5e-6348-48e3-b7d5-67111cd17889 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:50.432403 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3ccfc5e-6348-48e3-b7d5-67111cd17889 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:50.432872 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3ccfc5e-6348-48e3-b7d5-67111cd17889 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:50.462561 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f3ccfc5e-6348-48e3-b7d5-67111cd17889 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043437 Apr 06 16:48:50.463131 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 674/1371] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:50 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:51.475247 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fe0576d7-f990-4ccd-94c2-a96e2a28eabb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:51.476864 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fe0576d7-f990-4ccd-94c2-a96e2a28eabb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:51.483884 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe0576d7-f990-4ccd-94c2-a96e2a28eabb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:51.484714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe0576d7-f990-4ccd-94c2-a96e2a28eabb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:51.485696 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe0576d7-f990-4ccd-94c2-a96e2a28eabb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:51.486186 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe0576d7-f990-4ccd-94c2-a96e2a28eabb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:51.517423 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fe0576d7-f990-4ccd-94c2-a96e2a28eabb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046327 Apr 06 16:48:51.518001 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 698/1372] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:51 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:52.530254 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-694e7000-4e1e-4eac-992f-06066c8ab2a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:52.531349 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-694e7000-4e1e-4eac-992f-06066c8ab2a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:52.538096 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-694e7000-4e1e-4eac-992f-06066c8ab2a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:52.538547 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-694e7000-4e1e-4eac-992f-06066c8ab2a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:52.539326 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-694e7000-4e1e-4eac-992f-06066c8ab2a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:52.539815 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-694e7000-4e1e-4eac-992f-06066c8ab2a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:52.571611 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-694e7000-4e1e-4eac-992f-06066c8ab2a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045846 Apr 06 16:48:52.572183 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 675/1373] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:52 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:53.583746 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-15b00f6d-0286-4dc3-a4f7-e5c2fecf89a1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:53.584725 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-15b00f6d-0286-4dc3-a4f7-e5c2fecf89a1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:53.591946 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15b00f6d-0286-4dc3-a4f7-e5c2fecf89a1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:53.592395 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15b00f6d-0286-4dc3-a4f7-e5c2fecf89a1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:53.593870 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15b00f6d-0286-4dc3-a4f7-e5c2fecf89a1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:53.594300 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15b00f6d-0286-4dc3-a4f7-e5c2fecf89a1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:53.627578 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-15b00f6d-0286-4dc3-a4f7-e5c2fecf89a1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047769 Apr 06 16:48:53.628163 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 699/1374] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:53 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:54.639902 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dfdbab3e-4e28-4de1-b00d-5ae2fc9b84f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:54.641158 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dfdbab3e-4e28-4de1-b00d-5ae2fc9b84f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:54.649831 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfdbab3e-4e28-4de1-b00d-5ae2fc9b84f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:54.650295 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfdbab3e-4e28-4de1-b00d-5ae2fc9b84f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:54.651065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfdbab3e-4e28-4de1-b00d-5ae2fc9b84f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:54.651494 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfdbab3e-4e28-4de1-b00d-5ae2fc9b84f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:54.683660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dfdbab3e-4e28-4de1-b00d-5ae2fc9b84f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047709 Apr 06 16:48:54.684253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 676/1375] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:54 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:55.696057 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b99d9aa6-a440-4bd2-818e-a77ea4b60171 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:55.697023 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b99d9aa6-a440-4bd2-818e-a77ea4b60171 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:55.704483 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b99d9aa6-a440-4bd2-818e-a77ea4b60171 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:55.704968 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b99d9aa6-a440-4bd2-818e-a77ea4b60171 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:55.705760 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b99d9aa6-a440-4bd2-818e-a77ea4b60171 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:55.706191 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b99d9aa6-a440-4bd2-818e-a77ea4b60171 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:55.754041 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b99d9aa6-a440-4bd2-818e-a77ea4b60171 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062464 Apr 06 16:48:55.754632 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 700/1376] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:55 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:56.769266 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-574f035f-8afd-45db-b1d6-98f0ab4ecbbf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:56.770226 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-574f035f-8afd-45db-b1d6-98f0ab4ecbbf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:56.776984 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-574f035f-8afd-45db-b1d6-98f0ab4ecbbf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:56.777437 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-574f035f-8afd-45db-b1d6-98f0ab4ecbbf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:56.778213 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-574f035f-8afd-45db-b1d6-98f0ab4ecbbf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:56.778637 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-574f035f-8afd-45db-b1d6-98f0ab4ecbbf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:56.809690 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-574f035f-8afd-45db-b1d6-98f0ab4ecbbf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044575 Apr 06 16:48:56.810264 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 677/1377] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:56 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:57.827514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3909c837-87bc-43c8-b5dc-dc579ef0d5ef tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:57.828446 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3909c837-87bc-43c8-b5dc-dc579ef0d5ef tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:57.835808 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3909c837-87bc-43c8-b5dc-dc579ef0d5ef tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:57.836171 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3909c837-87bc-43c8-b5dc-dc579ef0d5ef tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:57.836994 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3909c837-87bc-43c8-b5dc-dc579ef0d5ef tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:57.837432 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3909c837-87bc-43c8-b5dc-dc579ef0d5ef tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:57.869800 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3909c837-87bc-43c8-b5dc-dc579ef0d5ef tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048369 Apr 06 16:48:57.870473 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 701/1378] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:57 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:58.881992 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b7eeb338-882b-4baf-bbcf-aac5a8ec51ac tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:58.882931 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b7eeb338-882b-4baf-bbcf-aac5a8ec51ac tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:58.890709 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7eeb338-882b-4baf-bbcf-aac5a8ec51ac tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:58.891167 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7eeb338-882b-4baf-bbcf-aac5a8ec51ac tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:58.892270 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7eeb338-882b-4baf-bbcf-aac5a8ec51ac tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:58.893049 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7eeb338-882b-4baf-bbcf-aac5a8ec51ac tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:58.926735 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b7eeb338-882b-4baf-bbcf-aac5a8ec51ac tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048710 Apr 06 16:48:58.927379 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 678/1379] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:58 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:48:59.939206 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fd379e28-6c5b-47f6-bd12-8529f2a26de1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:48:59.940848 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fd379e28-6c5b-47f6-bd12-8529f2a26de1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:48:59.947618 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd379e28-6c5b-47f6-bd12-8529f2a26de1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:59.948173 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd379e28-6c5b-47f6-bd12-8529f2a26de1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:59.949097 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd379e28-6c5b-47f6-bd12-8529f2a26de1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:48:59.949528 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd379e28-6c5b-47f6-bd12-8529f2a26de1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:48:59.981006 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fd379e28-6c5b-47f6-bd12-8529f2a26de1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046021 Apr 06 16:48:59.981600 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 702/1380] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:48:59 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:00.997774 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eb0ea04b-8133-42e4-b6bd-5c273d6b2dca tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:00.999140 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eb0ea04b-8133-42e4-b6bd-5c273d6b2dca tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:01.008337 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb0ea04b-8133-42e4-b6bd-5c273d6b2dca tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:01.008899 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb0ea04b-8133-42e4-b6bd-5c273d6b2dca tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:01.010047 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb0ea04b-8133-42e4-b6bd-5c273d6b2dca tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:01.010688 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb0ea04b-8133-42e4-b6bd-5c273d6b2dca tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:01.050190 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eb0ea04b-8133-42e4-b6bd-5c273d6b2dca tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059201 Apr 06 16:49:01.050750 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 679/1381] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:00 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:02.062988 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f6b9f808-acad-47a8-866a-00a02d6bd686 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:02.063954 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f6b9f808-acad-47a8-866a-00a02d6bd686 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:02.070649 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6b9f808-acad-47a8-866a-00a02d6bd686 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:02.071087 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6b9f808-acad-47a8-866a-00a02d6bd686 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:02.071881 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6b9f808-acad-47a8-866a-00a02d6bd686 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:02.072314 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6b9f808-acad-47a8-866a-00a02d6bd686 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:02.107036 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f6b9f808-acad-47a8-866a-00a02d6bd686 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049139 Apr 06 16:49:02.107560 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 703/1382] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:02 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:03.119418 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-35cf1f71-a105-4835-876c-5aca670107eb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:03.120431 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-35cf1f71-a105-4835-876c-5aca670107eb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:03.127138 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35cf1f71-a105-4835-876c-5aca670107eb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:03.127589 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35cf1f71-a105-4835-876c-5aca670107eb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:03.128360 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35cf1f71-a105-4835-876c-5aca670107eb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:03.128820 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35cf1f71-a105-4835-876c-5aca670107eb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:03.160181 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-35cf1f71-a105-4835-876c-5aca670107eb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044790 Apr 06 16:49:03.160784 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 680/1383] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:03 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:04.172004 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-06082bd3-d2db-4f50-9254-3c5031e058af tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:04.173071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-06082bd3-d2db-4f50-9254-3c5031e058af tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:04.180489 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06082bd3-d2db-4f50-9254-3c5031e058af tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:04.181143 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06082bd3-d2db-4f50-9254-3c5031e058af tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:04.183902 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06082bd3-d2db-4f50-9254-3c5031e058af tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:04.184350 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06082bd3-d2db-4f50-9254-3c5031e058af tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:04.214554 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-06082bd3-d2db-4f50-9254-3c5031e058af tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046631 Apr 06 16:49:04.215148 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 704/1384] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:04 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:05.228609 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-82d57160-62ac-4aa3-8788-a217067b82fc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:05.229891 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-82d57160-62ac-4aa3-8788-a217067b82fc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:05.237124 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82d57160-62ac-4aa3-8788-a217067b82fc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:05.237587 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82d57160-62ac-4aa3-8788-a217067b82fc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:05.238381 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82d57160-62ac-4aa3-8788-a217067b82fc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:05.238788 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82d57160-62ac-4aa3-8788-a217067b82fc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:05.268807 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-82d57160-62ac-4aa3-8788-a217067b82fc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045460 Apr 06 16:49:05.269859 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 681/1385] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:05 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:06.280528 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cb700ee0-ef34-470c-a845-3ab69da71fc2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:06.281370 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cb700ee0-ef34-470c-a845-3ab69da71fc2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:06.288229 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb700ee0-ef34-470c-a845-3ab69da71fc2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:06.288663 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb700ee0-ef34-470c-a845-3ab69da71fc2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:06.289458 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb700ee0-ef34-470c-a845-3ab69da71fc2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:06.289888 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb700ee0-ef34-470c-a845-3ab69da71fc2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:06.325320 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cb700ee0-ef34-470c-a845-3ab69da71fc2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049038 Apr 06 16:49:06.326057 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 705/1386] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:06 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:07.336826 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b03ae6c4-ac97-451c-90a8-897b327c3f4c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:07.337795 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b03ae6c4-ac97-451c-90a8-897b327c3f4c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:07.344900 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b03ae6c4-ac97-451c-90a8-897b327c3f4c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:07.345349 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b03ae6c4-ac97-451c-90a8-897b327c3f4c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:07.346133 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b03ae6c4-ac97-451c-90a8-897b327c3f4c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:07.346570 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b03ae6c4-ac97-451c-90a8-897b327c3f4c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:07.378802 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b03ae6c4-ac97-451c-90a8-897b327c3f4c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046093 Apr 06 16:49:07.381436 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 682/1387] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:07 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:08.390835 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-72d2ec63-f628-4bf4-b4e6-e672fd7d38e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:08.391772 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-72d2ec63-f628-4bf4-b4e6-e672fd7d38e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:08.398548 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72d2ec63-f628-4bf4-b4e6-e672fd7d38e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:08.398985 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72d2ec63-f628-4bf4-b4e6-e672fd7d38e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:08.399747 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72d2ec63-f628-4bf4-b4e6-e672fd7d38e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:08.400173 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72d2ec63-f628-4bf4-b4e6-e672fd7d38e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:08.430883 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-72d2ec63-f628-4bf4-b4e6-e672fd7d38e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044059 Apr 06 16:49:08.431462 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 706/1388] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:08 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:09.443344 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7c5ea42c-90ca-415e-b006-02a7a13dcc71 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:09.444316 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7c5ea42c-90ca-415e-b006-02a7a13dcc71 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:09.450996 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c5ea42c-90ca-415e-b006-02a7a13dcc71 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:09.451449 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c5ea42c-90ca-415e-b006-02a7a13dcc71 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:09.452226 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c5ea42c-90ca-415e-b006-02a7a13dcc71 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:09.452662 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c5ea42c-90ca-415e-b006-02a7a13dcc71 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:09.482892 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7c5ea42c-90ca-415e-b006-02a7a13dcc71 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043588 Apr 06 16:49:09.483817 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 683/1389] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:09 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:10.494798 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cc3a2ea6-99ad-4ff8-a578-304d5924061e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:10.495687 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cc3a2ea6-99ad-4ff8-a578-304d5924061e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:10.502641 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc3a2ea6-99ad-4ff8-a578-304d5924061e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:10.503104 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc3a2ea6-99ad-4ff8-a578-304d5924061e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:10.503874 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc3a2ea6-99ad-4ff8-a578-304d5924061e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:10.504307 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc3a2ea6-99ad-4ff8-a578-304d5924061e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:10.535487 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cc3a2ea6-99ad-4ff8-a578-304d5924061e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044781 Apr 06 16:49:10.536070 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 707/1390] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:10 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:11.548037 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-95a4b22b-24b3-4727-9ef2-a55e99aae024 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:11.548915 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-95a4b22b-24b3-4727-9ef2-a55e99aae024 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:11.555395 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95a4b22b-24b3-4727-9ef2-a55e99aae024 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:11.555844 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95a4b22b-24b3-4727-9ef2-a55e99aae024 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:11.556645 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95a4b22b-24b3-4727-9ef2-a55e99aae024 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:11.557210 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95a4b22b-24b3-4727-9ef2-a55e99aae024 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:11.588108 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-95a4b22b-24b3-4727-9ef2-a55e99aae024 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044196 Apr 06 16:49:11.589033 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 684/1391] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:11 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:12.601252 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0b38166d-9d3b-4142-9e67-63de51d047b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:12.602180 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0b38166d-9d3b-4142-9e67-63de51d047b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:12.609262 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b38166d-9d3b-4142-9e67-63de51d047b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:12.609711 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b38166d-9d3b-4142-9e67-63de51d047b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:12.610483 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b38166d-9d3b-4142-9e67-63de51d047b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:12.610919 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0b38166d-9d3b-4142-9e67-63de51d047b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:12.640610 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0b38166d-9d3b-4142-9e67-63de51d047b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043626 Apr 06 16:49:12.641202 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 708/1392] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:12 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:13.653673 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1c5a7bf9-2bbb-497b-94f1-c72d1aad6b1c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:13.654603 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1c5a7bf9-2bbb-497b-94f1-c72d1aad6b1c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:13.666852 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c5a7bf9-2bbb-497b-94f1-c72d1aad6b1c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:13.667456 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c5a7bf9-2bbb-497b-94f1-c72d1aad6b1c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:13.668360 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c5a7bf9-2bbb-497b-94f1-c72d1aad6b1c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:13.668908 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c5a7bf9-2bbb-497b-94f1-c72d1aad6b1c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:13.702471 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1c5a7bf9-2bbb-497b-94f1-c72d1aad6b1c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053445 Apr 06 16:49:13.703041 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 685/1393] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:13 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:14.715281 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8168b605-bade-4b69-87ad-3e69b3230200 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:14.716333 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8168b605-bade-4b69-87ad-3e69b3230200 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:14.722993 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8168b605-bade-4b69-87ad-3e69b3230200 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:14.723445 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8168b605-bade-4b69-87ad-3e69b3230200 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:14.724227 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8168b605-bade-4b69-87ad-3e69b3230200 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:14.724664 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8168b605-bade-4b69-87ad-3e69b3230200 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:14.756298 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8168b605-bade-4b69-87ad-3e69b3230200 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045492 Apr 06 16:49:14.756888 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 709/1394] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:14 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:15.768961 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7f60b61c-ebaf-4e6e-8f75-c42cb8084efa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:15.769894 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7f60b61c-ebaf-4e6e-8f75-c42cb8084efa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:15.776889 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f60b61c-ebaf-4e6e-8f75-c42cb8084efa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:15.777342 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f60b61c-ebaf-4e6e-8f75-c42cb8084efa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:15.778119 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f60b61c-ebaf-4e6e-8f75-c42cb8084efa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:15.778549 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f60b61c-ebaf-4e6e-8f75-c42cb8084efa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:15.815577 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7f60b61c-ebaf-4e6e-8f75-c42cb8084efa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050631 Apr 06 16:49:15.816273 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 686/1395] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:15 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:16.838531 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-26f4ba9c-1ee9-4982-bfcc-ccfe86fc6584 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:16.839928 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-26f4ba9c-1ee9-4982-bfcc-ccfe86fc6584 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:16.848505 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26f4ba9c-1ee9-4982-bfcc-ccfe86fc6584 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:16.848973 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26f4ba9c-1ee9-4982-bfcc-ccfe86fc6584 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:16.849746 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26f4ba9c-1ee9-4982-bfcc-ccfe86fc6584 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:16.850170 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26f4ba9c-1ee9-4982-bfcc-ccfe86fc6584 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:16.880221 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-26f4ba9c-1ee9-4982-bfcc-ccfe86fc6584 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048519 Apr 06 16:49:16.880811 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 710/1396] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:16 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:17.893277 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e41b0a4d-1633-4245-9163-9403ab4089f9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:17.894241 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e41b0a4d-1633-4245-9163-9403ab4089f9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:17.901614 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e41b0a4d-1633-4245-9163-9403ab4089f9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:17.902070 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e41b0a4d-1633-4245-9163-9403ab4089f9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:17.902877 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e41b0a4d-1633-4245-9163-9403ab4089f9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:17.903311 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e41b0a4d-1633-4245-9163-9403ab4089f9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:17.934844 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e41b0a4d-1633-4245-9163-9403ab4089f9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045590 Apr 06 16:49:17.935417 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 687/1397] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:17 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:18.953480 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ee390789-0101-41d9-9fdb-925fcff09ea4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:18.956082 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ee390789-0101-41d9-9fdb-925fcff09ea4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:18.967856 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee390789-0101-41d9-9fdb-925fcff09ea4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:18.968308 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee390789-0101-41d9-9fdb-925fcff09ea4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:18.969212 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee390789-0101-41d9-9fdb-925fcff09ea4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:18.969645 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee390789-0101-41d9-9fdb-925fcff09ea4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:19.000895 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ee390789-0101-41d9-9fdb-925fcff09ea4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056352 Apr 06 16:49:19.001472 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 711/1398] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:18 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:20.013065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0f7d796c-59ef-4c13-af81-5d3880e053bf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:20.014048 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0f7d796c-59ef-4c13-af81-5d3880e053bf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:20.020847 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f7d796c-59ef-4c13-af81-5d3880e053bf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:20.021299 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f7d796c-59ef-4c13-af81-5d3880e053bf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:20.022066 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f7d796c-59ef-4c13-af81-5d3880e053bf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:20.022489 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f7d796c-59ef-4c13-af81-5d3880e053bf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:20.053454 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0f7d796c-59ef-4c13-af81-5d3880e053bf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044546 Apr 06 16:49:20.054053 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 688/1399] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:20 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:21.066383 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-af6c7d5f-e893-473c-bfb9-23b097806fe7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:21.067312 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-af6c7d5f-e893-473c-bfb9-23b097806fe7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:21.074054 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af6c7d5f-e893-473c-bfb9-23b097806fe7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:21.074513 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af6c7d5f-e893-473c-bfb9-23b097806fe7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:21.075293 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af6c7d5f-e893-473c-bfb9-23b097806fe7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:21.075726 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af6c7d5f-e893-473c-bfb9-23b097806fe7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:21.106827 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-af6c7d5f-e893-473c-bfb9-23b097806fe7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044981 Apr 06 16:49:21.107592 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 712/1400] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:21 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:22.122022 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d31e3f6f-bd5b-44de-943e-770b070b1745 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:22.122987 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d31e3f6f-bd5b-44de-943e-770b070b1745 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:22.129924 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d31e3f6f-bd5b-44de-943e-770b070b1745 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:22.130376 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d31e3f6f-bd5b-44de-943e-770b070b1745 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:22.131164 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d31e3f6f-bd5b-44de-943e-770b070b1745 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:22.131594 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d31e3f6f-bd5b-44de-943e-770b070b1745 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:22.164427 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d31e3f6f-bd5b-44de-943e-770b070b1745 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046926 Apr 06 16:49:22.165039 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 689/1401] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:22 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:23.177088 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b2960e50-664f-4368-aa46-5b8d0379b294 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:23.178055 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b2960e50-664f-4368-aa46-5b8d0379b294 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:23.188741 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2960e50-664f-4368-aa46-5b8d0379b294 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:23.189642 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2960e50-664f-4368-aa46-5b8d0379b294 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:23.190906 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2960e50-664f-4368-aa46-5b8d0379b294 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:23.191625 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2960e50-664f-4368-aa46-5b8d0379b294 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:23.226250 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b2960e50-664f-4368-aa46-5b8d0379b294 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053179 Apr 06 16:49:23.226844 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 713/1402] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:23 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:49:24.239540 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-649d0149-6cf7-4960-a3e1-a3fbf6f82e04 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:24.240725 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-649d0149-6cf7-4960-a3e1-a3fbf6f82e04 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:24.247885 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-649d0149-6cf7-4960-a3e1-a3fbf6f82e04 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:24.248338 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-649d0149-6cf7-4960-a3e1-a3fbf6f82e04 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:24.249184 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-649d0149-6cf7-4960-a3e1-a3fbf6f82e04 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:24.249618 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-649d0149-6cf7-4960-a3e1-a3fbf6f82e04 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:24.282569 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-649d0149-6cf7-4960-a3e1-a3fbf6f82e04 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047069 Apr 06 16:49:24.283194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 690/1403] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:24 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:25.295997 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c53b6a71-de5e-4372-b97f-25ed87082451 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:25.297038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c53b6a71-de5e-4372-b97f-25ed87082451 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:25.304011 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c53b6a71-de5e-4372-b97f-25ed87082451 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:25.304470 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c53b6a71-de5e-4372-b97f-25ed87082451 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:25.305282 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c53b6a71-de5e-4372-b97f-25ed87082451 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:25.305716 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c53b6a71-de5e-4372-b97f-25ed87082451 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:25.340124 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c53b6a71-de5e-4372-b97f-25ed87082451 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048556 Apr 06 16:49:25.340918 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 714/1404] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:25 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:26.353312 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fd4d7468-85eb-45b9-9f6d-3164fee805c3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:26.354230 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fd4d7468-85eb-45b9-9f6d-3164fee805c3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:26.361828 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd4d7468-85eb-45b9-9f6d-3164fee805c3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:26.362276 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd4d7468-85eb-45b9-9f6d-3164fee805c3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:26.363058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd4d7468-85eb-45b9-9f6d-3164fee805c3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:26.363493 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd4d7468-85eb-45b9-9f6d-3164fee805c3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:26.394776 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fd4d7468-85eb-45b9-9f6d-3164fee805c3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045615 Apr 06 16:49:26.395367 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 691/1405] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:26 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:49:27.408986 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-42bbe8f8-928e-470e-b8b3-d48b5d568b15 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:27.409903 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-42bbe8f8-928e-470e-b8b3-d48b5d568b15 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:27.416971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42bbe8f8-928e-470e-b8b3-d48b5d568b15 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:27.417776 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42bbe8f8-928e-470e-b8b3-d48b5d568b15 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:27.418353 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42bbe8f8-928e-470e-b8b3-d48b5d568b15 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:27.418800 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42bbe8f8-928e-470e-b8b3-d48b5d568b15 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:27.452186 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-42bbe8f8-928e-470e-b8b3-d48b5d568b15 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047263 Apr 06 16:49:27.452820 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 715/1406] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:27 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:28.464333 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-23a967dd-cc8e-479c-8817-da47e7db70e1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:28.465200 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-23a967dd-cc8e-479c-8817-da47e7db70e1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:28.472049 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23a967dd-cc8e-479c-8817-da47e7db70e1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:28.472504 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23a967dd-cc8e-479c-8817-da47e7db70e1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:28.473322 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23a967dd-cc8e-479c-8817-da47e7db70e1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:28.473750 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23a967dd-cc8e-479c-8817-da47e7db70e1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:28.505613 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-23a967dd-cc8e-479c-8817-da47e7db70e1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045365 Apr 06 16:49:28.506372 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 692/1407] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:28 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:29.518589 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b915f101-c6fd-484c-8ec8-93bcec48c03c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:29.519670 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b915f101-c6fd-484c-8ec8-93bcec48c03c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:29.527210 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b915f101-c6fd-484c-8ec8-93bcec48c03c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:29.527690 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b915f101-c6fd-484c-8ec8-93bcec48c03c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:29.528564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b915f101-c6fd-484c-8ec8-93bcec48c03c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:29.529036 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b915f101-c6fd-484c-8ec8-93bcec48c03c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:29.560303 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b915f101-c6fd-484c-8ec8-93bcec48c03c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046237 Apr 06 16:49:29.560918 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 716/1408] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:29 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:49:30.572603 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e55b76d3-3d8c-43d3-967c-bdb49c47e5c8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:30.573617 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e55b76d3-3d8c-43d3-967c-bdb49c47e5c8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:30.580492 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e55b76d3-3d8c-43d3-967c-bdb49c47e5c8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:30.580984 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e55b76d3-3d8c-43d3-967c-bdb49c47e5c8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:30.581759 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e55b76d3-3d8c-43d3-967c-bdb49c47e5c8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:30.582201 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e55b76d3-3d8c-43d3-967c-bdb49c47e5c8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:30.612876 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e55b76d3-3d8c-43d3-967c-bdb49c47e5c8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044332 Apr 06 16:49:30.613606 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 693/1409] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:30 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:31.624026 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-28febebb-b916-4642-9db4-1d97b97c5aa4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:31.624985 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-28febebb-b916-4642-9db4-1d97b97c5aa4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:31.632718 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28febebb-b916-4642-9db4-1d97b97c5aa4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:31.633191 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28febebb-b916-4642-9db4-1d97b97c5aa4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:31.633956 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28febebb-b916-4642-9db4-1d97b97c5aa4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:31.634393 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28febebb-b916-4642-9db4-1d97b97c5aa4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:31.664086 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-28febebb-b916-4642-9db4-1d97b97c5aa4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044187 Apr 06 16:49:31.664671 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 717/1410] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:31 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:32.675827 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-32004e5a-57a8-42d3-9d18-35f6f54ccd96 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:32.676787 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-32004e5a-57a8-42d3-9d18-35f6f54ccd96 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:32.683533 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32004e5a-57a8-42d3-9d18-35f6f54ccd96 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:32.683984 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32004e5a-57a8-42d3-9d18-35f6f54ccd96 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:32.685099 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32004e5a-57a8-42d3-9d18-35f6f54ccd96 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:32.685223 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32004e5a-57a8-42d3-9d18-35f6f54ccd96 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:32.714164 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-32004e5a-57a8-42d3-9d18-35f6f54ccd96 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042284 Apr 06 16:49:32.715067 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 694/1411] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:32 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:33.729834 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2881a44a-70ed-43f8-bbff-756a69ca1c9e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:33.730863 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2881a44a-70ed-43f8-bbff-756a69ca1c9e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:33.738351 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2881a44a-70ed-43f8-bbff-756a69ca1c9e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:33.738790 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2881a44a-70ed-43f8-bbff-756a69ca1c9e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:33.739586 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2881a44a-70ed-43f8-bbff-756a69ca1c9e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:33.740021 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2881a44a-70ed-43f8-bbff-756a69ca1c9e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:33.775654 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2881a44a-70ed-43f8-bbff-756a69ca1c9e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052161 Apr 06 16:49:33.776235 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 718/1412] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:33 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:34.788000 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5c407f1a-eae8-4323-abd9-83dda72e9c30 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:34.788979 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5c407f1a-eae8-4323-abd9-83dda72e9c30 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:34.795810 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c407f1a-eae8-4323-abd9-83dda72e9c30 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:34.796255 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c407f1a-eae8-4323-abd9-83dda72e9c30 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:34.797053 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c407f1a-eae8-4323-abd9-83dda72e9c30 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:34.797478 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c407f1a-eae8-4323-abd9-83dda72e9c30 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:34.826818 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5c407f1a-eae8-4323-abd9-83dda72e9c30 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042793 Apr 06 16:49:34.827363 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 695/1413] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:34 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:35.838996 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e3197490-8de2-4323-943c-bcc92bf38549 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:35.840288 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e3197490-8de2-4323-943c-bcc92bf38549 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:35.847240 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3197490-8de2-4323-943c-bcc92bf38549 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:35.847691 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3197490-8de2-4323-943c-bcc92bf38549 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:35.848773 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3197490-8de2-4323-943c-bcc92bf38549 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:35.849494 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e3197490-8de2-4323-943c-bcc92bf38549 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:35.881523 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e3197490-8de2-4323-943c-bcc92bf38549 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046669 Apr 06 16:49:35.882345 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 719/1414] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:35 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:36.896890 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1c0c051a-157e-4f54-b2b7-79eebee6c93b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:36.898451 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1c0c051a-157e-4f54-b2b7-79eebee6c93b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:36.907448 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c0c051a-157e-4f54-b2b7-79eebee6c93b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:36.907905 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c0c051a-157e-4f54-b2b7-79eebee6c93b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:36.908704 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c0c051a-157e-4f54-b2b7-79eebee6c93b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:36.909160 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c0c051a-157e-4f54-b2b7-79eebee6c93b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:36.938862 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1c0c051a-157e-4f54-b2b7-79eebee6c93b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048639 Apr 06 16:49:36.939450 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 696/1415] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:36 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:37.951217 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bb877bb6-77d1-4cb0-b9d4-1f0847b8a599 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:37.952183 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bb877bb6-77d1-4cb0-b9d4-1f0847b8a599 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:37.959073 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb877bb6-77d1-4cb0-b9d4-1f0847b8a599 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:37.959526 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb877bb6-77d1-4cb0-b9d4-1f0847b8a599 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:37.960296 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb877bb6-77d1-4cb0-b9d4-1f0847b8a599 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:37.960734 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb877bb6-77d1-4cb0-b9d4-1f0847b8a599 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:37.993223 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bb877bb6-77d1-4cb0-b9d4-1f0847b8a599 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046236 Apr 06 16:49:37.993789 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 720/1416] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:37 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:39.005800 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f62d4a48-ef37-4c66-9be6-74a33f23e46d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:39.006765 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f62d4a48-ef37-4c66-9be6-74a33f23e46d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:39.013700 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f62d4a48-ef37-4c66-9be6-74a33f23e46d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:39.014182 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f62d4a48-ef37-4c66-9be6-74a33f23e46d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:39.014969 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f62d4a48-ef37-4c66-9be6-74a33f23e46d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:39.015386 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f62d4a48-ef37-4c66-9be6-74a33f23e46d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:39.050004 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f62d4a48-ef37-4c66-9be6-74a33f23e46d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048331 Apr 06 16:49:39.050605 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 697/1417] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:39 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:40.062092 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3de17940-aede-4d63-9647-758a81a921c7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:40.062934 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3de17940-aede-4d63-9647-758a81a921c7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:40.069940 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3de17940-aede-4d63-9647-758a81a921c7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:40.070389 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3de17940-aede-4d63-9647-758a81a921c7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:40.071204 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3de17940-aede-4d63-9647-758a81a921c7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:40.071637 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3de17940-aede-4d63-9647-758a81a921c7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:40.102293 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3de17940-aede-4d63-9647-758a81a921c7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044349 Apr 06 16:49:40.102868 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 721/1418] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:40 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:41.115324 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-302c1c03-99a7-412e-aaa3-71b87bc2510c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:41.116982 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-302c1c03-99a7-412e-aaa3-71b87bc2510c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:41.122912 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-302c1c03-99a7-412e-aaa3-71b87bc2510c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:41.123455 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-302c1c03-99a7-412e-aaa3-71b87bc2510c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:41.124233 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-302c1c03-99a7-412e-aaa3-71b87bc2510c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:41.124663 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-302c1c03-99a7-412e-aaa3-71b87bc2510c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:41.159538 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-302c1c03-99a7-412e-aaa3-71b87bc2510c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048183 Apr 06 16:49:41.160478 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 698/1419] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:41 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:42.173098 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e237c0dd-7137-494c-81e6-c32d1143e043 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:42.173933 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e237c0dd-7137-494c-81e6-c32d1143e043 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:42.180494 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e237c0dd-7137-494c-81e6-c32d1143e043 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:42.180978 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e237c0dd-7137-494c-81e6-c32d1143e043 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:42.181752 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e237c0dd-7137-494c-81e6-c32d1143e043 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:42.182192 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e237c0dd-7137-494c-81e6-c32d1143e043 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:42.211858 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e237c0dd-7137-494c-81e6-c32d1143e043 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043118 Apr 06 16:49:42.212418 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 722/1420] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:42 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:43.225179 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f9361db0-3fc6-4b5d-95ed-b3af47015722 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:43.226002 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f9361db0-3fc6-4b5d-95ed-b3af47015722 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:43.232842 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9361db0-3fc6-4b5d-95ed-b3af47015722 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:43.233331 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9361db0-3fc6-4b5d-95ed-b3af47015722 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:43.234116 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9361db0-3fc6-4b5d-95ed-b3af47015722 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:43.234549 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9361db0-3fc6-4b5d-95ed-b3af47015722 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:43.265675 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f9361db0-3fc6-4b5d-95ed-b3af47015722 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044588 Apr 06 16:49:43.266251 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 699/1421] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:43 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:44.277954 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-703dfb29-52cf-4980-9915-91cc55de1766 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:44.278774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-703dfb29-52cf-4980-9915-91cc55de1766 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:44.285899 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-703dfb29-52cf-4980-9915-91cc55de1766 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:44.286356 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-703dfb29-52cf-4980-9915-91cc55de1766 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:44.287115 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-703dfb29-52cf-4980-9915-91cc55de1766 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:44.287570 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-703dfb29-52cf-4980-9915-91cc55de1766 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:44.318911 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-703dfb29-52cf-4980-9915-91cc55de1766 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045082 Apr 06 16:49:44.319481 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 723/1422] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:44 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:45.335825 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5e5407be-d4ec-4b77-8aa9-d14d5892d9ee tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:45.337010 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5e5407be-d4ec-4b77-8aa9-d14d5892d9ee tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:45.345572 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e5407be-d4ec-4b77-8aa9-d14d5892d9ee tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:45.346027 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e5407be-d4ec-4b77-8aa9-d14d5892d9ee tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:45.346807 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e5407be-d4ec-4b77-8aa9-d14d5892d9ee tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:45.347240 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e5407be-d4ec-4b77-8aa9-d14d5892d9ee tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:45.377541 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5e5407be-d4ec-4b77-8aa9-d14d5892d9ee tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048855 Apr 06 16:49:45.378108 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 700/1423] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:45 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:46.389692 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-11e390f0-e743-4ccb-b8a5-a38f8f8badc8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:46.390617 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-11e390f0-e743-4ccb-b8a5-a38f8f8badc8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:46.397772 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11e390f0-e743-4ccb-b8a5-a38f8f8badc8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:46.398219 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11e390f0-e743-4ccb-b8a5-a38f8f8badc8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:46.399004 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11e390f0-e743-4ccb-b8a5-a38f8f8badc8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:46.399438 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11e390f0-e743-4ccb-b8a5-a38f8f8badc8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:46.434517 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-11e390f0-e743-4ccb-b8a5-a38f8f8badc8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048811 Apr 06 16:49:46.435115 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 724/1424] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:46 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:46.734920 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bcea5aba-7b85-4e45-a5aa-b202391115d9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:46.735507 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bcea5aba-7b85-4e45-a5aa-b202391115d9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:46.742116 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcea5aba-7b85-4e45-a5aa-b202391115d9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:46.742570 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcea5aba-7b85-4e45-a5aa-b202391115d9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:46.743358 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcea5aba-7b85-4e45-a5aa-b202391115d9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:46.743785 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcea5aba-7b85-4e45-a5aa-b202391115d9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:46.768637 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bcea5aba-7b85-4e45-a5aa-b202391115d9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 06 16:49:46.852085 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bcea5aba-7b85-4e45-a5aa-b202391115d9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 204 len: 0 microversion: 2.1 time: 0.121202 Apr 06 16:49:46.852768 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 701/1425] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 16:49:46 2022] DELETE /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 06 16:49:46.861431 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7062ab66-37e4-41c0-8b8b-3d3c7cbc8a36 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:46.862047 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7062ab66-37e4-41c0-8b8b-3d3c7cbc8a36 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:46.868173 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7062ab66-37e4-41c0-8b8b-3d3c7cbc8a36 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:46.868623 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7062ab66-37e4-41c0-8b8b-3d3c7cbc8a36 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:46.869438 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7062ab66-37e4-41c0-8b8b-3d3c7cbc8a36 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:46.869869 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7062ab66-37e4-41c0-8b8b-3d3c7cbc8a36 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:47.064577 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7062ab66-37e4-41c0-8b8b-3d3c7cbc8a36 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:49:47.073449 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7062ab66-37e4-41c0-8b8b-3d3c7cbc8a36 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.216366 Apr 06 16:49:47.074031 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 725/1426] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:49:46 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:49:47.451889 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-47365367-5b97-4f9f-8455-c5d7af5e1fe5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:47.453584 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-47365367-5b97-4f9f-8455-c5d7af5e1fe5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:47.464091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-47365367-5b97-4f9f-8455-c5d7af5e1fe5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:47.464895 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-47365367-5b97-4f9f-8455-c5d7af5e1fe5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:47.466166 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-47365367-5b97-4f9f-8455-c5d7af5e1fe5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:47.466881 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-47365367-5b97-4f9f-8455-c5d7af5e1fe5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:47.498142 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-47365367-5b97-4f9f-8455-c5d7af5e1fe5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053590 Apr 06 16:49:47.498944 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 702/1427] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:47 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:48.094965 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dc4f942f-9cfc-4f0f-9529-ad8f0b7b0f20 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:48.096354 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dc4f942f-9cfc-4f0f-9529-ad8f0b7b0f20 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:48.105332 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc4f942f-9cfc-4f0f-9529-ad8f0b7b0f20 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:48.105780 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc4f942f-9cfc-4f0f-9529-ad8f0b7b0f20 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:48.106580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc4f942f-9cfc-4f0f-9529-ad8f0b7b0f20 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:48.107017 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc4f942f-9cfc-4f0f-9529-ad8f0b7b0f20 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:48.273457 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-dc4f942f-9cfc-4f0f-9529-ad8f0b7b0f20 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:49:48.281930 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dc4f942f-9cfc-4f0f-9529-ad8f0b7b0f20 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.192439 Apr 06 16:49:48.283267 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 726/1428] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:49:48 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:49:48.515702 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d6eb8fca-d70c-4643-9423-ee27937d21fc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:48.517205 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d6eb8fca-d70c-4643-9423-ee27937d21fc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:48.523686 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6eb8fca-d70c-4643-9423-ee27937d21fc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:48.524135 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6eb8fca-d70c-4643-9423-ee27937d21fc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:48.524928 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6eb8fca-d70c-4643-9423-ee27937d21fc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:48.525356 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6eb8fca-d70c-4643-9423-ee27937d21fc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:48.554753 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d6eb8fca-d70c-4643-9423-ee27937d21fc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045557 Apr 06 16:49:48.555301 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 703/1429] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:48 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:49.385326 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-26b98662-e6bf-4d05-91a4-98a15402d79e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:49.385967 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-26b98662-e6bf-4d05-91a4-98a15402d79e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:49.391960 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26b98662-e6bf-4d05-91a4-98a15402d79e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:49.392467 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26b98662-e6bf-4d05-91a4-98a15402d79e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:49.393472 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26b98662-e6bf-4d05-91a4-98a15402d79e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:49.393935 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-26b98662-e6bf-4d05-91a4-98a15402d79e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:49.542226 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-26b98662-e6bf-4d05-91a4-98a15402d79e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:49:49.550485 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-26b98662-e6bf-4d05-91a4-98a15402d79e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.254831 Apr 06 16:49:49.551076 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 727/1430] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:49:49 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:49:49.566746 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-30a68de4-e010-4865-a0b4-b5a992500021 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:49.567680 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-30a68de4-e010-4865-a0b4-b5a992500021 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:49.574707 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30a68de4-e010-4865-a0b4-b5a992500021 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:49.576004 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30a68de4-e010-4865-a0b4-b5a992500021 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:49.576829 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30a68de4-e010-4865-a0b4-b5a992500021 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:49.577268 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30a68de4-e010-4865-a0b4-b5a992500021 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:49.612077 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-30a68de4-e010-4865-a0b4-b5a992500021 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049328 Apr 06 16:49:49.612862 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 704/1431] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:49 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:50.570284 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6dcb1a1c-a1a4-423a-b824-50b08a17ccfe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:50.570960 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6dcb1a1c-a1a4-423a-b824-50b08a17ccfe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:50.578541 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6dcb1a1c-a1a4-423a-b824-50b08a17ccfe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:50.579252 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6dcb1a1c-a1a4-423a-b824-50b08a17ccfe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:50.580150 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6dcb1a1c-a1a4-423a-b824-50b08a17ccfe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:50.580593 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6dcb1a1c-a1a4-423a-b824-50b08a17ccfe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:50.627432 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d55fa854-8e87-4a31-8922-3531bb4e2ae1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:50.628531 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d55fa854-8e87-4a31-8922-3531bb4e2ae1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:50.635441 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d55fa854-8e87-4a31-8922-3531bb4e2ae1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:50.635887 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d55fa854-8e87-4a31-8922-3531bb4e2ae1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:50.636670 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d55fa854-8e87-4a31-8922-3531bb4e2ae1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:50.637128 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d55fa854-8e87-4a31-8922-3531bb4e2ae1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:50.668030 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d55fa854-8e87-4a31-8922-3531bb4e2ae1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046679 Apr 06 16:49:50.668614 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 705/1432] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:50 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:50.727370 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6dcb1a1c-a1a4-423a-b824-50b08a17ccfe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:49:50.735715 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6dcb1a1c-a1a4-423a-b824-50b08a17ccfe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.171275 Apr 06 16:49:50.736322 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 728/1433] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:49:50 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:49:51.680033 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c26d6dea-9060-46e9-907b-61100adb9651 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:51.681034 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c26d6dea-9060-46e9-907b-61100adb9651 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:51.688238 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c26d6dea-9060-46e9-907b-61100adb9651 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:51.688700 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c26d6dea-9060-46e9-907b-61100adb9651 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:51.689771 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c26d6dea-9060-46e9-907b-61100adb9651 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:51.690200 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c26d6dea-9060-46e9-907b-61100adb9651 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:51.721239 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c26d6dea-9060-46e9-907b-61100adb9651 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045095 Apr 06 16:49:51.721822 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 706/1434] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:51 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:51.752354 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-95f3ce3b-8895-4cfd-8a21-032e420f6970 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:51.753070 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-95f3ce3b-8895-4cfd-8a21-032e420f6970 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:51.760150 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95f3ce3b-8895-4cfd-8a21-032e420f6970 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:51.760952 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95f3ce3b-8895-4cfd-8a21-032e420f6970 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:51.761732 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95f3ce3b-8895-4cfd-8a21-032e420f6970 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:51.762160 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95f3ce3b-8895-4cfd-8a21-032e420f6970 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:51.906953 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-95f3ce3b-8895-4cfd-8a21-032e420f6970 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:49:51.915246 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-95f3ce3b-8895-4cfd-8a21-032e420f6970 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.166926 Apr 06 16:49:51.915841 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 729/1435] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:49:51 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:49:52.734048 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d0b086d2-1208-4a5f-97c1-789ea2b86b11 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:52.734970 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d0b086d2-1208-4a5f-97c1-789ea2b86b11 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:52.743274 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0b086d2-1208-4a5f-97c1-789ea2b86b11 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:52.743871 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0b086d2-1208-4a5f-97c1-789ea2b86b11 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:52.744853 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0b086d2-1208-4a5f-97c1-789ea2b86b11 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:52.745292 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0b086d2-1208-4a5f-97c1-789ea2b86b11 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:52.777182 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d0b086d2-1208-4a5f-97c1-789ea2b86b11 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048445 Apr 06 16:49:52.777778 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 707/1436] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:52 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:52.933566 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6d0743bb-e10c-48d3-8aa8-2c1b7b3aa7b5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:52.934213 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6d0743bb-e10c-48d3-8aa8-2c1b7b3aa7b5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:52.941428 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d0743bb-e10c-48d3-8aa8-2c1b7b3aa7b5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:52.941921 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d0743bb-e10c-48d3-8aa8-2c1b7b3aa7b5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:52.942871 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d0743bb-e10c-48d3-8aa8-2c1b7b3aa7b5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:52.943308 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d0743bb-e10c-48d3-8aa8-2c1b7b3aa7b5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:53.089185 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6d0743bb-e10c-48d3-8aa8-2c1b7b3aa7b5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:49:53.099147 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6d0743bb-e10c-48d3-8aa8-2c1b7b3aa7b5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.169586 Apr 06 16:49:53.099721 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 730/1437] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:49:52 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:49:53.789665 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-494cb77c-980b-46c3-b52b-6d0c4e0c431f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:53.790599 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-494cb77c-980b-46c3-b52b-6d0c4e0c431f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:53.797363 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-494cb77c-980b-46c3-b52b-6d0c4e0c431f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:53.797819 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-494cb77c-980b-46c3-b52b-6d0c4e0c431f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:53.798668 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-494cb77c-980b-46c3-b52b-6d0c4e0c431f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:53.799087 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-494cb77c-980b-46c3-b52b-6d0c4e0c431f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:53.830805 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-494cb77c-980b-46c3-b52b-6d0c4e0c431f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045286 Apr 06 16:49:53.831374 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 708/1438] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:53 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:54.117123 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ae8c9034-eaf8-42f6-9b17-7b2effd255ab tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:54.117755 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ae8c9034-eaf8-42f6-9b17-7b2effd255ab tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:54.124398 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae8c9034-eaf8-42f6-9b17-7b2effd255ab tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:54.124895 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae8c9034-eaf8-42f6-9b17-7b2effd255ab tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:54.128447 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae8c9034-eaf8-42f6-9b17-7b2effd255ab tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:54.128447 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae8c9034-eaf8-42f6-9b17-7b2effd255ab tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:54.273631 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ae8c9034-eaf8-42f6-9b17-7b2effd255ab tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:49:54.281585 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ae8c9034-eaf8-42f6-9b17-7b2effd255ab tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.168453 Apr 06 16:49:54.282153 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 731/1439] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:49:54 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:49:54.844595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9f4e46c9-c6d2-4747-814d-4c7552cc20b6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:54.845721 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9f4e46c9-c6d2-4747-814d-4c7552cc20b6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:54.852173 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f4e46c9-c6d2-4747-814d-4c7552cc20b6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:54.852630 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f4e46c9-c6d2-4747-814d-4c7552cc20b6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:54.853434 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f4e46c9-c6d2-4747-814d-4c7552cc20b6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:54.853871 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f4e46c9-c6d2-4747-814d-4c7552cc20b6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:54.883852 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9f4e46c9-c6d2-4747-814d-4c7552cc20b6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045020 Apr 06 16:49:54.884408 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 709/1440] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:54 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:55.299508 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-be11762b-cc62-40eb-be8c-b9c80edd3643 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:55.300112 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-be11762b-cc62-40eb-be8c-b9c80edd3643 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:55.306777 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be11762b-cc62-40eb-be8c-b9c80edd3643 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:55.307225 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be11762b-cc62-40eb-be8c-b9c80edd3643 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:55.307993 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be11762b-cc62-40eb-be8c-b9c80edd3643 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:55.308426 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-be11762b-cc62-40eb-be8c-b9c80edd3643 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:55.444018 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-be11762b-cc62-40eb-be8c-b9c80edd3643 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:49:55.452311 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-be11762b-cc62-40eb-be8c-b9c80edd3643 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.157137 Apr 06 16:49:55.452961 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 732/1441] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:49:55 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:49:55.896353 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-158cc1cd-e132-4636-a353-de882a8d1fbf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:55.897282 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-158cc1cd-e132-4636-a353-de882a8d1fbf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:55.903787 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-158cc1cd-e132-4636-a353-de882a8d1fbf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:55.904226 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-158cc1cd-e132-4636-a353-de882a8d1fbf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:55.905028 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-158cc1cd-e132-4636-a353-de882a8d1fbf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:55.905460 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-158cc1cd-e132-4636-a353-de882a8d1fbf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:55.935103 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-158cc1cd-e132-4636-a353-de882a8d1fbf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043177 Apr 06 16:49:55.935651 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 710/1442] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:55 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:56.469924 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-35a67173-71bc-4bfe-8ef5-d43c5bade4c9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:56.470775 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-35a67173-71bc-4bfe-8ef5-d43c5bade4c9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:56.477354 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35a67173-71bc-4bfe-8ef5-d43c5bade4c9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:56.477816 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35a67173-71bc-4bfe-8ef5-d43c5bade4c9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:56.478602 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35a67173-71bc-4bfe-8ef5-d43c5bade4c9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:56.479036 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35a67173-71bc-4bfe-8ef5-d43c5bade4c9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:56.646890 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-35a67173-71bc-4bfe-8ef5-d43c5bade4c9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:49:56.655346 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-35a67173-71bc-4bfe-8ef5-d43c5bade4c9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.189520 Apr 06 16:49:56.655989 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 733/1443] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:49:56 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:49:56.947975 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d25e1fe0-9c36-4908-b45d-e58be6c8648a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:56.948961 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d25e1fe0-9c36-4908-b45d-e58be6c8648a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:56.955817 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d25e1fe0-9c36-4908-b45d-e58be6c8648a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:56.956306 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d25e1fe0-9c36-4908-b45d-e58be6c8648a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:56.957131 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d25e1fe0-9c36-4908-b45d-e58be6c8648a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:56.957570 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d25e1fe0-9c36-4908-b45d-e58be6c8648a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:56.989352 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d25e1fe0-9c36-4908-b45d-e58be6c8648a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045493 Apr 06 16:49:56.989920 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 711/1444] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:56 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:57.673068 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-64da5f03-4f8d-4080-bd38-b86077817fb6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:57.673730 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-64da5f03-4f8d-4080-bd38-b86077817fb6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:57.684436 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64da5f03-4f8d-4080-bd38-b86077817fb6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:57.684926 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64da5f03-4f8d-4080-bd38-b86077817fb6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:57.685708 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64da5f03-4f8d-4080-bd38-b86077817fb6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:57.686140 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64da5f03-4f8d-4080-bd38-b86077817fb6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:57.825166 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-64da5f03-4f8d-4080-bd38-b86077817fb6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:49:57.833123 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-64da5f03-4f8d-4080-bd38-b86077817fb6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.164179 Apr 06 16:49:57.833706 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 734/1445] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:49:57 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:49:58.002221 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2ddd6d1e-eaa3-4fa3-be59-0fae42f1c71d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:58.003060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2ddd6d1e-eaa3-4fa3-be59-0fae42f1c71d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:58.009871 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ddd6d1e-eaa3-4fa3-be59-0fae42f1c71d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:58.010323 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ddd6d1e-eaa3-4fa3-be59-0fae42f1c71d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:58.011084 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ddd6d1e-eaa3-4fa3-be59-0fae42f1c71d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:58.011516 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ddd6d1e-eaa3-4fa3-be59-0fae42f1c71d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:58.041057 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2ddd6d1e-eaa3-4fa3-be59-0fae42f1c71d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043377 Apr 06 16:49:58.041581 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 712/1446] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:57 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:49:58.850590 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c090e4ed-f25f-4267-a12a-e5c0dfcde7f7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:58.851121 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c090e4ed-f25f-4267-a12a-e5c0dfcde7f7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:58.858366 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c090e4ed-f25f-4267-a12a-e5c0dfcde7f7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:58.858806 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c090e4ed-f25f-4267-a12a-e5c0dfcde7f7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:58.859564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c090e4ed-f25f-4267-a12a-e5c0dfcde7f7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:58.859992 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c090e4ed-f25f-4267-a12a-e5c0dfcde7f7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:59.005561 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c090e4ed-f25f-4267-a12a-e5c0dfcde7f7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:49:59.013698 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c090e4ed-f25f-4267-a12a-e5c0dfcde7f7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.167021 Apr 06 16:49:59.014277 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 735/1447] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:49:58 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:49:59.053258 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-98481f77-5097-4975-8a1b-b0709ab9f1de tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:49:59.054189 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-98481f77-5097-4975-8a1b-b0709ab9f1de tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:49:59.060975 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98481f77-5097-4975-8a1b-b0709ab9f1de tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:59.061424 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98481f77-5097-4975-8a1b-b0709ab9f1de tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:59.062203 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98481f77-5097-4975-8a1b-b0709ab9f1de tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:49:59.062636 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98481f77-5097-4975-8a1b-b0709ab9f1de tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:49:59.092540 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-98481f77-5097-4975-8a1b-b0709ab9f1de tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043394 Apr 06 16:49:59.093130 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 713/1448] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:49:59 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:00.032303 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6dca2c2a-1f9d-4101-9035-7de6656af4fe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:00.032949 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6dca2c2a-1f9d-4101-9035-7de6656af4fe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:00.039662 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6dca2c2a-1f9d-4101-9035-7de6656af4fe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:00.040105 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6dca2c2a-1f9d-4101-9035-7de6656af4fe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:00.040907 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6dca2c2a-1f9d-4101-9035-7de6656af4fe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:00.041336 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6dca2c2a-1f9d-4101-9035-7de6656af4fe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:00.105018 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-adff439f-4c05-4dd7-8222-047deb135900 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:00.105902 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-adff439f-4c05-4dd7-8222-047deb135900 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:00.113405 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adff439f-4c05-4dd7-8222-047deb135900 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:00.113853 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adff439f-4c05-4dd7-8222-047deb135900 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:00.114630 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adff439f-4c05-4dd7-8222-047deb135900 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:00.115065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adff439f-4c05-4dd7-8222-047deb135900 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:00.145140 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-adff439f-4c05-4dd7-8222-047deb135900 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044130 Apr 06 16:50:00.146083 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 714/1449] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:00 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:00.181822 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6dca2c2a-1f9d-4101-9035-7de6656af4fe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:00.190143 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6dca2c2a-1f9d-4101-9035-7de6656af4fe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.161870 Apr 06 16:50:00.190709 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 736/1450] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:00 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:01.157569 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-19316809-63a4-4891-aba3-3e0e73b9ac01 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:01.158621 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-19316809-63a4-4891-aba3-3e0e73b9ac01 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:01.169630 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19316809-63a4-4891-aba3-3e0e73b9ac01 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:01.170376 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19316809-63a4-4891-aba3-3e0e73b9ac01 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:01.171629 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19316809-63a4-4891-aba3-3e0e73b9ac01 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:01.172336 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19316809-63a4-4891-aba3-3e0e73b9ac01 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:01.202070 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-19316809-63a4-4891-aba3-3e0e73b9ac01 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048930 Apr 06 16:50:01.202620 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 715/1451] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:01 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:01.207916 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-45ba66fa-1a75-4107-b81c-4d116ca52c73 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:01.208545 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-45ba66fa-1a75-4107-b81c-4d116ca52c73 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:01.215954 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45ba66fa-1a75-4107-b81c-4d116ca52c73 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:01.216392 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45ba66fa-1a75-4107-b81c-4d116ca52c73 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:01.217197 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45ba66fa-1a75-4107-b81c-4d116ca52c73 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:01.217635 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-45ba66fa-1a75-4107-b81c-4d116ca52c73 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:01.359388 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-45ba66fa-1a75-4107-b81c-4d116ca52c73 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:01.368208 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-45ba66fa-1a75-4107-b81c-4d116ca52c73 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.164488 Apr 06 16:50:01.368826 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 737/1452] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:01 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:02.216629 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b6db719a-a4e4-45a3-b814-830492f3c8a7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:02.217756 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b6db719a-a4e4-45a3-b814-830492f3c8a7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:02.225453 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6db719a-a4e4-45a3-b814-830492f3c8a7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:02.225903 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6db719a-a4e4-45a3-b814-830492f3c8a7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:02.226710 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6db719a-a4e4-45a3-b814-830492f3c8a7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:02.227134 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6db719a-a4e4-45a3-b814-830492f3c8a7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:02.256963 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b6db719a-a4e4-45a3-b814-830492f3c8a7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046586 Apr 06 16:50:02.257509 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 716/1453] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:02 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:02.385718 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-09ad832d-23cd-4557-a6c0-0c5bce373cd3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:02.386317 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-09ad832d-23cd-4557-a6c0-0c5bce373cd3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:02.393421 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09ad832d-23cd-4557-a6c0-0c5bce373cd3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:02.393859 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09ad832d-23cd-4557-a6c0-0c5bce373cd3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:02.394620 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09ad832d-23cd-4557-a6c0-0c5bce373cd3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:02.395045 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09ad832d-23cd-4557-a6c0-0c5bce373cd3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:02.546042 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-09ad832d-23cd-4557-a6c0-0c5bce373cd3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:02.554868 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-09ad832d-23cd-4557-a6c0-0c5bce373cd3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.173020 Apr 06 16:50:02.555435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 738/1454] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:02 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:03.269214 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-57f64d8c-2499-42d8-93f1-175161fce9aa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:03.270034 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-57f64d8c-2499-42d8-93f1-175161fce9aa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:03.276809 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57f64d8c-2499-42d8-93f1-175161fce9aa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:03.277270 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57f64d8c-2499-42d8-93f1-175161fce9aa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:03.278038 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57f64d8c-2499-42d8-93f1-175161fce9aa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:03.278474 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57f64d8c-2499-42d8-93f1-175161fce9aa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:03.307880 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-57f64d8c-2499-42d8-93f1-175161fce9aa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042910 Apr 06 16:50:03.308439 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 717/1455] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:03 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:03.576970 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c5c72815-7416-4ab5-8bd9-6c040ca452d7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:03.577912 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c5c72815-7416-4ab5-8bd9-6c040ca452d7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:03.585280 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5c72815-7416-4ab5-8bd9-6c040ca452d7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:03.585735 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5c72815-7416-4ab5-8bd9-6c040ca452d7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:03.586507 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5c72815-7416-4ab5-8bd9-6c040ca452d7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:03.586946 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5c72815-7416-4ab5-8bd9-6c040ca452d7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:03.743486 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c5c72815-7416-4ab5-8bd9-6c040ca452d7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:03.753857 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c5c72815-7416-4ab5-8bd9-6c040ca452d7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.183691 Apr 06 16:50:03.754441 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 739/1456] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:03 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:04.319957 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5793032e-d935-4303-b90b-3767a573982c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:04.320789 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5793032e-d935-4303-b90b-3767a573982c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:04.327425 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5793032e-d935-4303-b90b-3767a573982c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:04.327881 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5793032e-d935-4303-b90b-3767a573982c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:04.328632 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5793032e-d935-4303-b90b-3767a573982c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:04.329095 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5793032e-d935-4303-b90b-3767a573982c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:04.359909 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5793032e-d935-4303-b90b-3767a573982c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044028 Apr 06 16:50:04.360469 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 718/1457] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:04 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:04.772725 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1f0c3785-ad2d-416e-aa5b-3318c2190dd3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:04.773346 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1f0c3785-ad2d-416e-aa5b-3318c2190dd3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:04.780465 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f0c3785-ad2d-416e-aa5b-3318c2190dd3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:04.780712 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f0c3785-ad2d-416e-aa5b-3318c2190dd3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:04.781533 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f0c3785-ad2d-416e-aa5b-3318c2190dd3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:04.781969 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f0c3785-ad2d-416e-aa5b-3318c2190dd3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:04.919846 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1f0c3785-ad2d-416e-aa5b-3318c2190dd3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:04.927981 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1f0c3785-ad2d-416e-aa5b-3318c2190dd3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.159129 Apr 06 16:50:04.928559 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 740/1458] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:04 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:05.372284 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8cd389ed-25e7-4bf5-a138-853d345d099a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:05.373140 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8cd389ed-25e7-4bf5-a138-853d345d099a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:05.380234 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cd389ed-25e7-4bf5-a138-853d345d099a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:05.380677 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cd389ed-25e7-4bf5-a138-853d345d099a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:05.381488 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cd389ed-25e7-4bf5-a138-853d345d099a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:05.381987 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cd389ed-25e7-4bf5-a138-853d345d099a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:05.411976 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8cd389ed-25e7-4bf5-a138-853d345d099a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043862 Apr 06 16:50:05.412498 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 719/1459] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:05 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:05.950496 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9d6aea51-aa18-44bf-b089-1e8a6d6b498a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:05.951131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9d6aea51-aa18-44bf-b089-1e8a6d6b498a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:05.958151 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d6aea51-aa18-44bf-b089-1e8a6d6b498a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:05.958606 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d6aea51-aa18-44bf-b089-1e8a6d6b498a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:05.959375 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d6aea51-aa18-44bf-b089-1e8a6d6b498a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:05.959816 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d6aea51-aa18-44bf-b089-1e8a6d6b498a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:06.105895 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9d6aea51-aa18-44bf-b089-1e8a6d6b498a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:06.132347 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9d6aea51-aa18-44bf-b089-1e8a6d6b498a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.184869 Apr 06 16:50:06.132670 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 741/1460] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:05 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:06.427094 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-87dcc375-e67c-4dc7-8c3b-3e5995122666 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:06.428200 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-87dcc375-e67c-4dc7-8c3b-3e5995122666 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:06.436325 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87dcc375-e67c-4dc7-8c3b-3e5995122666 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:06.436930 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87dcc375-e67c-4dc7-8c3b-3e5995122666 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:06.437870 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87dcc375-e67c-4dc7-8c3b-3e5995122666 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:06.438433 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87dcc375-e67c-4dc7-8c3b-3e5995122666 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:06.476611 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-87dcc375-e67c-4dc7-8c3b-3e5995122666 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055108 Apr 06 16:50:06.477461 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 720/1461] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:06 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:07.152636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bd5243e6-2e72-49c8-8f8a-cf1996ef5769 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:07.153568 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bd5243e6-2e72-49c8-8f8a-cf1996ef5769 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:07.165423 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd5243e6-2e72-49c8-8f8a-cf1996ef5769 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:07.165870 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd5243e6-2e72-49c8-8f8a-cf1996ef5769 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:07.168944 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd5243e6-2e72-49c8-8f8a-cf1996ef5769 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:07.169391 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd5243e6-2e72-49c8-8f8a-cf1996ef5769 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:07.319195 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-bd5243e6-2e72-49c8-8f8a-cf1996ef5769 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:07.328510 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bd5243e6-2e72-49c8-8f8a-cf1996ef5769 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.181791 Apr 06 16:50:07.329137 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 742/1462] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:07 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:07.489653 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5d1e275e-abad-455b-ae40-41b2068e643d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:07.490493 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5d1e275e-abad-455b-ae40-41b2068e643d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:07.497405 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d1e275e-abad-455b-ae40-41b2068e643d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:07.497861 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d1e275e-abad-455b-ae40-41b2068e643d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:07.498688 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d1e275e-abad-455b-ae40-41b2068e643d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:07.499116 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d1e275e-abad-455b-ae40-41b2068e643d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:07.528774 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5d1e275e-abad-455b-ae40-41b2068e643d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043647 Apr 06 16:50:07.529325 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 721/1463] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:07 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:08.346423 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3a0e5372-07a5-4d45-b808-077b1c19573f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:08.347023 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3a0e5372-07a5-4d45-b808-077b1c19573f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:08.353450 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a0e5372-07a5-4d45-b808-077b1c19573f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:08.353922 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a0e5372-07a5-4d45-b808-077b1c19573f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:08.354695 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a0e5372-07a5-4d45-b808-077b1c19573f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:08.355120 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a0e5372-07a5-4d45-b808-077b1c19573f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:08.496029 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3a0e5372-07a5-4d45-b808-077b1c19573f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:08.510683 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3a0e5372-07a5-4d45-b808-077b1c19573f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.167816 Apr 06 16:50:08.511476 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 743/1464] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:08 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:08.541025 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-09247ea6-d302-4964-a843-c6f1dff4850a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:08.541878 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-09247ea6-d302-4964-a843-c6f1dff4850a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:08.549171 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09247ea6-d302-4964-a843-c6f1dff4850a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:08.549626 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09247ea6-d302-4964-a843-c6f1dff4850a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:08.550422 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09247ea6-d302-4964-a843-c6f1dff4850a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:08.550857 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09247ea6-d302-4964-a843-c6f1dff4850a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:08.580351 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-09247ea6-d302-4964-a843-c6f1dff4850a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043498 Apr 06 16:50:08.580936 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 722/1465] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:08 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:09.534644 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-005543ee-f316-4669-bbd1-113cfab2e28b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:09.535647 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-005543ee-f316-4669-bbd1-113cfab2e28b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:09.547137 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-005543ee-f316-4669-bbd1-113cfab2e28b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:09.547889 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-005543ee-f316-4669-bbd1-113cfab2e28b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:09.549103 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-005543ee-f316-4669-bbd1-113cfab2e28b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:09.549546 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-005543ee-f316-4669-bbd1-113cfab2e28b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:09.595976 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4e7c4e33-7f8a-44c0-8f04-c3a3d948ee11 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:09.596836 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4e7c4e33-7f8a-44c0-8f04-c3a3d948ee11 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:09.603319 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e7c4e33-7f8a-44c0-8f04-c3a3d948ee11 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:09.603765 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e7c4e33-7f8a-44c0-8f04-c3a3d948ee11 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:09.604543 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e7c4e33-7f8a-44c0-8f04-c3a3d948ee11 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:09.605006 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e7c4e33-7f8a-44c0-8f04-c3a3d948ee11 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:09.636146 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4e7c4e33-7f8a-44c0-8f04-c3a3d948ee11 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046629 Apr 06 16:50:09.636744 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 723/1466] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:09 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:50:09.702012 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-005543ee-f316-4669-bbd1-113cfab2e28b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:09.710339 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-005543ee-f316-4669-bbd1-113cfab2e28b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.182271 Apr 06 16:50:09.710971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 744/1467] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:09 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:10.648553 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-771db84e-0fc2-483e-b4dc-8102209c6b3e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:10.649556 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-771db84e-0fc2-483e-b4dc-8102209c6b3e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:10.656723 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-771db84e-0fc2-483e-b4dc-8102209c6b3e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:10.657199 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-771db84e-0fc2-483e-b4dc-8102209c6b3e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:10.658392 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-771db84e-0fc2-483e-b4dc-8102209c6b3e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:10.659097 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-771db84e-0fc2-483e-b4dc-8102209c6b3e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:10.689803 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-771db84e-0fc2-483e-b4dc-8102209c6b3e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045473 Apr 06 16:50:10.690416 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 724/1468] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:10 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:10.728162 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-785f20d9-a200-4618-9fbd-d415a7ca2b1c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:10.728779 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-785f20d9-a200-4618-9fbd-d415a7ca2b1c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:10.742733 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-785f20d9-a200-4618-9fbd-d415a7ca2b1c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:10.742733 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-785f20d9-a200-4618-9fbd-d415a7ca2b1c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:10.742733 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-785f20d9-a200-4618-9fbd-d415a7ca2b1c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:10.742733 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-785f20d9-a200-4618-9fbd-d415a7ca2b1c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:10.882069 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-785f20d9-a200-4618-9fbd-d415a7ca2b1c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:10.893101 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-785f20d9-a200-4618-9fbd-d415a7ca2b1c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.168705 Apr 06 16:50:10.893660 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 745/1469] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:10 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:11.702203 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ec2873b3-b81d-4b59-a892-c6d19072a54a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:11.703138 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ec2873b3-b81d-4b59-a892-c6d19072a54a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:11.710481 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec2873b3-b81d-4b59-a892-c6d19072a54a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:11.710909 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec2873b3-b81d-4b59-a892-c6d19072a54a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:11.712254 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec2873b3-b81d-4b59-a892-c6d19072a54a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:11.713024 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec2873b3-b81d-4b59-a892-c6d19072a54a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:11.744363 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ec2873b3-b81d-4b59-a892-c6d19072a54a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046152 Apr 06 16:50:11.744867 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 725/1470] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:11 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:11.910851 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c7aaaf79-9889-421d-ad5f-1d1d63786cfd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:11.911708 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c7aaaf79-9889-421d-ad5f-1d1d63786cfd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:11.918642 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7aaaf79-9889-421d-ad5f-1d1d63786cfd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:11.919185 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7aaaf79-9889-421d-ad5f-1d1d63786cfd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:11.920010 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7aaaf79-9889-421d-ad5f-1d1d63786cfd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:11.920537 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7aaaf79-9889-421d-ad5f-1d1d63786cfd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:12.060103 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c7aaaf79-9889-421d-ad5f-1d1d63786cfd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:12.069514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c7aaaf79-9889-421d-ad5f-1d1d63786cfd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.162656 Apr 06 16:50:12.070110 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 746/1471] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:11 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:12.756932 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0c8a8045-5f97-48ab-8166-1c8001614d03 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:12.757864 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0c8a8045-5f97-48ab-8166-1c8001614d03 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:12.768367 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c8a8045-5f97-48ab-8166-1c8001614d03 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:12.769192 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c8a8045-5f97-48ab-8166-1c8001614d03 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:12.770519 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c8a8045-5f97-48ab-8166-1c8001614d03 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:12.771238 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c8a8045-5f97-48ab-8166-1c8001614d03 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:12.808625 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0c8a8045-5f97-48ab-8166-1c8001614d03 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056050 Apr 06 16:50:12.809500 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 726/1472] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:12 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:13.090971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-edb5c310-999b-461d-a03e-08626d5403e6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:13.091934 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-edb5c310-999b-461d-a03e-08626d5403e6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:13.100820 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edb5c310-999b-461d-a03e-08626d5403e6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:13.101356 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edb5c310-999b-461d-a03e-08626d5403e6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:13.102266 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edb5c310-999b-461d-a03e-08626d5403e6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:13.102803 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edb5c310-999b-461d-a03e-08626d5403e6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:13.247828 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-edb5c310-999b-461d-a03e-08626d5403e6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:13.257192 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-edb5c310-999b-461d-a03e-08626d5403e6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.172680 Apr 06 16:50:13.258511 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 747/1473] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:13 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:13.824546 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4ceb594b-eb69-465f-9898-f29e667398d4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:13.825825 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4ceb594b-eb69-465f-9898-f29e667398d4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:13.833741 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ceb594b-eb69-465f-9898-f29e667398d4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:13.834197 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ceb594b-eb69-465f-9898-f29e667398d4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:13.834951 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ceb594b-eb69-465f-9898-f29e667398d4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:13.835379 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ceb594b-eb69-465f-9898-f29e667398d4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:13.865728 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4ceb594b-eb69-465f-9898-f29e667398d4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046456 Apr 06 16:50:13.866280 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 727/1474] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:13 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:14.275650 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-08f93fa6-1c34-4907-b95d-b59559771e54 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:14.276239 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-08f93fa6-1c34-4907-b95d-b59559771e54 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:14.282854 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08f93fa6-1c34-4907-b95d-b59559771e54 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:14.283314 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08f93fa6-1c34-4907-b95d-b59559771e54 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:14.284068 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08f93fa6-1c34-4907-b95d-b59559771e54 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:14.284519 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08f93fa6-1c34-4907-b95d-b59559771e54 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:14.434664 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-08f93fa6-1c34-4907-b95d-b59559771e54 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:14.443641 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-08f93fa6-1c34-4907-b95d-b59559771e54 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.171927 Apr 06 16:50:14.444214 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 748/1475] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:14 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:14.881177 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7ddcec71-76bd-4119-9e6e-6528f531767c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:14.882099 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7ddcec71-76bd-4119-9e6e-6528f531767c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:14.888801 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ddcec71-76bd-4119-9e6e-6528f531767c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:14.889246 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ddcec71-76bd-4119-9e6e-6528f531767c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:14.890010 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ddcec71-76bd-4119-9e6e-6528f531767c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:14.890435 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ddcec71-76bd-4119-9e6e-6528f531767c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:14.920553 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7ddcec71-76bd-4119-9e6e-6528f531767c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045523 Apr 06 16:50:14.921135 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 728/1476] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:14 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:15.463627 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-53194ea0-b651-4ff5-a765-35da36f3c8d3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:15.464335 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-53194ea0-b651-4ff5-a765-35da36f3c8d3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:15.471256 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53194ea0-b651-4ff5-a765-35da36f3c8d3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:15.471714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53194ea0-b651-4ff5-a765-35da36f3c8d3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:15.472513 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53194ea0-b651-4ff5-a765-35da36f3c8d3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:15.473284 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53194ea0-b651-4ff5-a765-35da36f3c8d3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:15.620558 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-53194ea0-b651-4ff5-a765-35da36f3c8d3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:15.628940 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-53194ea0-b651-4ff5-a765-35da36f3c8d3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.169248 Apr 06 16:50:15.630015 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 749/1477] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:15 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:15.935872 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0d060593-716f-4df3-8c1c-6a134b0ff147 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:15.936838 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0d060593-716f-4df3-8c1c-6a134b0ff147 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:15.945988 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d060593-716f-4df3-8c1c-6a134b0ff147 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:15.946432 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d060593-716f-4df3-8c1c-6a134b0ff147 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:15.947264 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d060593-716f-4df3-8c1c-6a134b0ff147 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:15.947688 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d060593-716f-4df3-8c1c-6a134b0ff147 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:15.977409 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0d060593-716f-4df3-8c1c-6a134b0ff147 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048248 Apr 06 16:50:15.977957 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 729/1478] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:15 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:16.647568 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-afc87982-cc3e-43ff-b42d-8602339e3459 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:16.648153 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-afc87982-cc3e-43ff-b42d-8602339e3459 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:16.655171 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-afc87982-cc3e-43ff-b42d-8602339e3459 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:16.655620 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-afc87982-cc3e-43ff-b42d-8602339e3459 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:16.656395 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-afc87982-cc3e-43ff-b42d-8602339e3459 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:16.656862 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-afc87982-cc3e-43ff-b42d-8602339e3459 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:16.819380 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-afc87982-cc3e-43ff-b42d-8602339e3459 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:16.830158 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-afc87982-cc3e-43ff-b42d-8602339e3459 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.186771 Apr 06 16:50:16.830742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 750/1479] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:16 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:16.989742 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f4253846-e6e3-4d27-a210-743d932bedb1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:16.990718 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f4253846-e6e3-4d27-a210-743d932bedb1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:16.999045 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4253846-e6e3-4d27-a210-743d932bedb1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:16.999491 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4253846-e6e3-4d27-a210-743d932bedb1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:17.000270 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4253846-e6e3-4d27-a210-743d932bedb1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:17.000719 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4253846-e6e3-4d27-a210-743d932bedb1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:17.037852 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f4253846-e6e3-4d27-a210-743d932bedb1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052581 Apr 06 16:50:17.038444 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 730/1480] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:16 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:17.851662 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5193d15a-1a71-4c08-9fd6-2e1e75efbc7f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:17.852246 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5193d15a-1a71-4c08-9fd6-2e1e75efbc7f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:17.859518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5193d15a-1a71-4c08-9fd6-2e1e75efbc7f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:17.859977 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5193d15a-1a71-4c08-9fd6-2e1e75efbc7f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:17.860787 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5193d15a-1a71-4c08-9fd6-2e1e75efbc7f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:17.861224 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5193d15a-1a71-4c08-9fd6-2e1e75efbc7f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:18.003373 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5193d15a-1a71-4c08-9fd6-2e1e75efbc7f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:18.018081 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5193d15a-1a71-4c08-9fd6-2e1e75efbc7f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.170732 Apr 06 16:50:18.018677 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 751/1481] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:17 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:18.051438 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-958f485e-c5f7-40e0-8181-213414c51b48 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:18.052370 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-958f485e-c5f7-40e0-8181-213414c51b48 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:18.060717 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-958f485e-c5f7-40e0-8181-213414c51b48 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:18.061358 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-958f485e-c5f7-40e0-8181-213414c51b48 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:18.062573 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-958f485e-c5f7-40e0-8181-213414c51b48 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:18.063237 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-958f485e-c5f7-40e0-8181-213414c51b48 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:18.095811 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-958f485e-c5f7-40e0-8181-213414c51b48 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048631 Apr 06 16:50:18.096382 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 731/1482] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:18 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:19.039865 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7913d0fd-d56e-4bbc-b216-4c0c007292d2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:19.040867 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7913d0fd-d56e-4bbc-b216-4c0c007292d2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:19.051581 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7913d0fd-d56e-4bbc-b216-4c0c007292d2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:19.052034 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7913d0fd-d56e-4bbc-b216-4c0c007292d2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:19.052841 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7913d0fd-d56e-4bbc-b216-4c0c007292d2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:19.053281 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7913d0fd-d56e-4bbc-b216-4c0c007292d2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:19.112442 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4e9652eb-4b33-4eec-88b4-23c32ce67d64 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:19.114136 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4e9652eb-4b33-4eec-88b4-23c32ce67d64 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:19.120872 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e9652eb-4b33-4eec-88b4-23c32ce67d64 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:19.121329 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e9652eb-4b33-4eec-88b4-23c32ce67d64 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:19.122109 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e9652eb-4b33-4eec-88b4-23c32ce67d64 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:19.122546 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e9652eb-4b33-4eec-88b4-23c32ce67d64 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:19.153166 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4e9652eb-4b33-4eec-88b4-23c32ce67d64 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047696 Apr 06 16:50:19.157019 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 732/1483] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:19 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:19.205125 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7913d0fd-d56e-4bbc-b216-4c0c007292d2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:19.213359 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7913d0fd-d56e-4bbc-b216-4c0c007292d2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.180372 Apr 06 16:50:19.213950 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 752/1484] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:19 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:20.167617 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-48a5f2ef-bdcc-4f1a-9246-26f78ec57613 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:20.168664 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-48a5f2ef-bdcc-4f1a-9246-26f78ec57613 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:20.175878 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48a5f2ef-bdcc-4f1a-9246-26f78ec57613 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:20.176356 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48a5f2ef-bdcc-4f1a-9246-26f78ec57613 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:20.177213 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48a5f2ef-bdcc-4f1a-9246-26f78ec57613 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:20.177694 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48a5f2ef-bdcc-4f1a-9246-26f78ec57613 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:20.209692 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-48a5f2ef-bdcc-4f1a-9246-26f78ec57613 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047195 Apr 06 16:50:20.210151 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 733/1485] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:20 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:20.232145 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cd5ab882-5f79-441b-b894-d6665360a516 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:20.232749 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cd5ab882-5f79-441b-b894-d6665360a516 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:20.239886 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd5ab882-5f79-441b-b894-d6665360a516 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:20.240329 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd5ab882-5f79-441b-b894-d6665360a516 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:20.241141 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd5ab882-5f79-441b-b894-d6665360a516 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:20.241594 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd5ab882-5f79-441b-b894-d6665360a516 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:20.381689 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-cd5ab882-5f79-441b-b894-d6665360a516 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:20.390542 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cd5ab882-5f79-441b-b894-d6665360a516 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.162770 Apr 06 16:50:20.391124 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 753/1486] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:20 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:21.221837 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-31574f55-2ee3-46d5-9f0f-3e20b717ff49 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:21.222763 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-31574f55-2ee3-46d5-9f0f-3e20b717ff49 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:21.229268 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31574f55-2ee3-46d5-9f0f-3e20b717ff49 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:21.229712 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31574f55-2ee3-46d5-9f0f-3e20b717ff49 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:21.230475 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31574f55-2ee3-46d5-9f0f-3e20b717ff49 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:21.230908 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31574f55-2ee3-46d5-9f0f-3e20b717ff49 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:21.260873 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-31574f55-2ee3-46d5-9f0f-3e20b717ff49 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043017 Apr 06 16:50:21.261437 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 734/1487] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:21 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:21.407795 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1105cfb2-cf38-432d-ae8d-dbb3f33e91be tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:21.408777 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1105cfb2-cf38-432d-ae8d-dbb3f33e91be tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:21.415861 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1105cfb2-cf38-432d-ae8d-dbb3f33e91be tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:21.416310 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1105cfb2-cf38-432d-ae8d-dbb3f33e91be tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:21.417196 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1105cfb2-cf38-432d-ae8d-dbb3f33e91be tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:21.417575 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1105cfb2-cf38-432d-ae8d-dbb3f33e91be tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:21.565678 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1105cfb2-cf38-432d-ae8d-dbb3f33e91be tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:21.573700 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1105cfb2-cf38-432d-ae8d-dbb3f33e91be tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.169920 Apr 06 16:50:21.574286 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 754/1488] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:21 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:22.272796 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ea3e65d8-159e-45c7-b1b6-ccf8988bde61 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:22.273736 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ea3e65d8-159e-45c7-b1b6-ccf8988bde61 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:22.280538 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea3e65d8-159e-45c7-b1b6-ccf8988bde61 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:22.281025 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea3e65d8-159e-45c7-b1b6-ccf8988bde61 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:22.281797 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea3e65d8-159e-45c7-b1b6-ccf8988bde61 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:22.282236 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea3e65d8-159e-45c7-b1b6-ccf8988bde61 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:22.312776 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ea3e65d8-159e-45c7-b1b6-ccf8988bde61 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044132 Apr 06 16:50:22.313342 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 735/1489] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:22 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:22.595547 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eca6cce9-0153-4cec-822c-916decb5d9e7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:22.596517 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eca6cce9-0153-4cec-822c-916decb5d9e7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:22.604069 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eca6cce9-0153-4cec-822c-916decb5d9e7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:22.604518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eca6cce9-0153-4cec-822c-916decb5d9e7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:22.605330 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eca6cce9-0153-4cec-822c-916decb5d9e7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:22.605766 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eca6cce9-0153-4cec-822c-916decb5d9e7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:22.754884 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-eca6cce9-0153-4cec-822c-916decb5d9e7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:22.763694 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eca6cce9-0153-4cec-822c-916decb5d9e7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.174899 Apr 06 16:50:22.764278 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 755/1490] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:22 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:23.324566 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-48845b93-1957-44a2-be66-f95595034651 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:23.325512 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-48845b93-1957-44a2-be66-f95595034651 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:23.332468 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48845b93-1957-44a2-be66-f95595034651 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:23.332954 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48845b93-1957-44a2-be66-f95595034651 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:23.333764 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48845b93-1957-44a2-be66-f95595034651 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:23.334191 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48845b93-1957-44a2-be66-f95595034651 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:23.363974 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-48845b93-1957-44a2-be66-f95595034651 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043396 Apr 06 16:50:23.364513 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 736/1491] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:23 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:23.788807 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c9ce72b2-8bd4-40ef-b47e-981f6ce74693 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:23.789383 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c9ce72b2-8bd4-40ef-b47e-981f6ce74693 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:23.796399 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9ce72b2-8bd4-40ef-b47e-981f6ce74693 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:23.796912 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9ce72b2-8bd4-40ef-b47e-981f6ce74693 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:23.797716 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9ce72b2-8bd4-40ef-b47e-981f6ce74693 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:23.798178 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9ce72b2-8bd4-40ef-b47e-981f6ce74693 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:23.948160 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c9ce72b2-8bd4-40ef-b47e-981f6ce74693 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:23.956229 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c9ce72b2-8bd4-40ef-b47e-981f6ce74693 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.172392 Apr 06 16:50:23.956916 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 756/1492] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:23 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:24.010120 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 16:50:24.010494 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 16:50:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 16:50:24.379409 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-28cf177b-6690-411b-9cc0-326e9f7d3a07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:24.380471 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-28cf177b-6690-411b-9cc0-326e9f7d3a07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:24.390649 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28cf177b-6690-411b-9cc0-326e9f7d3a07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:24.391288 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28cf177b-6690-411b-9cc0-326e9f7d3a07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:24.392514 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28cf177b-6690-411b-9cc0-326e9f7d3a07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:24.393291 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28cf177b-6690-411b-9cc0-326e9f7d3a07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:24.425099 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-28cf177b-6690-411b-9cc0-326e9f7d3a07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052041 Apr 06 16:50:24.425647 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 737/1493] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:24 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:24.973735 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d202049e-d3ef-44db-bfcc-4a0ca48a46f7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:24.974347 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d202049e-d3ef-44db-bfcc-4a0ca48a46f7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:24.980907 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d202049e-d3ef-44db-bfcc-4a0ca48a46f7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:24.981714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d202049e-d3ef-44db-bfcc-4a0ca48a46f7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:24.982476 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d202049e-d3ef-44db-bfcc-4a0ca48a46f7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:24.982910 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d202049e-d3ef-44db-bfcc-4a0ca48a46f7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:25.137626 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d202049e-d3ef-44db-bfcc-4a0ca48a46f7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:25.147940 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d202049e-d3ef-44db-bfcc-4a0ca48a46f7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.178138 Apr 06 16:50:25.148518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 757/1494] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:24 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:25.441458 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0b941953-c4d0-4b8a-8f3d-c5a45a9e8f04 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:25.443177 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0b941953-c4d0-4b8a-8f3d-c5a45a9e8f04 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:25.450072 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b941953-c4d0-4b8a-8f3d-c5a45a9e8f04 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:25.450528 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b941953-c4d0-4b8a-8f3d-c5a45a9e8f04 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:25.451299 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b941953-c4d0-4b8a-8f3d-c5a45a9e8f04 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:25.451730 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b941953-c4d0-4b8a-8f3d-c5a45a9e8f04 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:25.482683 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0b941953-c4d0-4b8a-8f3d-c5a45a9e8f04 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047919 Apr 06 16:50:25.483236 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 738/1495] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:25 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:26.165813 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3504851f-ab7a-46df-8e01-c5a157f76165 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:26.166499 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3504851f-ab7a-46df-8e01-c5a157f76165 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:26.173430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3504851f-ab7a-46df-8e01-c5a157f76165 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:26.173961 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3504851f-ab7a-46df-8e01-c5a157f76165 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:26.174808 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3504851f-ab7a-46df-8e01-c5a157f76165 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:26.175312 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3504851f-ab7a-46df-8e01-c5a157f76165 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:26.318608 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3504851f-ab7a-46df-8e01-c5a157f76165 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:26.326690 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3504851f-ab7a-46df-8e01-c5a157f76165 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.164856 Apr 06 16:50:26.327565 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 758/1496] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:26 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:26.500741 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6f72e743-83df-4e8d-9e7b-a3e7269da741 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:26.502339 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6f72e743-83df-4e8d-9e7b-a3e7269da741 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:26.513584 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f72e743-83df-4e8d-9e7b-a3e7269da741 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:26.514176 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f72e743-83df-4e8d-9e7b-a3e7269da741 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:26.515491 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f72e743-83df-4e8d-9e7b-a3e7269da741 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:26.516241 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f72e743-83df-4e8d-9e7b-a3e7269da741 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:26.548070 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6f72e743-83df-4e8d-9e7b-a3e7269da741 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053955 Apr 06 16:50:26.548645 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 739/1497] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:26 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:27.343748 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f267ba69-b9b0-458a-891d-ef563aed1081 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:27.344358 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f267ba69-b9b0-458a-891d-ef563aed1081 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:27.351200 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f267ba69-b9b0-458a-891d-ef563aed1081 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:27.351653 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f267ba69-b9b0-458a-891d-ef563aed1081 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:27.352480 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f267ba69-b9b0-458a-891d-ef563aed1081 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:27.352922 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f267ba69-b9b0-458a-891d-ef563aed1081 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:27.503334 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f267ba69-b9b0-458a-891d-ef563aed1081 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:27.513100 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f267ba69-b9b0-458a-891d-ef563aed1081 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.172893 Apr 06 16:50:27.513659 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 759/1498] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:27 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:27.560407 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e847267c-7709-4ca4-a3db-6bfb57085783 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:27.561349 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e847267c-7709-4ca4-a3db-6bfb57085783 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:27.568495 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e847267c-7709-4ca4-a3db-6bfb57085783 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:27.568966 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e847267c-7709-4ca4-a3db-6bfb57085783 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:27.569724 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e847267c-7709-4ca4-a3db-6bfb57085783 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:27.570146 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e847267c-7709-4ca4-a3db-6bfb57085783 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:27.599818 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e847267c-7709-4ca4-a3db-6bfb57085783 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043385 Apr 06 16:50:27.600292 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 740/1499] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:27 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:28.533316 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-85266af2-bdd5-4730-818a-452f75b96268 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:28.533927 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-85266af2-bdd5-4730-818a-452f75b96268 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:28.540868 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85266af2-bdd5-4730-818a-452f75b96268 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:28.541316 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85266af2-bdd5-4730-818a-452f75b96268 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:28.542089 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85266af2-bdd5-4730-818a-452f75b96268 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:28.542533 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-85266af2-bdd5-4730-818a-452f75b96268 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:28.612056 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c02e9082-a8ed-45d4-bfdc-43a01497790f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:28.613057 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c02e9082-a8ed-45d4-bfdc-43a01497790f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:28.619541 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c02e9082-a8ed-45d4-bfdc-43a01497790f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:28.620040 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c02e9082-a8ed-45d4-bfdc-43a01497790f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:28.620918 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c02e9082-a8ed-45d4-bfdc-43a01497790f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:28.621235 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c02e9082-a8ed-45d4-bfdc-43a01497790f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:28.651050 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c02e9082-a8ed-45d4-bfdc-43a01497790f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042969 Apr 06 16:50:28.651960 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 741/1500] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:28 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:28.682776 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-85266af2-bdd5-4730-818a-452f75b96268 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:28.690726 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-85266af2-bdd5-4730-818a-452f75b96268 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.161327 Apr 06 16:50:28.691308 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 760/1501] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:28 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:29.663693 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-55decfb3-3c88-4840-95d7-896dccdb7038 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:29.664746 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-55decfb3-3c88-4840-95d7-896dccdb7038 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:29.671873 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55decfb3-3c88-4840-95d7-896dccdb7038 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:29.672318 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55decfb3-3c88-4840-95d7-896dccdb7038 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:29.673142 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55decfb3-3c88-4840-95d7-896dccdb7038 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:29.673570 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55decfb3-3c88-4840-95d7-896dccdb7038 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:29.707579 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-55decfb3-3c88-4840-95d7-896dccdb7038 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048282 Apr 06 16:50:29.708041 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d9d225c2-443f-4286-b808-d80ca2465e72 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:29.708899 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 742/1502] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:29 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:29.713227 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d9d225c2-443f-4286-b808-d80ca2465e72 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:29.720091 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9d225c2-443f-4286-b808-d80ca2465e72 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:29.720491 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9d225c2-443f-4286-b808-d80ca2465e72 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:29.721315 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9d225c2-443f-4286-b808-d80ca2465e72 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:29.721755 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9d225c2-443f-4286-b808-d80ca2465e72 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:29.858461 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d9d225c2-443f-4286-b808-d80ca2465e72 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:29.867109 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d9d225c2-443f-4286-b808-d80ca2465e72 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.163017 Apr 06 16:50:29.867661 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 761/1503] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:29 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:30.720017 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d833c6fa-32ee-41c7-a661-bcbc289a4855 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:30.721835 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d833c6fa-32ee-41c7-a661-bcbc289a4855 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:30.728497 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d833c6fa-32ee-41c7-a661-bcbc289a4855 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:30.728932 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d833c6fa-32ee-41c7-a661-bcbc289a4855 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:30.729694 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d833c6fa-32ee-41c7-a661-bcbc289a4855 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:30.730121 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d833c6fa-32ee-41c7-a661-bcbc289a4855 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:30.760175 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d833c6fa-32ee-41c7-a661-bcbc289a4855 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044142 Apr 06 16:50:30.763963 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 743/1504] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:30 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:30.886377 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-22a99b1a-f7d0-4441-9f5f-51414e75396f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:30.886929 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-22a99b1a-f7d0-4441-9f5f-51414e75396f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:30.893985 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22a99b1a-f7d0-4441-9f5f-51414e75396f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:30.894436 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22a99b1a-f7d0-4441-9f5f-51414e75396f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:30.895285 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22a99b1a-f7d0-4441-9f5f-51414e75396f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:30.895713 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22a99b1a-f7d0-4441-9f5f-51414e75396f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:31.037651 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-22a99b1a-f7d0-4441-9f5f-51414e75396f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:31.046336 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-22a99b1a-f7d0-4441-9f5f-51414e75396f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.163849 Apr 06 16:50:31.046914 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 762/1505] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:30 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:31.776251 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-37a16093-e4f9-418b-bde3-e30aca58dc28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:31.777797 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-37a16093-e4f9-418b-bde3-e30aca58dc28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:31.788424 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37a16093-e4f9-418b-bde3-e30aca58dc28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:31.789228 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37a16093-e4f9-418b-bde3-e30aca58dc28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:31.790523 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37a16093-e4f9-418b-bde3-e30aca58dc28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:31.791246 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37a16093-e4f9-418b-bde3-e30aca58dc28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:31.825180 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-37a16093-e4f9-418b-bde3-e30aca58dc28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055636 Apr 06 16:50:31.825885 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 744/1506] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:31 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:32.067551 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7692ab71-87e3-46ea-b4d9-fa5fae6d8b75 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:32.068176 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7692ab71-87e3-46ea-b4d9-fa5fae6d8b75 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:32.075270 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7692ab71-87e3-46ea-b4d9-fa5fae6d8b75 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:32.075745 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7692ab71-87e3-46ea-b4d9-fa5fae6d8b75 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:32.076555 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7692ab71-87e3-46ea-b4d9-fa5fae6d8b75 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:32.077063 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7692ab71-87e3-46ea-b4d9-fa5fae6d8b75 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:32.239264 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7692ab71-87e3-46ea-b4d9-fa5fae6d8b75 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:32.247733 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7692ab71-87e3-46ea-b4d9-fa5fae6d8b75 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.186755 Apr 06 16:50:32.248318 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 763/1507] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:32 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:32.841849 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ef4522f9-8579-4dd3-8f32-5353be53dff3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:32.843710 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ef4522f9-8579-4dd3-8f32-5353be53dff3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:32.852353 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef4522f9-8579-4dd3-8f32-5353be53dff3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:32.852835 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef4522f9-8579-4dd3-8f32-5353be53dff3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:32.853744 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef4522f9-8579-4dd3-8f32-5353be53dff3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:32.854180 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef4522f9-8579-4dd3-8f32-5353be53dff3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:32.883975 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ef4522f9-8579-4dd3-8f32-5353be53dff3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049263 Apr 06 16:50:32.887847 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 745/1508] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:32 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:32.916904 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 16:50:32.917065 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 16:50:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 16:50:33.269751 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-94f01601-3bf3-4d55-920c-cad2e2eee45f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:33.270965 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-94f01601-3bf3-4d55-920c-cad2e2eee45f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:33.277631 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94f01601-3bf3-4d55-920c-cad2e2eee45f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:33.278125 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94f01601-3bf3-4d55-920c-cad2e2eee45f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:33.278888 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94f01601-3bf3-4d55-920c-cad2e2eee45f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:33.279295 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94f01601-3bf3-4d55-920c-cad2e2eee45f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:33.422667 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-94f01601-3bf3-4d55-920c-cad2e2eee45f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:33.430541 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-94f01601-3bf3-4d55-920c-cad2e2eee45f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.167584 Apr 06 16:50:33.431073 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 764/1509] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:33 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:33.900462 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6bd82d46-5b97-49fc-816f-0b1c7087078b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:33.902041 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6bd82d46-5b97-49fc-816f-0b1c7087078b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:33.910147 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bd82d46-5b97-49fc-816f-0b1c7087078b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:33.910590 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bd82d46-5b97-49fc-816f-0b1c7087078b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:33.911437 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bd82d46-5b97-49fc-816f-0b1c7087078b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:33.912163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bd82d46-5b97-49fc-816f-0b1c7087078b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:33.942113 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6bd82d46-5b97-49fc-816f-0b1c7087078b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048988 Apr 06 16:50:33.942743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 746/1510] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:33 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:34.448447 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-596bc0f5-5db9-41c4-8c36-f6344e9155bc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:34.449060 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-596bc0f5-5db9-41c4-8c36-f6344e9155bc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:34.455720 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-596bc0f5-5db9-41c4-8c36-f6344e9155bc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:34.456257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-596bc0f5-5db9-41c4-8c36-f6344e9155bc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:34.457080 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-596bc0f5-5db9-41c4-8c36-f6344e9155bc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:34.457517 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-596bc0f5-5db9-41c4-8c36-f6344e9155bc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:34.596270 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-596bc0f5-5db9-41c4-8c36-f6344e9155bc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:34.604677 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-596bc0f5-5db9-41c4-8c36-f6344e9155bc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.160294 Apr 06 16:50:34.605282 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 765/1511] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:34 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:34.957057 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b815cc5d-e9de-4d3b-95ad-1e968590fe4e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:34.958522 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b815cc5d-e9de-4d3b-95ad-1e968590fe4e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:34.965004 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b815cc5d-e9de-4d3b-95ad-1e968590fe4e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:34.965463 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b815cc5d-e9de-4d3b-95ad-1e968590fe4e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:34.966238 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b815cc5d-e9de-4d3b-95ad-1e968590fe4e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:34.966676 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b815cc5d-e9de-4d3b-95ad-1e968590fe4e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:34.999362 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b815cc5d-e9de-4d3b-95ad-1e968590fe4e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048406 Apr 06 16:50:34.999928 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 747/1512] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:34 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:35.624284 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0e95882d-eec5-4daa-8526-96015587d7ec tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:35.625039 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0e95882d-eec5-4daa-8526-96015587d7ec tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:35.634049 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e95882d-eec5-4daa-8526-96015587d7ec tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:35.634606 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e95882d-eec5-4daa-8526-96015587d7ec tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:35.635561 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e95882d-eec5-4daa-8526-96015587d7ec tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:35.636099 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e95882d-eec5-4daa-8526-96015587d7ec tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:35.791810 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0e95882d-eec5-4daa-8526-96015587d7ec tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:35.805098 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0e95882d-eec5-4daa-8526-96015587d7ec tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.185385 Apr 06 16:50:35.806150 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 766/1513] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:35 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:36.011819 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8e309a33-c20f-48b5-99e8-86c686629899 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:36.012859 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8e309a33-c20f-48b5-99e8-86c686629899 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:36.020025 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e309a33-c20f-48b5-99e8-86c686629899 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:36.021027 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e309a33-c20f-48b5-99e8-86c686629899 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:36.021950 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e309a33-c20f-48b5-99e8-86c686629899 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:36.022440 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e309a33-c20f-48b5-99e8-86c686629899 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:36.053946 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8e309a33-c20f-48b5-99e8-86c686629899 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045927 Apr 06 16:50:36.054652 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 748/1514] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:36 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:36.833463 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5869ec04-c53d-4d3e-b957-21903ae1ac1d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:36.834486 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5869ec04-c53d-4d3e-b957-21903ae1ac1d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:36.841721 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5869ec04-c53d-4d3e-b957-21903ae1ac1d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:36.842098 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5869ec04-c53d-4d3e-b957-21903ae1ac1d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:36.842852 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5869ec04-c53d-4d3e-b957-21903ae1ac1d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:36.843277 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5869ec04-c53d-4d3e-b957-21903ae1ac1d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:36.981730 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5869ec04-c53d-4d3e-b957-21903ae1ac1d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:36.989715 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5869ec04-c53d-4d3e-b957-21903ae1ac1d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.162806 Apr 06 16:50:36.991803 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 767/1515] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:36 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:37.065891 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-928670ef-55a5-4d29-8777-748e08d4f327 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:37.066836 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-928670ef-55a5-4d29-8777-748e08d4f327 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:37.073465 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-928670ef-55a5-4d29-8777-748e08d4f327 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:37.073921 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-928670ef-55a5-4d29-8777-748e08d4f327 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:37.074688 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-928670ef-55a5-4d29-8777-748e08d4f327 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:37.075120 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-928670ef-55a5-4d29-8777-748e08d4f327 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:37.105022 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-928670ef-55a5-4d29-8777-748e08d4f327 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043065 Apr 06 16:50:37.105928 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 749/1516] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:37 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:38.008717 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aa15b929-2662-4dc7-a0f6-298645130fd9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:38.009363 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aa15b929-2662-4dc7-a0f6-298645130fd9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:38.016175 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa15b929-2662-4dc7-a0f6-298645130fd9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:38.016630 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa15b929-2662-4dc7-a0f6-298645130fd9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:38.017429 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa15b929-2662-4dc7-a0f6-298645130fd9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:38.017867 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa15b929-2662-4dc7-a0f6-298645130fd9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:38.117300 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9cf83dbc-9b29-45b5-8c91-33b63c2ef038 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:38.118200 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9cf83dbc-9b29-45b5-8c91-33b63c2ef038 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:38.124976 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9cf83dbc-9b29-45b5-8c91-33b63c2ef038 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:38.125302 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9cf83dbc-9b29-45b5-8c91-33b63c2ef038 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:38.126137 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9cf83dbc-9b29-45b5-8c91-33b63c2ef038 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:38.126571 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9cf83dbc-9b29-45b5-8c91-33b63c2ef038 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:38.158157 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9cf83dbc-9b29-45b5-8c91-33b63c2ef038 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045022 Apr 06 16:50:38.158301 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-aa15b929-2662-4dc7-a0f6-298645130fd9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:38.158717 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 750/1517] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:38 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:38.166386 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aa15b929-2662-4dc7-a0f6-298645130fd9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.161680 Apr 06 16:50:38.166981 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 768/1518] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:38 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:39.174328 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-908faa0a-43a1-41c8-98d2-f581b64bef50 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:39.175829 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-908faa0a-43a1-41c8-98d2-f581b64bef50 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:39.183168 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-908faa0a-43a1-41c8-98d2-f581b64bef50 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:39.183632 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-908faa0a-43a1-41c8-98d2-f581b64bef50 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:39.184401 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-908faa0a-43a1-41c8-98d2-f581b64bef50 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:39.184873 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-908faa0a-43a1-41c8-98d2-f581b64bef50 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:39.186748 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-05806186-9653-4165-a0f1-27c8ed48c92a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:39.187546 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-05806186-9653-4165-a0f1-27c8ed48c92a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:39.194006 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05806186-9653-4165-a0f1-27c8ed48c92a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:39.194389 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05806186-9653-4165-a0f1-27c8ed48c92a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:39.195237 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05806186-9653-4165-a0f1-27c8ed48c92a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:39.195727 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-05806186-9653-4165-a0f1-27c8ed48c92a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:39.215591 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-908faa0a-43a1-41c8-98d2-f581b64bef50 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047952 Apr 06 16:50:39.216151 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 751/1519] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:39 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:39.333781 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-05806186-9653-4165-a0f1-27c8ed48c92a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:39.342233 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-05806186-9653-4165-a0f1-27c8ed48c92a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.159652 Apr 06 16:50:39.342837 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 769/1520] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:39 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:40.228209 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7d05e920-2ed2-471d-9e44-755372a6588e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:40.229182 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7d05e920-2ed2-471d-9e44-755372a6588e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:40.236080 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d05e920-2ed2-471d-9e44-755372a6588e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:40.236544 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d05e920-2ed2-471d-9e44-755372a6588e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:40.237351 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d05e920-2ed2-471d-9e44-755372a6588e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:40.237784 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d05e920-2ed2-471d-9e44-755372a6588e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:40.267335 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7d05e920-2ed2-471d-9e44-755372a6588e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043615 Apr 06 16:50:40.267875 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 752/1521] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:40 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:40.360307 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-52619638-92b3-4976-9db8-66bd1a1eee12 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:40.360926 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-52619638-92b3-4976-9db8-66bd1a1eee12 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:40.368227 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52619638-92b3-4976-9db8-66bd1a1eee12 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:40.368931 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52619638-92b3-4976-9db8-66bd1a1eee12 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:40.369488 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52619638-92b3-4976-9db8-66bd1a1eee12 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:40.369927 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52619638-92b3-4976-9db8-66bd1a1eee12 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:40.503296 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-52619638-92b3-4976-9db8-66bd1a1eee12 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:40.511763 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-52619638-92b3-4976-9db8-66bd1a1eee12 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.155402 Apr 06 16:50:40.512332 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 770/1522] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:40 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:41.280123 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fe10c789-c82c-48bb-a8ca-6e908dd94963 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:41.281187 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fe10c789-c82c-48bb-a8ca-6e908dd94963 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:41.288286 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe10c789-c82c-48bb-a8ca-6e908dd94963 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:41.288843 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe10c789-c82c-48bb-a8ca-6e908dd94963 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:41.289688 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe10c789-c82c-48bb-a8ca-6e908dd94963 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:41.290172 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe10c789-c82c-48bb-a8ca-6e908dd94963 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:41.320917 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fe10c789-c82c-48bb-a8ca-6e908dd94963 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045123 Apr 06 16:50:41.321470 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 753/1523] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:41 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:41.535349 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-894be233-6413-4151-be69-a007edbc6f3a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:41.535976 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-894be233-6413-4151-be69-a007edbc6f3a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:41.542668 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-894be233-6413-4151-be69-a007edbc6f3a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:41.543122 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-894be233-6413-4151-be69-a007edbc6f3a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:41.543890 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-894be233-6413-4151-be69-a007edbc6f3a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:41.544331 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-894be233-6413-4151-be69-a007edbc6f3a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:41.684530 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-894be233-6413-4151-be69-a007edbc6f3a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:41.692958 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-894be233-6413-4151-be69-a007edbc6f3a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.161620 Apr 06 16:50:41.693913 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 771/1524] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:41 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:42.332213 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-19a7d5bd-0f4c-4b48-a081-438c835ea733 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:42.333244 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-19a7d5bd-0f4c-4b48-a081-438c835ea733 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:42.339597 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19a7d5bd-0f4c-4b48-a081-438c835ea733 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:42.340054 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19a7d5bd-0f4c-4b48-a081-438c835ea733 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:42.340859 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19a7d5bd-0f4c-4b48-a081-438c835ea733 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:42.341302 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19a7d5bd-0f4c-4b48-a081-438c835ea733 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:42.371256 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-19a7d5bd-0f4c-4b48-a081-438c835ea733 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042871 Apr 06 16:50:42.371823 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 754/1525] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:42 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:42.711447 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dfc9f609-b924-4555-ba8c-4ff16ee2b71f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:42.712113 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dfc9f609-b924-4555-ba8c-4ff16ee2b71f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:42.719113 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfc9f609-b924-4555-ba8c-4ff16ee2b71f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:42.719595 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfc9f609-b924-4555-ba8c-4ff16ee2b71f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:42.720372 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfc9f609-b924-4555-ba8c-4ff16ee2b71f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:42.720842 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfc9f609-b924-4555-ba8c-4ff16ee2b71f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:42.862215 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-dfc9f609-b924-4555-ba8c-4ff16ee2b71f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:42.870766 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dfc9f609-b924-4555-ba8c-4ff16ee2b71f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.163602 Apr 06 16:50:42.871347 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 772/1526] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:42 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:43.385168 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5246f448-1c0b-49fc-98e4-b895a7d732dd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:43.386352 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5246f448-1c0b-49fc-98e4-b895a7d732dd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:43.398157 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5246f448-1c0b-49fc-98e4-b895a7d732dd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:43.398610 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5246f448-1c0b-49fc-98e4-b895a7d732dd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:43.399394 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5246f448-1c0b-49fc-98e4-b895a7d732dd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:43.399821 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5246f448-1c0b-49fc-98e4-b895a7d732dd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:43.429261 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5246f448-1c0b-49fc-98e4-b895a7d732dd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050222 Apr 06 16:50:43.429798 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 755/1527] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:43 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:43.890162 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bd200cb6-e1b0-453a-b297-3cd028f6ef39 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:43.890799 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bd200cb6-e1b0-453a-b297-3cd028f6ef39 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:43.897739 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd200cb6-e1b0-453a-b297-3cd028f6ef39 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:43.898188 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd200cb6-e1b0-453a-b297-3cd028f6ef39 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:43.898947 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd200cb6-e1b0-453a-b297-3cd028f6ef39 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:43.899376 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd200cb6-e1b0-453a-b297-3cd028f6ef39 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:44.043056 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-bd200cb6-e1b0-453a-b297-3cd028f6ef39 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:44.051054 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bd200cb6-e1b0-453a-b297-3cd028f6ef39 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.164912 Apr 06 16:50:44.051620 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 773/1528] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:43 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:44.441140 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-474b69da-d1f3-4a01-b019-b37eba4cca44 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:44.442074 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-474b69da-d1f3-4a01-b019-b37eba4cca44 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:44.448780 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-474b69da-d1f3-4a01-b019-b37eba4cca44 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:44.449235 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-474b69da-d1f3-4a01-b019-b37eba4cca44 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:44.450016 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-474b69da-d1f3-4a01-b019-b37eba4cca44 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:44.450447 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-474b69da-d1f3-4a01-b019-b37eba4cca44 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:44.480066 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-474b69da-d1f3-4a01-b019-b37eba4cca44 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042903 Apr 06 16:50:44.481022 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 756/1529] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:44 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:45.068977 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9e515c19-f832-4b8b-86b8-d2097088bdb8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:45.069631 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9e515c19-f832-4b8b-86b8-d2097088bdb8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:45.076295 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e515c19-f832-4b8b-86b8-d2097088bdb8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:45.076796 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e515c19-f832-4b8b-86b8-d2097088bdb8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:45.077566 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e515c19-f832-4b8b-86b8-d2097088bdb8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:45.078052 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e515c19-f832-4b8b-86b8-d2097088bdb8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:45.234430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9e515c19-f832-4b8b-86b8-d2097088bdb8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:45.247597 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9e515c19-f832-4b8b-86b8-d2097088bdb8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.182426 Apr 06 16:50:45.248459 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 774/1530] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:45 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:45.492077 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1949a28c-ab5c-4a9b-b4dd-ab435bef0efb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:45.493040 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1949a28c-ab5c-4a9b-b4dd-ab435bef0efb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:45.501963 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1949a28c-ab5c-4a9b-b4dd-ab435bef0efb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:45.501963 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1949a28c-ab5c-4a9b-b4dd-ab435bef0efb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:45.501963 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1949a28c-ab5c-4a9b-b4dd-ab435bef0efb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:45.501963 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1949a28c-ab5c-4a9b-b4dd-ab435bef0efb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:45.532721 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1949a28c-ab5c-4a9b-b4dd-ab435bef0efb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045104 Apr 06 16:50:45.533286 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 757/1531] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:45 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:46.268306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3d604b3b-f827-406a-ae16-7fc322bb1c57 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:46.269013 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3d604b3b-f827-406a-ae16-7fc322bb1c57 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:46.275977 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d604b3b-f827-406a-ae16-7fc322bb1c57 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:46.276427 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d604b3b-f827-406a-ae16-7fc322bb1c57 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:46.277228 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d604b3b-f827-406a-ae16-7fc322bb1c57 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:46.277663 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d604b3b-f827-406a-ae16-7fc322bb1c57 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:46.418642 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3d604b3b-f827-406a-ae16-7fc322bb1c57 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:46.427124 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3d604b3b-f827-406a-ae16-7fc322bb1c57 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.162823 Apr 06 16:50:46.427810 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 775/1532] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:46 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:46.544431 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d0a2f569-9aa9-44e6-9427-7903b391639e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:46.545967 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d0a2f569-9aa9-44e6-9427-7903b391639e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:46.561507 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0a2f569-9aa9-44e6-9427-7903b391639e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:46.561961 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0a2f569-9aa9-44e6-9427-7903b391639e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:46.562738 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0a2f569-9aa9-44e6-9427-7903b391639e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:46.563141 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0a2f569-9aa9-44e6-9427-7903b391639e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:46.593382 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d0a2f569-9aa9-44e6-9427-7903b391639e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052948 Apr 06 16:50:46.594132 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 758/1533] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:46 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:47.445635 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a58b3d66-65ce-4956-8085-645f0ffdc3e3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:47.446217 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a58b3d66-65ce-4956-8085-645f0ffdc3e3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:47.453021 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a58b3d66-65ce-4956-8085-645f0ffdc3e3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:47.453467 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a58b3d66-65ce-4956-8085-645f0ffdc3e3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:47.454228 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a58b3d66-65ce-4956-8085-645f0ffdc3e3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:47.454651 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a58b3d66-65ce-4956-8085-645f0ffdc3e3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:47.593781 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a58b3d66-65ce-4956-8085-645f0ffdc3e3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:47.605967 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a58b3d66-65ce-4956-8085-645f0ffdc3e3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.165448 Apr 06 16:50:47.606556 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 776/1534] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:47 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:47.615790 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7462d640-2512-4a89-8f09-bade74b92761 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:47.615790 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7462d640-2512-4a89-8f09-bade74b92761 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:47.616499 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7462d640-2512-4a89-8f09-bade74b92761 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:47.616762 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7462d640-2512-4a89-8f09-bade74b92761 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:47.617548 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7462d640-2512-4a89-8f09-bade74b92761 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:47.617981 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7462d640-2512-4a89-8f09-bade74b92761 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:47.649982 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7462d640-2512-4a89-8f09-bade74b92761 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047814 Apr 06 16:50:47.650553 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 759/1535] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:47 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:50:48.627206 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b944e558-6c41-4522-8463-15223b1d8705 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:48.628152 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b944e558-6c41-4522-8463-15223b1d8705 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:48.639091 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b944e558-6c41-4522-8463-15223b1d8705 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:48.639835 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b944e558-6c41-4522-8463-15223b1d8705 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:48.641144 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b944e558-6c41-4522-8463-15223b1d8705 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:48.641856 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b944e558-6c41-4522-8463-15223b1d8705 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:48.663052 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-017c94d2-49b7-44fd-aef1-02bc58e7f939 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:48.664459 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-017c94d2-49b7-44fd-aef1-02bc58e7f939 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:48.675060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-017c94d2-49b7-44fd-aef1-02bc58e7f939 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:48.675797 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-017c94d2-49b7-44fd-aef1-02bc58e7f939 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:48.676714 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-017c94d2-49b7-44fd-aef1-02bc58e7f939 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:48.677256 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-017c94d2-49b7-44fd-aef1-02bc58e7f939 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:48.708105 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-017c94d2-49b7-44fd-aef1-02bc58e7f939 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050256 Apr 06 16:50:48.709179 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 760/1536] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:48 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:50:48.786240 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b944e558-6c41-4522-8463-15223b1d8705 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:48.799072 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b944e558-6c41-4522-8463-15223b1d8705 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.178079 Apr 06 16:50:48.799873 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 777/1537] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:48 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:49.723849 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f3ef8959-8ce1-46a5-894d-af45209db1ff tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:49.724820 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f3ef8959-8ce1-46a5-894d-af45209db1ff tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:49.732420 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3ef8959-8ce1-46a5-894d-af45209db1ff tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:49.732911 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3ef8959-8ce1-46a5-894d-af45209db1ff tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:49.733691 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3ef8959-8ce1-46a5-894d-af45209db1ff tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:49.734122 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3ef8959-8ce1-46a5-894d-af45209db1ff tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:49.785329 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f3ef8959-8ce1-46a5-894d-af45209db1ff tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067950 Apr 06 16:50:49.786361 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 761/1538] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:49 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:49.818018 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e2e41b6a-e5a4-4a4e-92a1-8001bc3bf7b3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:49.818643 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e2e41b6a-e5a4-4a4e-92a1-8001bc3bf7b3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:49.826410 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2e41b6a-e5a4-4a4e-92a1-8001bc3bf7b3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:49.826779 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2e41b6a-e5a4-4a4e-92a1-8001bc3bf7b3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:49.827538 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2e41b6a-e5a4-4a4e-92a1-8001bc3bf7b3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:49.827965 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2e41b6a-e5a4-4a4e-92a1-8001bc3bf7b3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:49.968536 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e2e41b6a-e5a4-4a4e-92a1-8001bc3bf7b3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:49.977257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e2e41b6a-e5a4-4a4e-92a1-8001bc3bf7b3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.163223 Apr 06 16:50:49.977854 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 778/1539] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:49 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:50.798058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d7e84af2-fb34-4cfd-b8e7-2c1e7115c248 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:50.799020 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d7e84af2-fb34-4cfd-b8e7-2c1e7115c248 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:50.805948 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7e84af2-fb34-4cfd-b8e7-2c1e7115c248 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:50.806403 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7e84af2-fb34-4cfd-b8e7-2c1e7115c248 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:50.807220 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7e84af2-fb34-4cfd-b8e7-2c1e7115c248 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:50.807655 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7e84af2-fb34-4cfd-b8e7-2c1e7115c248 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:50.837670 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d7e84af2-fb34-4cfd-b8e7-2c1e7115c248 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043602 Apr 06 16:50:50.838260 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 762/1540] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:50 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:50.994920 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-059e8a49-9c9e-4814-a2e2-11cfacec266d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:50.995521 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-059e8a49-9c9e-4814-a2e2-11cfacec266d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:51.002156 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-059e8a49-9c9e-4814-a2e2-11cfacec266d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:51.002651 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-059e8a49-9c9e-4814-a2e2-11cfacec266d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:51.003468 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-059e8a49-9c9e-4814-a2e2-11cfacec266d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:51.004073 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-059e8a49-9c9e-4814-a2e2-11cfacec266d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:51.144164 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-059e8a49-9c9e-4814-a2e2-11cfacec266d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:51.152253 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-059e8a49-9c9e-4814-a2e2-11cfacec266d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.161276 Apr 06 16:50:51.152829 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 779/1541] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:50 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:51.850122 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-76bb69a3-3c29-402b-9745-2790684e3c4c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:51.851490 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-76bb69a3-3c29-402b-9745-2790684e3c4c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:51.858811 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76bb69a3-3c29-402b-9745-2790684e3c4c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:51.859263 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76bb69a3-3c29-402b-9745-2790684e3c4c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:51.860037 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76bb69a3-3c29-402b-9745-2790684e3c4c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:51.860470 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76bb69a3-3c29-402b-9745-2790684e3c4c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:51.899244 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-76bb69a3-3c29-402b-9745-2790684e3c4c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053218 Apr 06 16:50:51.900064 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 763/1542] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:51 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:52.173739 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c72eab3b-2342-4c30-87a3-cdab3dd219c1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:52.174662 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c72eab3b-2342-4c30-87a3-cdab3dd219c1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:52.183069 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c72eab3b-2342-4c30-87a3-cdab3dd219c1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:52.183520 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c72eab3b-2342-4c30-87a3-cdab3dd219c1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:52.184290 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c72eab3b-2342-4c30-87a3-cdab3dd219c1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:52.184729 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c72eab3b-2342-4c30-87a3-cdab3dd219c1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:52.346282 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c72eab3b-2342-4c30-87a3-cdab3dd219c1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:52.354577 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c72eab3b-2342-4c30-87a3-cdab3dd219c1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.187455 Apr 06 16:50:52.355544 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 780/1543] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:52 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:52.914334 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5b8d2a23-68bb-4ef3-956d-e1dfe9e170e5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:52.915279 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5b8d2a23-68bb-4ef3-956d-e1dfe9e170e5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:52.921701 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b8d2a23-68bb-4ef3-956d-e1dfe9e170e5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:52.922160 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b8d2a23-68bb-4ef3-956d-e1dfe9e170e5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:52.922925 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b8d2a23-68bb-4ef3-956d-e1dfe9e170e5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:52.923362 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b8d2a23-68bb-4ef3-956d-e1dfe9e170e5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:52.952520 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5b8d2a23-68bb-4ef3-956d-e1dfe9e170e5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043768 Apr 06 16:50:52.953185 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 764/1544] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:52 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:53.371795 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2949df85-c478-40dc-acc8-6359dd3347a6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:53.372365 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2949df85-c478-40dc-acc8-6359dd3347a6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:53.379255 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2949df85-c478-40dc-acc8-6359dd3347a6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:53.379706 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2949df85-c478-40dc-acc8-6359dd3347a6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:53.380503 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2949df85-c478-40dc-acc8-6359dd3347a6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:53.380976 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2949df85-c478-40dc-acc8-6359dd3347a6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:53.522094 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2949df85-c478-40dc-acc8-6359dd3347a6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:53.530706 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2949df85-c478-40dc-acc8-6359dd3347a6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.162913 Apr 06 16:50:53.531257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 781/1545] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:53 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:53.963747 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-65d9c21c-491c-4b6e-b735-d2d08206afd8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:53.964672 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-65d9c21c-491c-4b6e-b735-d2d08206afd8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:53.971693 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65d9c21c-491c-4b6e-b735-d2d08206afd8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:53.972138 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65d9c21c-491c-4b6e-b735-d2d08206afd8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:53.972930 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65d9c21c-491c-4b6e-b735-d2d08206afd8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:53.973355 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65d9c21c-491c-4b6e-b735-d2d08206afd8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:54.006695 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-65d9c21c-491c-4b6e-b735-d2d08206afd8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046990 Apr 06 16:50:54.007239 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 765/1546] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:53 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:54.548943 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-442e184c-73d0-483f-9801-184e8ff69033 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:54.549524 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-442e184c-73d0-483f-9801-184e8ff69033 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:54.557108 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-442e184c-73d0-483f-9801-184e8ff69033 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:54.557558 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-442e184c-73d0-483f-9801-184e8ff69033 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:54.558325 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-442e184c-73d0-483f-9801-184e8ff69033 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:54.558772 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-442e184c-73d0-483f-9801-184e8ff69033 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:54.694814 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-442e184c-73d0-483f-9801-184e8ff69033 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:54.702894 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-442e184c-73d0-483f-9801-184e8ff69033 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.158115 Apr 06 16:50:54.703567 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 782/1547] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:54 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:55.019765 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b06f2c62-f447-491e-a641-74b99e8471cc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:55.020720 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b06f2c62-f447-491e-a641-74b99e8471cc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:55.027591 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b06f2c62-f447-491e-a641-74b99e8471cc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:55.028044 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b06f2c62-f447-491e-a641-74b99e8471cc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:55.028867 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b06f2c62-f447-491e-a641-74b99e8471cc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:55.029307 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b06f2c62-f447-491e-a641-74b99e8471cc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:55.058751 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b06f2c62-f447-491e-a641-74b99e8471cc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042979 Apr 06 16:50:55.059335 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 766/1548] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:55 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:55.720561 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-06c178b4-ea18-4b0a-a432-0a9284dc0d3e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:55.721170 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-06c178b4-ea18-4b0a-a432-0a9284dc0d3e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:55.728171 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06c178b4-ea18-4b0a-a432-0a9284dc0d3e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:55.728621 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06c178b4-ea18-4b0a-a432-0a9284dc0d3e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:55.729437 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06c178b4-ea18-4b0a-a432-0a9284dc0d3e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:55.729872 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06c178b4-ea18-4b0a-a432-0a9284dc0d3e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:55.865769 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-06c178b4-ea18-4b0a-a432-0a9284dc0d3e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:55.873673 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-06c178b4-ea18-4b0a-a432-0a9284dc0d3e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.157038 Apr 06 16:50:55.874238 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 783/1549] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:55 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:56.070858 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-60052c30-78a9-4514-a065-ab421a63b38a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:56.071963 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-60052c30-78a9-4514-a065-ab421a63b38a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:56.081143 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60052c30-78a9-4514-a065-ab421a63b38a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:56.081595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60052c30-78a9-4514-a065-ab421a63b38a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:56.082376 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60052c30-78a9-4514-a065-ab421a63b38a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:56.082814 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60052c30-78a9-4514-a065-ab421a63b38a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:56.113015 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-60052c30-78a9-4514-a065-ab421a63b38a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046535 Apr 06 16:50:56.113572 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 767/1550] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:56 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:56.891300 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c713d47e-0009-4b4a-9b19-eed38486e757 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:56.891923 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c713d47e-0009-4b4a-9b19-eed38486e757 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:56.898891 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c713d47e-0009-4b4a-9b19-eed38486e757 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:56.899353 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c713d47e-0009-4b4a-9b19-eed38486e757 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:56.900141 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c713d47e-0009-4b4a-9b19-eed38486e757 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:56.900576 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c713d47e-0009-4b4a-9b19-eed38486e757 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:57.040357 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c713d47e-0009-4b4a-9b19-eed38486e757 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:57.048560 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c713d47e-0009-4b4a-9b19-eed38486e757 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.161392 Apr 06 16:50:57.049199 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 784/1551] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:56 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:57.125548 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a2ada05f-078c-4418-a612-585e0cfaf7ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:57.126499 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a2ada05f-078c-4418-a612-585e0cfaf7ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:57.133204 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2ada05f-078c-4418-a612-585e0cfaf7ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:57.133668 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2ada05f-078c-4418-a612-585e0cfaf7ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:57.134438 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2ada05f-078c-4418-a612-585e0cfaf7ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:57.134873 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2ada05f-078c-4418-a612-585e0cfaf7ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:57.164068 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a2ada05f-078c-4418-a612-585e0cfaf7ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042435 Apr 06 16:50:57.164533 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 768/1552] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:57 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:58.066408 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1f16c9a2-c566-431f-ae2a-5d303f5e173a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:58.067026 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1f16c9a2-c566-431f-ae2a-5d303f5e173a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:58.074019 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f16c9a2-c566-431f-ae2a-5d303f5e173a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:58.074470 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f16c9a2-c566-431f-ae2a-5d303f5e173a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:58.075242 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f16c9a2-c566-431f-ae2a-5d303f5e173a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:58.075686 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f16c9a2-c566-431f-ae2a-5d303f5e173a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:58.175439 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5fa53ff7-c7d2-47ea-9104-32d564027ba7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:58.176397 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5fa53ff7-c7d2-47ea-9104-32d564027ba7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:58.182914 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fa53ff7-c7d2-47ea-9104-32d564027ba7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:58.183361 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fa53ff7-c7d2-47ea-9104-32d564027ba7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:58.184125 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fa53ff7-c7d2-47ea-9104-32d564027ba7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:58.184549 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fa53ff7-c7d2-47ea-9104-32d564027ba7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:58.214154 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5fa53ff7-c7d2-47ea-9104-32d564027ba7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042302 Apr 06 16:50:58.214706 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 769/1553] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:58 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:50:58.216287 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1f16c9a2-c566-431f-ae2a-5d303f5e173a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:58.224165 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1f16c9a2-c566-431f-ae2a-5d303f5e173a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.161745 Apr 06 16:50:58.224783 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 785/1554] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:58 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:50:59.226641 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-32d38714-582b-4de2-8962-23b157ae7b60 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:59.227576 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-32d38714-582b-4de2-8962-23b157ae7b60 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:59.234454 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32d38714-582b-4de2-8962-23b157ae7b60 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:59.234906 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32d38714-582b-4de2-8962-23b157ae7b60 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:59.235666 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32d38714-582b-4de2-8962-23b157ae7b60 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:59.236101 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32d38714-582b-4de2-8962-23b157ae7b60 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:59.241711 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-415f3058-e3ef-4a41-9518-a31b8eae8fd4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:50:59.242457 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-415f3058-e3ef-4a41-9518-a31b8eae8fd4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:50:59.249259 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-415f3058-e3ef-4a41-9518-a31b8eae8fd4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:59.249720 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-415f3058-e3ef-4a41-9518-a31b8eae8fd4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:59.250499 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-415f3058-e3ef-4a41-9518-a31b8eae8fd4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:50:59.250941 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-415f3058-e3ef-4a41-9518-a31b8eae8fd4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:50:59.266163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-32d38714-582b-4de2-8962-23b157ae7b60 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044052 Apr 06 16:50:59.266736 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 770/1555] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:50:59 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:50:59.391522 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-415f3058-e3ef-4a41-9518-a31b8eae8fd4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:50:59.400349 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-415f3058-e3ef-4a41-9518-a31b8eae8fd4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.162713 Apr 06 16:50:59.401012 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 786/1556] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:50:59 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:00.278120 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-90883397-2347-4a89-8bf7-a5c5879e77df tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:00.279060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-90883397-2347-4a89-8bf7-a5c5879e77df tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:00.285806 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90883397-2347-4a89-8bf7-a5c5879e77df tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:00.286251 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90883397-2347-4a89-8bf7-a5c5879e77df tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:00.287060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90883397-2347-4a89-8bf7-a5c5879e77df tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:00.287502 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90883397-2347-4a89-8bf7-a5c5879e77df tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:00.321487 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-90883397-2347-4a89-8bf7-a5c5879e77df tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047383 Apr 06 16:51:00.322089 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 771/1557] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:00 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:00.417884 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1808255f-e521-466b-933e-0dd35bbdcec4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:00.418508 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1808255f-e521-466b-933e-0dd35bbdcec4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:00.425339 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1808255f-e521-466b-933e-0dd35bbdcec4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:00.425780 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1808255f-e521-466b-933e-0dd35bbdcec4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:00.426549 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1808255f-e521-466b-933e-0dd35bbdcec4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:00.426987 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1808255f-e521-466b-933e-0dd35bbdcec4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:00.562082 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1808255f-e521-466b-933e-0dd35bbdcec4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:00.570730 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1808255f-e521-466b-933e-0dd35bbdcec4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.156927 Apr 06 16:51:00.571310 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 787/1558] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:00 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:01.333597 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9d62c486-f13d-4ff6-92f4-47e63233ff54 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:01.335394 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9d62c486-f13d-4ff6-92f4-47e63233ff54 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:01.341509 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d62c486-f13d-4ff6-92f4-47e63233ff54 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:01.341955 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d62c486-f13d-4ff6-92f4-47e63233ff54 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:01.342735 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d62c486-f13d-4ff6-92f4-47e63233ff54 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:01.343172 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d62c486-f13d-4ff6-92f4-47e63233ff54 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:01.374039 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9d62c486-f13d-4ff6-92f4-47e63233ff54 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044343 Apr 06 16:51:01.374477 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 772/1559] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:01 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:01.587811 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d12c057b-74af-4a01-af4c-a263c7744c5d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:01.588420 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d12c057b-74af-4a01-af4c-a263c7744c5d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:01.595170 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d12c057b-74af-4a01-af4c-a263c7744c5d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:01.595615 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d12c057b-74af-4a01-af4c-a263c7744c5d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:01.596378 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d12c057b-74af-4a01-af4c-a263c7744c5d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:01.596841 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d12c057b-74af-4a01-af4c-a263c7744c5d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:01.740973 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d12c057b-74af-4a01-af4c-a263c7744c5d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:01.749117 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d12c057b-74af-4a01-af4c-a263c7744c5d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.165450 Apr 06 16:51:01.749688 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 788/1560] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:01 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:02.387873 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f2ee32af-7865-4e60-a229-90029928a63c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:02.388854 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f2ee32af-7865-4e60-a229-90029928a63c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:02.397040 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2ee32af-7865-4e60-a229-90029928a63c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:02.397509 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2ee32af-7865-4e60-a229-90029928a63c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:02.398305 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2ee32af-7865-4e60-a229-90029928a63c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:02.398732 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2ee32af-7865-4e60-a229-90029928a63c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:02.431827 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f2ee32af-7865-4e60-a229-90029928a63c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048862 Apr 06 16:51:02.432415 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 773/1561] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:02 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:02.766845 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-586d0f77-ae69-450e-b489-028e72cf241d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:02.767443 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-586d0f77-ae69-450e-b489-028e72cf241d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:02.774547 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-586d0f77-ae69-450e-b489-028e72cf241d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:02.774968 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-586d0f77-ae69-450e-b489-028e72cf241d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:02.775767 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-586d0f77-ae69-450e-b489-028e72cf241d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:02.776204 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-586d0f77-ae69-450e-b489-028e72cf241d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:02.919083 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-586d0f77-ae69-450e-b489-028e72cf241d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:02.927285 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-586d0f77-ae69-450e-b489-028e72cf241d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.164436 Apr 06 16:51:02.927867 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 789/1562] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:02 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:03.444348 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a3569b0d-383e-4573-9005-b8b955615ebd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:03.445519 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a3569b0d-383e-4573-9005-b8b955615ebd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:03.452556 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3569b0d-383e-4573-9005-b8b955615ebd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:03.453042 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3569b0d-383e-4573-9005-b8b955615ebd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:03.453820 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3569b0d-383e-4573-9005-b8b955615ebd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:03.454246 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3569b0d-383e-4573-9005-b8b955615ebd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:03.487780 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a3569b0d-383e-4573-9005-b8b955615ebd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047551 Apr 06 16:51:03.488336 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 774/1563] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:03 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:03.951289 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aa016f99-fdc3-41f3-b6a7-b2664f736add tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:03.951884 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aa016f99-fdc3-41f3-b6a7-b2664f736add tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:03.959908 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa016f99-fdc3-41f3-b6a7-b2664f736add tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:03.960349 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa016f99-fdc3-41f3-b6a7-b2664f736add tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:03.961176 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa016f99-fdc3-41f3-b6a7-b2664f736add tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:03.961612 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aa016f99-fdc3-41f3-b6a7-b2664f736add tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:04.106955 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-aa016f99-fdc3-41f3-b6a7-b2664f736add tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:04.114845 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aa016f99-fdc3-41f3-b6a7-b2664f736add tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.169096 Apr 06 16:51:04.115435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 790/1564] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:03 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:04.500402 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bdc0da56-487f-4a3f-913f-3c67b89694d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:04.501383 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bdc0da56-487f-4a3f-913f-3c67b89694d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:04.507614 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bdc0da56-487f-4a3f-913f-3c67b89694d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:04.508041 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bdc0da56-487f-4a3f-913f-3c67b89694d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:04.508978 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bdc0da56-487f-4a3f-913f-3c67b89694d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:04.509472 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bdc0da56-487f-4a3f-913f-3c67b89694d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:04.546743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bdc0da56-487f-4a3f-913f-3c67b89694d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050392 Apr 06 16:51:04.547319 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 775/1565] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:04 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:05.131995 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-39a56a36-4e16-4bc3-9f0c-91a43caee337 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:05.132659 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-39a56a36-4e16-4bc3-9f0c-91a43caee337 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:05.146303 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39a56a36-4e16-4bc3-9f0c-91a43caee337 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:05.147233 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39a56a36-4e16-4bc3-9f0c-91a43caee337 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:05.148204 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39a56a36-4e16-4bc3-9f0c-91a43caee337 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:05.156339 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39a56a36-4e16-4bc3-9f0c-91a43caee337 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:05.295097 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-39a56a36-4e16-4bc3-9f0c-91a43caee337 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:05.303568 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-39a56a36-4e16-4bc3-9f0c-91a43caee337 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.175461 Apr 06 16:51:05.304447 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 791/1566] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:05 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:05.560225 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6d857a89-cd37-4943-a8cf-ef3b16a43594 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:05.561092 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6d857a89-cd37-4943-a8cf-ef3b16a43594 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:05.568566 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d857a89-cd37-4943-a8cf-ef3b16a43594 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:05.569136 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d857a89-cd37-4943-a8cf-ef3b16a43594 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:05.569915 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d857a89-cd37-4943-a8cf-ef3b16a43594 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:05.570384 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d857a89-cd37-4943-a8cf-ef3b16a43594 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:05.602732 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6d857a89-cd37-4943-a8cf-ef3b16a43594 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046691 Apr 06 16:51:05.603298 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 776/1567] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:05 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:06.327859 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0d94c0cf-24d9-492e-afc0-063b21489c83 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:06.328489 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0d94c0cf-24d9-492e-afc0-063b21489c83 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:06.335889 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d94c0cf-24d9-492e-afc0-063b21489c83 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:06.336341 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d94c0cf-24d9-492e-afc0-063b21489c83 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:06.337172 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d94c0cf-24d9-492e-afc0-063b21489c83 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:06.337608 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d94c0cf-24d9-492e-afc0-063b21489c83 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:06.476941 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0d94c0cf-24d9-492e-afc0-063b21489c83 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:06.486450 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0d94c0cf-24d9-492e-afc0-063b21489c83 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.162426 Apr 06 16:51:06.487129 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 792/1568] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:06 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:06.615227 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3f2d09f4-b289-4202-b79c-8f8964835011 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:06.616656 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3f2d09f4-b289-4202-b79c-8f8964835011 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:06.623541 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f2d09f4-b289-4202-b79c-8f8964835011 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:06.623985 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f2d09f4-b289-4202-b79c-8f8964835011 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:06.624871 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f2d09f4-b289-4202-b79c-8f8964835011 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:06.625298 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f2d09f4-b289-4202-b79c-8f8964835011 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:06.663599 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3f2d09f4-b289-4202-b79c-8f8964835011 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052490 Apr 06 16:51:06.664163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 777/1569] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:06 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:07.505781 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5579cf46-ed45-43f6-952d-b78fbaeb8f9d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:07.505781 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5579cf46-ed45-43f6-952d-b78fbaeb8f9d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:07.513197 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5579cf46-ed45-43f6-952d-b78fbaeb8f9d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:07.513566 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5579cf46-ed45-43f6-952d-b78fbaeb8f9d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:07.514343 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5579cf46-ed45-43f6-952d-b78fbaeb8f9d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:07.514776 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5579cf46-ed45-43f6-952d-b78fbaeb8f9d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:07.671141 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5579cf46-ed45-43f6-952d-b78fbaeb8f9d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:07.675556 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-13f17fa2-a6eb-484d-a305-ce85cdf818b3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:07.676477 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-13f17fa2-a6eb-484d-a305-ce85cdf818b3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:07.679684 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5579cf46-ed45-43f6-952d-b78fbaeb8f9d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.178557 Apr 06 16:51:07.680615 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 793/1570] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:07 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:07.683674 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13f17fa2-a6eb-484d-a305-ce85cdf818b3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:07.684117 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13f17fa2-a6eb-484d-a305-ce85cdf818b3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:07.684913 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13f17fa2-a6eb-484d-a305-ce85cdf818b3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:07.685348 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13f17fa2-a6eb-484d-a305-ce85cdf818b3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:07.715040 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-13f17fa2-a6eb-484d-a305-ce85cdf818b3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043441 Apr 06 16:51:07.715610 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 778/1571] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:07 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:08.698974 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7c8fb87d-9a91-487d-9448-0b52e7d34a6e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:08.699642 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7c8fb87d-9a91-487d-9448-0b52e7d34a6e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:08.706604 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c8fb87d-9a91-487d-9448-0b52e7d34a6e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:08.707147 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c8fb87d-9a91-487d-9448-0b52e7d34a6e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:08.707986 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c8fb87d-9a91-487d-9448-0b52e7d34a6e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:08.708420 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c8fb87d-9a91-487d-9448-0b52e7d34a6e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:08.728065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-15ab3b61-12b3-4b10-a238-0f7b4c337936 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:08.730264 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-15ab3b61-12b3-4b10-a238-0f7b4c337936 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:08.738843 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15ab3b61-12b3-4b10-a238-0f7b4c337936 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:08.739450 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15ab3b61-12b3-4b10-a238-0f7b4c337936 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:08.740337 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15ab3b61-12b3-4b10-a238-0f7b4c337936 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:08.740837 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15ab3b61-12b3-4b10-a238-0f7b4c337936 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:08.775336 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-15ab3b61-12b3-4b10-a238-0f7b4c337936 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052467 Apr 06 16:51:08.775918 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 779/1572] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:08 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:51:08.849386 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7c8fb87d-9a91-487d-9448-0b52e7d34a6e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:08.857879 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7c8fb87d-9a91-487d-9448-0b52e7d34a6e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.163754 Apr 06 16:51:08.858458 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 794/1573] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:08 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:09.787271 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8050f89b-fedf-4a13-8bcc-8118c27b4faf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:09.788193 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8050f89b-fedf-4a13-8bcc-8118c27b4faf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:09.794815 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8050f89b-fedf-4a13-8bcc-8118c27b4faf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:09.795261 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8050f89b-fedf-4a13-8bcc-8118c27b4faf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:09.796036 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8050f89b-fedf-4a13-8bcc-8118c27b4faf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:09.796483 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8050f89b-fedf-4a13-8bcc-8118c27b4faf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:09.827114 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8050f89b-fedf-4a13-8bcc-8118c27b4faf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043849 Apr 06 16:51:09.827687 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 780/1574] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:09 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:09.875968 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8e585312-9fc9-419a-bf74-697fc030936d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:09.876740 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8e585312-9fc9-419a-bf74-697fc030936d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:09.884203 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e585312-9fc9-419a-bf74-697fc030936d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:09.884648 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e585312-9fc9-419a-bf74-697fc030936d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:09.885524 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e585312-9fc9-419a-bf74-697fc030936d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:09.885965 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e585312-9fc9-419a-bf74-697fc030936d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:10.044167 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8e585312-9fc9-419a-bf74-697fc030936d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:10.052356 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8e585312-9fc9-419a-bf74-697fc030936d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.180409 Apr 06 16:51:10.053267 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 795/1575] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:09 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:51:10.839682 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8353de68-ba2c-4057-8bce-2e8f3eff196c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:10.840632 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8353de68-ba2c-4057-8bce-2e8f3eff196c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:10.847332 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8353de68-ba2c-4057-8bce-2e8f3eff196c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:10.847782 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8353de68-ba2c-4057-8bce-2e8f3eff196c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:10.848558 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8353de68-ba2c-4057-8bce-2e8f3eff196c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:10.849060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8353de68-ba2c-4057-8bce-2e8f3eff196c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:10.891797 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8353de68-ba2c-4057-8bce-2e8f3eff196c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056203 Apr 06 16:51:10.892436 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 781/1576] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:10 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:11.070385 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fa163ed2-e798-45fe-972b-18468be31400 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:11.071253 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fa163ed2-e798-45fe-972b-18468be31400 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:11.077774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa163ed2-e798-45fe-972b-18468be31400 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:11.078228 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa163ed2-e798-45fe-972b-18468be31400 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:11.079008 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa163ed2-e798-45fe-972b-18468be31400 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:11.079416 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa163ed2-e798-45fe-972b-18468be31400 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:11.224314 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fa163ed2-e798-45fe-972b-18468be31400 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:11.233783 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fa163ed2-e798-45fe-972b-18468be31400 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.167689 Apr 06 16:51:11.234454 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 796/1577] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:11 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:11.905611 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-378b2700-52b8-4d95-9acb-c1c1c2e78e07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:11.906548 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-378b2700-52b8-4d95-9acb-c1c1c2e78e07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:11.913729 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-378b2700-52b8-4d95-9acb-c1c1c2e78e07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:11.914384 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-378b2700-52b8-4d95-9acb-c1c1c2e78e07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:11.915183 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-378b2700-52b8-4d95-9acb-c1c1c2e78e07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:11.915621 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-378b2700-52b8-4d95-9acb-c1c1c2e78e07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:11.949660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-378b2700-52b8-4d95-9acb-c1c1c2e78e07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049559 Apr 06 16:51:11.950242 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 782/1578] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:11 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:12.252733 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b7ff3f81-905f-43e7-9146-45592fc661c4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:12.253334 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b7ff3f81-905f-43e7-9146-45592fc661c4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:12.260994 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7ff3f81-905f-43e7-9146-45592fc661c4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:12.261439 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7ff3f81-905f-43e7-9146-45592fc661c4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:12.262442 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7ff3f81-905f-43e7-9146-45592fc661c4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:12.262866 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7ff3f81-905f-43e7-9146-45592fc661c4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:12.414996 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b7ff3f81-905f-43e7-9146-45592fc661c4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:12.423313 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b7ff3f81-905f-43e7-9146-45592fc661c4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.175193 Apr 06 16:51:12.423894 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 797/1579] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:12 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:12.962823 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-02d4810d-c428-484b-b1bb-c74e5e612233 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:12.963764 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-02d4810d-c428-484b-b1bb-c74e5e612233 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:12.970675 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02d4810d-c428-484b-b1bb-c74e5e612233 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:12.971163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02d4810d-c428-484b-b1bb-c74e5e612233 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:12.971932 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02d4810d-c428-484b-b1bb-c74e5e612233 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:12.972513 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02d4810d-c428-484b-b1bb-c74e5e612233 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:13.004913 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-02d4810d-c428-484b-b1bb-c74e5e612233 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047208 Apr 06 16:51:13.005508 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 783/1580] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:12 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:13.441607 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-29c831c5-e89f-44b9-9d9f-3350c256a770 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:13.442192 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-29c831c5-e89f-44b9-9d9f-3350c256a770 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:13.449214 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29c831c5-e89f-44b9-9d9f-3350c256a770 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:13.449671 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29c831c5-e89f-44b9-9d9f-3350c256a770 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:13.450461 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29c831c5-e89f-44b9-9d9f-3350c256a770 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:13.451068 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29c831c5-e89f-44b9-9d9f-3350c256a770 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:13.603922 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-29c831c5-e89f-44b9-9d9f-3350c256a770 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:13.612808 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-29c831c5-e89f-44b9-9d9f-3350c256a770 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.175349 Apr 06 16:51:13.613396 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 798/1581] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:13 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:14.017017 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3a437ea5-5fc7-4c74-8f55-5829e78d6cbf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:14.018001 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3a437ea5-5fc7-4c74-8f55-5829e78d6cbf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:14.024927 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a437ea5-5fc7-4c74-8f55-5829e78d6cbf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:14.025380 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a437ea5-5fc7-4c74-8f55-5829e78d6cbf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:14.026164 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a437ea5-5fc7-4c74-8f55-5829e78d6cbf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:14.026594 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a437ea5-5fc7-4c74-8f55-5829e78d6cbf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:14.059915 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3a437ea5-5fc7-4c74-8f55-5829e78d6cbf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047041 Apr 06 16:51:14.060479 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 784/1582] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:14 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:14.631812 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cea7b051-d674-473f-9893-5aa33f90e106 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:14.632413 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cea7b051-d674-473f-9893-5aa33f90e106 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:14.639421 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cea7b051-d674-473f-9893-5aa33f90e106 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:14.639867 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cea7b051-d674-473f-9893-5aa33f90e106 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:14.640655 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cea7b051-d674-473f-9893-5aa33f90e106 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:14.641121 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cea7b051-d674-473f-9893-5aa33f90e106 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:14.794477 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-cea7b051-d674-473f-9893-5aa33f90e106 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:14.802837 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cea7b051-d674-473f-9893-5aa33f90e106 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.174990 Apr 06 16:51:14.803586 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 799/1583] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:14 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:15.072076 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-12d26c04-24d3-42c6-b217-a0b3c11bdb1f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:15.073033 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-12d26c04-24d3-42c6-b217-a0b3c11bdb1f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:15.079951 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12d26c04-24d3-42c6-b217-a0b3c11bdb1f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:15.080404 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12d26c04-24d3-42c6-b217-a0b3c11bdb1f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:15.081233 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12d26c04-24d3-42c6-b217-a0b3c11bdb1f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:15.081676 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12d26c04-24d3-42c6-b217-a0b3c11bdb1f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:15.117075 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-12d26c04-24d3-42c6-b217-a0b3c11bdb1f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049056 Apr 06 16:51:15.117648 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 785/1584] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:15 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:15.819865 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-301c83fb-897b-4dac-9460-be0fbe831bc3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:15.820825 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-301c83fb-897b-4dac-9460-be0fbe831bc3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:15.827436 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-301c83fb-897b-4dac-9460-be0fbe831bc3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:15.827889 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-301c83fb-897b-4dac-9460-be0fbe831bc3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:15.828673 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-301c83fb-897b-4dac-9460-be0fbe831bc3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:15.829145 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-301c83fb-897b-4dac-9460-be0fbe831bc3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:15.982008 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-301c83fb-897b-4dac-9460-be0fbe831bc3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:15.990488 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-301c83fb-897b-4dac-9460-be0fbe831bc3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.174631 Apr 06 16:51:15.991430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 800/1585] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:15 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:16.129178 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f272598a-b90f-40ce-97ae-850bb4a26144 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:16.130068 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f272598a-b90f-40ce-97ae-850bb4a26144 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:16.137207 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f272598a-b90f-40ce-97ae-850bb4a26144 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:16.137652 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f272598a-b90f-40ce-97ae-850bb4a26144 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:16.138427 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f272598a-b90f-40ce-97ae-850bb4a26144 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:16.138844 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f272598a-b90f-40ce-97ae-850bb4a26144 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:16.174469 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f272598a-b90f-40ce-97ae-850bb4a26144 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049355 Apr 06 16:51:16.175049 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 786/1586] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:16 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:17.009885 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9809b953-89f6-44b6-a73d-76776992a4c8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:17.009885 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9809b953-89f6-44b6-a73d-76776992a4c8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:17.019916 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9809b953-89f6-44b6-a73d-76776992a4c8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:17.020630 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9809b953-89f6-44b6-a73d-76776992a4c8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:17.021351 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9809b953-89f6-44b6-a73d-76776992a4c8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:17.021786 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9809b953-89f6-44b6-a73d-76776992a4c8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:17.185812 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9809b953-89f6-44b6-a73d-76776992a4c8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:17.190742 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0fe9f92f-8436-4982-8008-3b5745fb018e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:17.193056 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0fe9f92f-8436-4982-8008-3b5745fb018e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:17.196370 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9809b953-89f6-44b6-a73d-76776992a4c8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.192552 Apr 06 16:51:17.197033 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 801/1587] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:17 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:17.199910 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fe9f92f-8436-4982-8008-3b5745fb018e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:17.200358 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fe9f92f-8436-4982-8008-3b5745fb018e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:17.202213 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fe9f92f-8436-4982-8008-3b5745fb018e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:17.202213 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fe9f92f-8436-4982-8008-3b5745fb018e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:17.241062 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0fe9f92f-8436-4982-8008-3b5745fb018e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056916 Apr 06 16:51:17.241648 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 787/1588] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:17 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:18.215572 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3577f2e8-c173-4de5-b393-ab421cc98b41 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:18.216306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3577f2e8-c173-4de5-b393-ab421cc98b41 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:18.222599 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3577f2e8-c173-4de5-b393-ab421cc98b41 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:18.223039 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3577f2e8-c173-4de5-b393-ab421cc98b41 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:18.223801 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3577f2e8-c173-4de5-b393-ab421cc98b41 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:18.224407 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3577f2e8-c173-4de5-b393-ab421cc98b41 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:18.253339 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8448599a-ed89-47a7-84b4-c3bd54dfa563 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:18.254270 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8448599a-ed89-47a7-84b4-c3bd54dfa563 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:18.262034 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8448599a-ed89-47a7-84b4-c3bd54dfa563 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:18.262577 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8448599a-ed89-47a7-84b4-c3bd54dfa563 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:18.264051 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8448599a-ed89-47a7-84b4-c3bd54dfa563 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:18.264051 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8448599a-ed89-47a7-84b4-c3bd54dfa563 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:18.295003 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8448599a-ed89-47a7-84b4-c3bd54dfa563 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045815 Apr 06 16:51:18.295780 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 788/1589] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:18 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:51:18.386287 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3577f2e8-c173-4de5-b393-ab421cc98b41 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:18.394933 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3577f2e8-c173-4de5-b393-ab421cc98b41 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.183076 Apr 06 16:51:18.395420 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 802/1590] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:18 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:19.308103 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ef355541-7fd6-494c-ac3b-fd581fafa7cf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:19.309097 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ef355541-7fd6-494c-ac3b-fd581fafa7cf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:19.315778 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef355541-7fd6-494c-ac3b-fd581fafa7cf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:19.316256 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef355541-7fd6-494c-ac3b-fd581fafa7cf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:19.317059 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef355541-7fd6-494c-ac3b-fd581fafa7cf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:19.317501 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef355541-7fd6-494c-ac3b-fd581fafa7cf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:19.349626 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ef355541-7fd6-494c-ac3b-fd581fafa7cf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046000 Apr 06 16:51:19.350439 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 789/1591] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:19 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:19.415617 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4cc5c57a-f18e-4821-b182-a8e08d4d6060 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:19.416255 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4cc5c57a-f18e-4821-b182-a8e08d4d6060 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:19.423286 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cc5c57a-f18e-4821-b182-a8e08d4d6060 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:19.423766 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cc5c57a-f18e-4821-b182-a8e08d4d6060 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:19.424708 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cc5c57a-f18e-4821-b182-a8e08d4d6060 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:19.425193 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cc5c57a-f18e-4821-b182-a8e08d4d6060 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:19.577040 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4cc5c57a-f18e-4821-b182-a8e08d4d6060 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:19.585345 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4cc5c57a-f18e-4821-b182-a8e08d4d6060 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.175789 Apr 06 16:51:19.585937 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 803/1592] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:19 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:20.361556 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-068ea646-5112-4b18-89c5-9d6e9e4321ed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:20.362488 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-068ea646-5112-4b18-89c5-9d6e9e4321ed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:20.369344 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-068ea646-5112-4b18-89c5-9d6e9e4321ed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:20.369800 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-068ea646-5112-4b18-89c5-9d6e9e4321ed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:20.370604 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-068ea646-5112-4b18-89c5-9d6e9e4321ed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:20.371043 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-068ea646-5112-4b18-89c5-9d6e9e4321ed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:20.402231 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-068ea646-5112-4b18-89c5-9d6e9e4321ed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044693 Apr 06 16:51:20.402830 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 790/1593] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:20 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:20.603597 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-49090fba-df26-4bd8-b9d8-c1fe8ad96a2a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:20.604589 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-49090fba-df26-4bd8-b9d8-c1fe8ad96a2a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:20.611696 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49090fba-df26-4bd8-b9d8-c1fe8ad96a2a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:20.612147 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49090fba-df26-4bd8-b9d8-c1fe8ad96a2a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:20.613038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49090fba-df26-4bd8-b9d8-c1fe8ad96a2a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:20.613470 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49090fba-df26-4bd8-b9d8-c1fe8ad96a2a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:20.750839 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-49090fba-df26-4bd8-b9d8-c1fe8ad96a2a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:20.761589 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-49090fba-df26-4bd8-b9d8-c1fe8ad96a2a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.161867 Apr 06 16:51:20.762165 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 804/1594] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:20 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:21.420717 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a9438b68-1166-4660-b836-967c10e81058 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:21.421695 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a9438b68-1166-4660-b836-967c10e81058 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:21.430268 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9438b68-1166-4660-b836-967c10e81058 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:21.430705 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9438b68-1166-4660-b836-967c10e81058 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:21.431489 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9438b68-1166-4660-b836-967c10e81058 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:21.431916 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9438b68-1166-4660-b836-967c10e81058 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:21.468141 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a9438b68-1166-4660-b836-967c10e81058 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051343 Apr 06 16:51:21.468721 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 791/1595] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:21 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:21.780388 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a1964888-a114-4bbe-8559-76880e423be7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:21.781064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a1964888-a114-4bbe-8559-76880e423be7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:21.787896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1964888-a114-4bbe-8559-76880e423be7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:21.788345 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1964888-a114-4bbe-8559-76880e423be7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:21.789168 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1964888-a114-4bbe-8559-76880e423be7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:21.789602 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1964888-a114-4bbe-8559-76880e423be7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:21.962768 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a1964888-a114-4bbe-8559-76880e423be7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:21.971166 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a1964888-a114-4bbe-8559-76880e423be7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.195020 Apr 06 16:51:21.971747 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 805/1596] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:21 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:22.480329 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2006ad3e-1e21-4aeb-9bf0-ccc3ce8e9d90 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:22.481298 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2006ad3e-1e21-4aeb-9bf0-ccc3ce8e9d90 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:22.488143 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2006ad3e-1e21-4aeb-9bf0-ccc3ce8e9d90 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:22.488591 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2006ad3e-1e21-4aeb-9bf0-ccc3ce8e9d90 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:22.489413 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2006ad3e-1e21-4aeb-9bf0-ccc3ce8e9d90 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:22.489844 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2006ad3e-1e21-4aeb-9bf0-ccc3ce8e9d90 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:22.523100 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2006ad3e-1e21-4aeb-9bf0-ccc3ce8e9d90 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047017 Apr 06 16:51:22.523675 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 792/1597] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:22 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:51:22.988943 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1088b56e-8704-4338-af28-637dcf13331d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:22.989542 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1088b56e-8704-4338-af28-637dcf13331d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:22.996596 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1088b56e-8704-4338-af28-637dcf13331d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:22.997064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1088b56e-8704-4338-af28-637dcf13331d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:22.997840 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1088b56e-8704-4338-af28-637dcf13331d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:22.998271 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1088b56e-8704-4338-af28-637dcf13331d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:23.156229 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1088b56e-8704-4338-af28-637dcf13331d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:23.167816 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1088b56e-8704-4338-af28-637dcf13331d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.182526 Apr 06 16:51:23.168551 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 806/1598] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:22 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:23.535116 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e1c64f60-cc43-4765-b7cf-019c89e010fc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:23.536065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e1c64f60-cc43-4765-b7cf-019c89e010fc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:23.544075 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1c64f60-cc43-4765-b7cf-019c89e010fc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:23.545256 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1c64f60-cc43-4765-b7cf-019c89e010fc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:23.545380 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1c64f60-cc43-4765-b7cf-019c89e010fc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:23.545782 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1c64f60-cc43-4765-b7cf-019c89e010fc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:23.578223 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e1c64f60-cc43-4765-b7cf-019c89e010fc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047194 Apr 06 16:51:23.578830 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 793/1599] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:23 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:24.186677 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d74f6b0b-6ab1-4e8b-8465-83abbae1543d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:24.187347 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d74f6b0b-6ab1-4e8b-8465-83abbae1543d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:24.194164 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d74f6b0b-6ab1-4e8b-8465-83abbae1543d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:24.194609 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d74f6b0b-6ab1-4e8b-8465-83abbae1543d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:24.195410 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d74f6b0b-6ab1-4e8b-8465-83abbae1543d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:24.195838 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d74f6b0b-6ab1-4e8b-8465-83abbae1543d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:24.364958 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d74f6b0b-6ab1-4e8b-8465-83abbae1543d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:24.374180 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d74f6b0b-6ab1-4e8b-8465-83abbae1543d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.191472 Apr 06 16:51:24.374772 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 807/1600] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:24 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:24.591269 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a4821073-3d69-4cd9-a44f-be35fcfbbc96 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:24.592215 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a4821073-3d69-4cd9-a44f-be35fcfbbc96 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:24.598920 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4821073-3d69-4cd9-a44f-be35fcfbbc96 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:24.599381 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4821073-3d69-4cd9-a44f-be35fcfbbc96 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:24.600447 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4821073-3d69-4cd9-a44f-be35fcfbbc96 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:24.600624 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4821073-3d69-4cd9-a44f-be35fcfbbc96 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:24.633000 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a4821073-3d69-4cd9-a44f-be35fcfbbc96 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045669 Apr 06 16:51:24.633581 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 794/1601] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:24 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:25.391844 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-da472655-2434-415d-9366-eb0afbe63996 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:25.392546 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-da472655-2434-415d-9366-eb0afbe63996 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:25.399738 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-da472655-2434-415d-9366-eb0afbe63996 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:25.400187 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-da472655-2434-415d-9366-eb0afbe63996 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:25.401017 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-da472655-2434-415d-9366-eb0afbe63996 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:25.401452 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-da472655-2434-415d-9366-eb0afbe63996 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:25.561323 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-da472655-2434-415d-9366-eb0afbe63996 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:25.571758 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-da472655-2434-415d-9366-eb0afbe63996 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.183677 Apr 06 16:51:25.572357 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 808/1602] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:25 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:25.645428 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7377550b-7df6-41f3-8a4f-f99734282d95 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:25.646473 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7377550b-7df6-41f3-8a4f-f99734282d95 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:25.653220 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7377550b-7df6-41f3-8a4f-f99734282d95 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:25.653680 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7377550b-7df6-41f3-8a4f-f99734282d95 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:25.654484 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7377550b-7df6-41f3-8a4f-f99734282d95 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:25.654921 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7377550b-7df6-41f3-8a4f-f99734282d95 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:25.685986 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7377550b-7df6-41f3-8a4f-f99734282d95 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044565 Apr 06 16:51:25.686564 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 795/1603] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:25 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:51:26.591306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a651afde-0d23-4f76-be07-ab56b3896f1f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:26.593211 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a651afde-0d23-4f76-be07-ab56b3896f1f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:26.600952 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a651afde-0d23-4f76-be07-ab56b3896f1f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:26.601405 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a651afde-0d23-4f76-be07-ab56b3896f1f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:26.602168 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a651afde-0d23-4f76-be07-ab56b3896f1f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:26.602625 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a651afde-0d23-4f76-be07-ab56b3896f1f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:26.698754 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5dd42017-b539-48f6-bc72-91c0a601c312 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:26.700605 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5dd42017-b539-48f6-bc72-91c0a601c312 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:26.707559 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5dd42017-b539-48f6-bc72-91c0a601c312 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:26.708015 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5dd42017-b539-48f6-bc72-91c0a601c312 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:26.709067 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5dd42017-b539-48f6-bc72-91c0a601c312 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:26.709809 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5dd42017-b539-48f6-bc72-91c0a601c312 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:26.742112 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5dd42017-b539-48f6-bc72-91c0a601c312 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048317 Apr 06 16:51:26.742660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 796/1604] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:26 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:51:26.746043 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a651afde-0d23-4f76-be07-ab56b3896f1f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:26.754392 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a651afde-0d23-4f76-be07-ab56b3896f1f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.166971 Apr 06 16:51:26.754936 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 809/1605] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:26 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:27.754040 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c7718de8-17cf-486f-9e22-276456b2d37d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:27.755178 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c7718de8-17cf-486f-9e22-276456b2d37d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:27.761948 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7718de8-17cf-486f-9e22-276456b2d37d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:27.762387 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7718de8-17cf-486f-9e22-276456b2d37d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:27.763194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7718de8-17cf-486f-9e22-276456b2d37d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:27.763585 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7718de8-17cf-486f-9e22-276456b2d37d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:27.776839 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bbb7681b-8a02-4ffd-99b0-c8cd560cf9cc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:27.777420 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bbb7681b-8a02-4ffd-99b0-c8cd560cf9cc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:27.783701 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbb7681b-8a02-4ffd-99b0-c8cd560cf9cc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:27.784143 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbb7681b-8a02-4ffd-99b0-c8cd560cf9cc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:27.784946 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbb7681b-8a02-4ffd-99b0-c8cd560cf9cc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:27.785368 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbb7681b-8a02-4ffd-99b0-c8cd560cf9cc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:27.796012 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c7718de8-17cf-486f-9e22-276456b2d37d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046082 Apr 06 16:51:27.796567 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 797/1606] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:27 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:27.936325 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-bbb7681b-8a02-4ffd-99b0-c8cd560cf9cc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:27.948395 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bbb7681b-8a02-4ffd-99b0-c8cd560cf9cc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.175604 Apr 06 16:51:27.949057 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 810/1607] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:27 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:51:28.813943 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8a62e32c-05af-4a46-a039-f651fc5ca824 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:28.815980 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8a62e32c-05af-4a46-a039-f651fc5ca824 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:28.827361 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a62e32c-05af-4a46-a039-f651fc5ca824 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:28.827893 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a62e32c-05af-4a46-a039-f651fc5ca824 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:28.828798 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a62e32c-05af-4a46-a039-f651fc5ca824 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:28.829291 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a62e32c-05af-4a46-a039-f651fc5ca824 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:28.860960 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8a62e32c-05af-4a46-a039-f651fc5ca824 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057028 Apr 06 16:51:28.861495 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 798/1608] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:28 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:28.965999 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0f4709fa-c706-4cdd-8740-5059abd3ee97 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:28.966642 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0f4709fa-c706-4cdd-8740-5059abd3ee97 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:28.974148 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f4709fa-c706-4cdd-8740-5059abd3ee97 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:28.974725 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f4709fa-c706-4cdd-8740-5059abd3ee97 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:28.975661 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f4709fa-c706-4cdd-8740-5059abd3ee97 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:28.976300 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f4709fa-c706-4cdd-8740-5059abd3ee97 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:29.129047 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0f4709fa-c706-4cdd-8740-5059abd3ee97 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:29.137451 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0f4709fa-c706-4cdd-8740-5059abd3ee97 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.175345 Apr 06 16:51:29.138004 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 811/1609] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:28 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:29.873596 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0b99dbd2-2123-4f99-8a59-ebcad6782477 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:29.874538 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0b99dbd2-2123-4f99-8a59-ebcad6782477 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:29.882260 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b99dbd2-2123-4f99-8a59-ebcad6782477 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:29.882260 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b99dbd2-2123-4f99-8a59-ebcad6782477 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:29.883136 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b99dbd2-2123-4f99-8a59-ebcad6782477 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:29.883539 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b99dbd2-2123-4f99-8a59-ebcad6782477 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:29.916440 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0b99dbd2-2123-4f99-8a59-ebcad6782477 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046864 Apr 06 16:51:29.917135 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 799/1610] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:29 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:30.155638 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c348936a-41e2-482c-940c-6c3ba6bb3483 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:30.157176 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c348936a-41e2-482c-940c-6c3ba6bb3483 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:30.163836 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c348936a-41e2-482c-940c-6c3ba6bb3483 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:30.164583 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c348936a-41e2-482c-940c-6c3ba6bb3483 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:30.165398 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c348936a-41e2-482c-940c-6c3ba6bb3483 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:30.165814 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c348936a-41e2-482c-940c-6c3ba6bb3483 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:30.316366 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c348936a-41e2-482c-940c-6c3ba6bb3483 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:30.324918 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c348936a-41e2-482c-940c-6c3ba6bb3483 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.173860 Apr 06 16:51:30.325668 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 812/1611] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:30 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:30.929262 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-55d37c8c-c816-4bc4-ab56-0b588a83c408 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:30.930251 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-55d37c8c-c816-4bc4-ab56-0b588a83c408 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:30.937065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55d37c8c-c816-4bc4-ab56-0b588a83c408 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:30.937546 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55d37c8c-c816-4bc4-ab56-0b588a83c408 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:30.938307 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55d37c8c-c816-4bc4-ab56-0b588a83c408 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:30.938744 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55d37c8c-c816-4bc4-ab56-0b588a83c408 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:30.969311 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-55d37c8c-c816-4bc4-ab56-0b588a83c408 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044934 Apr 06 16:51:30.969859 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 800/1612] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:30 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:31.342569 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2d7d68d5-b88c-403d-9301-f424ec715455 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:31.343174 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2d7d68d5-b88c-403d-9301-f424ec715455 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:31.350207 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d7d68d5-b88c-403d-9301-f424ec715455 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:31.354166 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d7d68d5-b88c-403d-9301-f424ec715455 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:31.354166 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d7d68d5-b88c-403d-9301-f424ec715455 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:31.354166 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d7d68d5-b88c-403d-9301-f424ec715455 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:31.502019 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2d7d68d5-b88c-403d-9301-f424ec715455 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:31.510879 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2d7d68d5-b88c-403d-9301-f424ec715455 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.172139 Apr 06 16:51:31.511492 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 813/1613] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:31 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:31.982021 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-886b0a47-1fe1-4d10-987b-acbc9295b0ef tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:31.982946 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-886b0a47-1fe1-4d10-987b-acbc9295b0ef tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:31.989516 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-886b0a47-1fe1-4d10-987b-acbc9295b0ef tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:31.989962 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-886b0a47-1fe1-4d10-987b-acbc9295b0ef tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:31.990852 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-886b0a47-1fe1-4d10-987b-acbc9295b0ef tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:31.991530 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-886b0a47-1fe1-4d10-987b-acbc9295b0ef tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:32.022305 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-886b0a47-1fe1-4d10-987b-acbc9295b0ef tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044453 Apr 06 16:51:32.022870 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 801/1614] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:31 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:32.533679 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3152000b-b93e-4ff1-afb6-2b3146a52f09 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:32.534264 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3152000b-b93e-4ff1-afb6-2b3146a52f09 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:32.541419 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3152000b-b93e-4ff1-afb6-2b3146a52f09 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:32.541872 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3152000b-b93e-4ff1-afb6-2b3146a52f09 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:32.542718 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3152000b-b93e-4ff1-afb6-2b3146a52f09 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:32.543256 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3152000b-b93e-4ff1-afb6-2b3146a52f09 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:32.693075 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3152000b-b93e-4ff1-afb6-2b3146a52f09 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:32.701502 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3152000b-b93e-4ff1-afb6-2b3146a52f09 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.171753 Apr 06 16:51:32.702366 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 814/1615] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:32 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:33.034192 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7e8625e2-ee58-40e3-aa52-d8b7915b809d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:33.035134 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7e8625e2-ee58-40e3-aa52-d8b7915b809d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:33.042686 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e8625e2-ee58-40e3-aa52-d8b7915b809d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:33.043141 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e8625e2-ee58-40e3-aa52-d8b7915b809d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:33.043958 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e8625e2-ee58-40e3-aa52-d8b7915b809d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:33.044545 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e8625e2-ee58-40e3-aa52-d8b7915b809d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:33.075513 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7e8625e2-ee58-40e3-aa52-d8b7915b809d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045189 Apr 06 16:51:33.076089 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 802/1616] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:33 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:33.720989 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-40689b4f-1103-4bc2-bb1e-3f53148d5371 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:33.721637 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-40689b4f-1103-4bc2-bb1e-3f53148d5371 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:33.729539 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40689b4f-1103-4bc2-bb1e-3f53148d5371 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:33.730010 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40689b4f-1103-4bc2-bb1e-3f53148d5371 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:33.730798 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40689b4f-1103-4bc2-bb1e-3f53148d5371 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:33.731235 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40689b4f-1103-4bc2-bb1e-3f53148d5371 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:33.879924 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-40689b4f-1103-4bc2-bb1e-3f53148d5371 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:33.888423 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-40689b4f-1103-4bc2-bb1e-3f53148d5371 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.172601 Apr 06 16:51:33.889197 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 815/1617] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:33 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:34.090526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3cf40501-be34-4027-91f2-21f2ac3e23d4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:34.090526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3cf40501-be34-4027-91f2-21f2ac3e23d4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:34.097393 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cf40501-be34-4027-91f2-21f2ac3e23d4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:34.097839 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cf40501-be34-4027-91f2-21f2ac3e23d4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:34.098623 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cf40501-be34-4027-91f2-21f2ac3e23d4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:34.099019 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cf40501-be34-4027-91f2-21f2ac3e23d4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:34.130991 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3cf40501-be34-4027-91f2-21f2ac3e23d4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047051 Apr 06 16:51:34.131576 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 803/1618] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:34 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:34.908575 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-60392255-2c46-4798-9e19-b56b472f4bb0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:34.909205 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-60392255-2c46-4798-9e19-b56b472f4bb0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:34.919418 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60392255-2c46-4798-9e19-b56b472f4bb0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:34.920060 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60392255-2c46-4798-9e19-b56b472f4bb0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:34.921176 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60392255-2c46-4798-9e19-b56b472f4bb0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:34.921620 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60392255-2c46-4798-9e19-b56b472f4bb0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:35.064572 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-60392255-2c46-4798-9e19-b56b472f4bb0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:35.072995 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-60392255-2c46-4798-9e19-b56b472f4bb0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.170588 Apr 06 16:51:35.073629 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 816/1619] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:34 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:35.144701 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0a3ccff4-0ede-4580-9f3b-782b6f5b2a46 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:35.144701 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0a3ccff4-0ede-4580-9f3b-782b6f5b2a46 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:35.151054 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a3ccff4-0ede-4580-9f3b-782b6f5b2a46 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:35.151502 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a3ccff4-0ede-4580-9f3b-782b6f5b2a46 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:35.152284 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a3ccff4-0ede-4580-9f3b-782b6f5b2a46 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:35.152740 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a3ccff4-0ede-4580-9f3b-782b6f5b2a46 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:35.185087 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0a3ccff4-0ede-4580-9f3b-782b6f5b2a46 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046674 Apr 06 16:51:35.185711 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 804/1620] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:35 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:36.090747 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-007bb4ec-475a-4ee8-9213-42c2a9b5e6d3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:36.091401 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-007bb4ec-475a-4ee8-9213-42c2a9b5e6d3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:36.098090 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-007bb4ec-475a-4ee8-9213-42c2a9b5e6d3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:36.098530 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-007bb4ec-475a-4ee8-9213-42c2a9b5e6d3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:36.099295 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-007bb4ec-475a-4ee8-9213-42c2a9b5e6d3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:36.099721 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-007bb4ec-475a-4ee8-9213-42c2a9b5e6d3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:36.197068 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-43be36a4-0085-4eaa-86d8-b9a9d577e4a0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:36.198607 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-43be36a4-0085-4eaa-86d8-b9a9d577e4a0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:36.204991 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43be36a4-0085-4eaa-86d8-b9a9d577e4a0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:36.205442 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43be36a4-0085-4eaa-86d8-b9a9d577e4a0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:36.206192 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43be36a4-0085-4eaa-86d8-b9a9d577e4a0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:36.206808 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43be36a4-0085-4eaa-86d8-b9a9d577e4a0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:36.238374 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-43be36a4-0085-4eaa-86d8-b9a9d577e4a0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045356 Apr 06 16:51:36.238953 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 805/1621] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:36 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:51:36.250671 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-007bb4ec-475a-4ee8-9213-42c2a9b5e6d3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:36.259044 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-007bb4ec-475a-4ee8-9213-42c2a9b5e6d3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.171945 Apr 06 16:51:36.259804 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 817/1622] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:36 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:37.251773 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0198a96a-8601-4fc3-9eb9-4dfdd049387c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:37.252839 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0198a96a-8601-4fc3-9eb9-4dfdd049387c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:37.260460 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0198a96a-8601-4fc3-9eb9-4dfdd049387c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:37.260976 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0198a96a-8601-4fc3-9eb9-4dfdd049387c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:37.261907 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0198a96a-8601-4fc3-9eb9-4dfdd049387c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:37.262341 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0198a96a-8601-4fc3-9eb9-4dfdd049387c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:37.279504 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8e78fa72-8711-4207-bf24-f315961e94f2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:37.280232 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8e78fa72-8711-4207-bf24-f315961e94f2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:37.286951 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e78fa72-8711-4207-bf24-f315961e94f2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:37.287403 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e78fa72-8711-4207-bf24-f315961e94f2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:37.288191 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e78fa72-8711-4207-bf24-f315961e94f2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:37.288635 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e78fa72-8711-4207-bf24-f315961e94f2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:37.294186 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0198a96a-8601-4fc3-9eb9-4dfdd049387c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046378 Apr 06 16:51:37.298091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 806/1623] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:37 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:37.441919 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8e78fa72-8711-4207-bf24-f315961e94f2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:37.450592 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8e78fa72-8711-4207-bf24-f315961e94f2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.175220 Apr 06 16:51:37.451172 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 818/1624] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:37 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:38.307356 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4e40c7e9-23f9-40e5-b545-d7b96402aeb4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:38.308319 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4e40c7e9-23f9-40e5-b545-d7b96402aeb4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:38.314899 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e40c7e9-23f9-40e5-b545-d7b96402aeb4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:38.315383 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e40c7e9-23f9-40e5-b545-d7b96402aeb4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:38.316167 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e40c7e9-23f9-40e5-b545-d7b96402aeb4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:38.316597 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e40c7e9-23f9-40e5-b545-d7b96402aeb4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:38.352394 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4e40c7e9-23f9-40e5-b545-d7b96402aeb4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049559 Apr 06 16:51:38.353251 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 807/1625] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:38 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:38.469312 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-34c2cd24-9853-4893-8693-a3c6f2a88184 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:38.470409 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-34c2cd24-9853-4893-8693-a3c6f2a88184 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:38.480264 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34c2cd24-9853-4893-8693-a3c6f2a88184 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:38.480715 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34c2cd24-9853-4893-8693-a3c6f2a88184 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:38.481566 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34c2cd24-9853-4893-8693-a3c6f2a88184 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:38.481980 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34c2cd24-9853-4893-8693-a3c6f2a88184 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:38.634061 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-34c2cd24-9853-4893-8693-a3c6f2a88184 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:38.642380 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-34c2cd24-9853-4893-8693-a3c6f2a88184 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.177528 Apr 06 16:51:38.642958 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 819/1626] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:38 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:39.364964 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f2f2c6d2-3830-4494-831b-7340a6dbf043 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:39.366301 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f2f2c6d2-3830-4494-831b-7340a6dbf043 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:39.375242 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2f2c6d2-3830-4494-831b-7340a6dbf043 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:39.375918 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2f2c6d2-3830-4494-831b-7340a6dbf043 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:39.377656 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2f2c6d2-3830-4494-831b-7340a6dbf043 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:39.378084 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2f2c6d2-3830-4494-831b-7340a6dbf043 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:39.410302 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f2f2c6d2-3830-4494-831b-7340a6dbf043 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049332 Apr 06 16:51:39.410872 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 808/1627] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:39 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:39.659389 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7aec9959-d5d5-4b61-8758-178a2a6bca99 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:39.660293 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7aec9959-d5d5-4b61-8758-178a2a6bca99 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:39.671143 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7aec9959-d5d5-4b61-8758-178a2a6bca99 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:39.671636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7aec9959-d5d5-4b61-8758-178a2a6bca99 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:39.673038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7aec9959-d5d5-4b61-8758-178a2a6bca99 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:39.673789 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7aec9959-d5d5-4b61-8758-178a2a6bca99 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:39.830898 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7aec9959-d5d5-4b61-8758-178a2a6bca99 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:39.842880 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7aec9959-d5d5-4b61-8758-178a2a6bca99 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.187392 Apr 06 16:51:39.843473 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 820/1628] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:39 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:40.422927 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2b2a8c20-1474-4ae1-93eb-1bb47e1e30d6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:40.423857 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2b2a8c20-1474-4ae1-93eb-1bb47e1e30d6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:40.431120 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b2a8c20-1474-4ae1-93eb-1bb47e1e30d6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:40.431555 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b2a8c20-1474-4ae1-93eb-1bb47e1e30d6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:40.432362 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b2a8c20-1474-4ae1-93eb-1bb47e1e30d6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:40.432853 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b2a8c20-1474-4ae1-93eb-1bb47e1e30d6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:40.465576 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2b2a8c20-1474-4ae1-93eb-1bb47e1e30d6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046602 Apr 06 16:51:40.466125 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 809/1629] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:40 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:40.863846 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e6087b84-99c5-4140-b119-6ccfb487bfb8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:40.864504 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e6087b84-99c5-4140-b119-6ccfb487bfb8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:40.872071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6087b84-99c5-4140-b119-6ccfb487bfb8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:40.872520 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6087b84-99c5-4140-b119-6ccfb487bfb8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:40.873335 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6087b84-99c5-4140-b119-6ccfb487bfb8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:40.873768 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6087b84-99c5-4140-b119-6ccfb487bfb8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:41.032633 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e6087b84-99c5-4140-b119-6ccfb487bfb8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:41.041915 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e6087b84-99c5-4140-b119-6ccfb487bfb8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.181745 Apr 06 16:51:41.042669 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 821/1630] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:40 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:41.477974 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a6e9f70b-95db-45eb-9300-9a9fc30b7535 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:41.479296 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a6e9f70b-95db-45eb-9300-9a9fc30b7535 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:41.485778 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6e9f70b-95db-45eb-9300-9a9fc30b7535 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:41.486191 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6e9f70b-95db-45eb-9300-9a9fc30b7535 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:41.486968 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6e9f70b-95db-45eb-9300-9a9fc30b7535 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:41.487427 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6e9f70b-95db-45eb-9300-9a9fc30b7535 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:41.528349 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a6e9f70b-95db-45eb-9300-9a9fc30b7535 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054575 Apr 06 16:51:41.528961 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 810/1631] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:41 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:42.060329 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c823485c-e4b9-4c7a-aeb8-a00f7d318be9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:42.060946 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c823485c-e4b9-4c7a-aeb8-a00f7d318be9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:42.068227 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c823485c-e4b9-4c7a-aeb8-a00f7d318be9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:42.068675 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c823485c-e4b9-4c7a-aeb8-a00f7d318be9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:42.069509 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c823485c-e4b9-4c7a-aeb8-a00f7d318be9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:42.069946 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c823485c-e4b9-4c7a-aeb8-a00f7d318be9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:42.448301 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c823485c-e4b9-4c7a-aeb8-a00f7d318be9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:42.456131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c823485c-e4b9-4c7a-aeb8-a00f7d318be9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.400386 Apr 06 16:51:42.456702 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 822/1632] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:42 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:42.540368 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-89de4cf4-3f22-4101-aec2-5d66150d68a7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:42.541320 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-89de4cf4-3f22-4101-aec2-5d66150d68a7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:42.547440 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89de4cf4-3f22-4101-aec2-5d66150d68a7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:42.547883 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89de4cf4-3f22-4101-aec2-5d66150d68a7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:42.548655 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89de4cf4-3f22-4101-aec2-5d66150d68a7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:42.549110 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89de4cf4-3f22-4101-aec2-5d66150d68a7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:42.584369 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-89de4cf4-3f22-4101-aec2-5d66150d68a7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048093 Apr 06 16:51:42.584867 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 811/1633] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:42 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:43.474099 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9f32967a-bc84-42a5-b5bf-5c36a4ebd1ed tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:43.474681 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9f32967a-bc84-42a5-b5bf-5c36a4ebd1ed tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:43.481921 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f32967a-bc84-42a5-b5bf-5c36a4ebd1ed tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:43.482352 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f32967a-bc84-42a5-b5bf-5c36a4ebd1ed tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:43.483123 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f32967a-bc84-42a5-b5bf-5c36a4ebd1ed tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:43.483565 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f32967a-bc84-42a5-b5bf-5c36a4ebd1ed tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:43.596701 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ae38c69e-c468-48da-bb1d-2ee3cc8e7a37 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:43.598140 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ae38c69e-c468-48da-bb1d-2ee3cc8e7a37 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:43.606765 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae38c69e-c468-48da-bb1d-2ee3cc8e7a37 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:43.607216 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae38c69e-c468-48da-bb1d-2ee3cc8e7a37 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:43.607990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae38c69e-c468-48da-bb1d-2ee3cc8e7a37 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:43.608724 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae38c69e-c468-48da-bb1d-2ee3cc8e7a37 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:43.632532 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9f32967a-bc84-42a5-b5bf-5c36a4ebd1ed tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:43.641261 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9f32967a-bc84-42a5-b5bf-5c36a4ebd1ed tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.171531 Apr 06 16:51:43.642244 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 823/1634] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:43 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:43.646447 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ae38c69e-c468-48da-bb1d-2ee3cc8e7a37 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054579 Apr 06 16:51:43.647128 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 812/1635] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:43 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:51:44.659367 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1641d9ca-0cb3-488e-b8c1-5cc75a4fc644 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:44.660810 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1641d9ca-0cb3-488e-b8c1-5cc75a4fc644 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:44.665130 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-39ea7e8e-66d4-4dca-ae60-a4ebe67fa8f6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:44.666015 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-39ea7e8e-66d4-4dca-ae60-a4ebe67fa8f6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:44.669326 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1641d9ca-0cb3-488e-b8c1-5cc75a4fc644 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:44.669749 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1641d9ca-0cb3-488e-b8c1-5cc75a4fc644 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:44.670584 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1641d9ca-0cb3-488e-b8c1-5cc75a4fc644 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:44.670993 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1641d9ca-0cb3-488e-b8c1-5cc75a4fc644 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:44.672825 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39ea7e8e-66d4-4dca-ae60-a4ebe67fa8f6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:44.673274 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39ea7e8e-66d4-4dca-ae60-a4ebe67fa8f6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:44.674217 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39ea7e8e-66d4-4dca-ae60-a4ebe67fa8f6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:44.674805 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39ea7e8e-66d4-4dca-ae60-a4ebe67fa8f6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:44.705361 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1641d9ca-0cb3-488e-b8c1-5cc75a4fc644 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050027 Apr 06 16:51:44.705978 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 824/1636] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:44 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:44.934064 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-39ea7e8e-66d4-4dca-ae60-a4ebe67fa8f6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:44.943307 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-39ea7e8e-66d4-4dca-ae60-a4ebe67fa8f6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.287209 Apr 06 16:51:44.944080 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 813/1637] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:44 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:45.717310 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-76d5c7b2-0822-45ec-bf41-b062aa9d0a18 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:45.718229 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-76d5c7b2-0822-45ec-bf41-b062aa9d0a18 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:45.724923 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76d5c7b2-0822-45ec-bf41-b062aa9d0a18 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:45.725373 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76d5c7b2-0822-45ec-bf41-b062aa9d0a18 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:45.726146 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76d5c7b2-0822-45ec-bf41-b062aa9d0a18 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:45.726573 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76d5c7b2-0822-45ec-bf41-b062aa9d0a18 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:45.759784 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-76d5c7b2-0822-45ec-bf41-b062aa9d0a18 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046410 Apr 06 16:51:45.760364 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 825/1638] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:45 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:45.839134 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 16:51:45.839798 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 16:51:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 16:51:45.962332 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8394347e-d9af-47a8-9335-f4fee3f5e483 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:45.962861 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8394347e-d9af-47a8-9335-f4fee3f5e483 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:45.969609 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8394347e-d9af-47a8-9335-f4fee3f5e483 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:45.970057 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8394347e-d9af-47a8-9335-f4fee3f5e483 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:45.970832 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8394347e-d9af-47a8-9335-f4fee3f5e483 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:45.971257 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8394347e-d9af-47a8-9335-f4fee3f5e483 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:46.126627 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8394347e-d9af-47a8-9335-f4fee3f5e483 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:46.135193 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8394347e-d9af-47a8-9335-f4fee3f5e483 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.177508 Apr 06 16:51:46.135836 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 814/1639] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:45 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:46.773796 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d924382b-60de-48c5-92c7-ea9eb6af622e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:46.774710 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d924382b-60de-48c5-92c7-ea9eb6af622e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:46.781699 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d924382b-60de-48c5-92c7-ea9eb6af622e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:46.782118 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d924382b-60de-48c5-92c7-ea9eb6af622e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:46.782912 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d924382b-60de-48c5-92c7-ea9eb6af622e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:46.783361 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d924382b-60de-48c5-92c7-ea9eb6af622e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:46.815107 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d924382b-60de-48c5-92c7-ea9eb6af622e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047239 Apr 06 16:51:46.815688 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 826/1640] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:46 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:47.156404 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ced50864-3a83-414b-9ce0-a025965ad11a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:47.157481 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ced50864-3a83-414b-9ce0-a025965ad11a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:47.166521 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ced50864-3a83-414b-9ce0-a025965ad11a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:47.167088 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ced50864-3a83-414b-9ce0-a025965ad11a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:47.168317 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ced50864-3a83-414b-9ce0-a025965ad11a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:47.168975 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ced50864-3a83-414b-9ce0-a025965ad11a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:47.315000 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ced50864-3a83-414b-9ce0-a025965ad11a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:47.324197 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ced50864-3a83-414b-9ce0-a025965ad11a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.174631 Apr 06 16:51:47.324775 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 815/1641] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:47 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:47.830025 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b31caf73-757c-4fa8-98b0-cfeb66acf893 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:47.831592 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b31caf73-757c-4fa8-98b0-cfeb66acf893 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:47.845198 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b31caf73-757c-4fa8-98b0-cfeb66acf893 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:47.846741 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b31caf73-757c-4fa8-98b0-cfeb66acf893 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:47.847956 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b31caf73-757c-4fa8-98b0-cfeb66acf893 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:47.848637 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b31caf73-757c-4fa8-98b0-cfeb66acf893 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:47.881239 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b31caf73-757c-4fa8-98b0-cfeb66acf893 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057331 Apr 06 16:51:47.882041 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 827/1642] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:47 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:48.341703 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-86a58834-44c9-4f40-b7ad-b5974fb8500e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:48.342319 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-86a58834-44c9-4f40-b7ad-b5974fb8500e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:48.351369 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86a58834-44c9-4f40-b7ad-b5974fb8500e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:48.351842 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86a58834-44c9-4f40-b7ad-b5974fb8500e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:48.352623 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86a58834-44c9-4f40-b7ad-b5974fb8500e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:48.353086 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86a58834-44c9-4f40-b7ad-b5974fb8500e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:48.514475 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-86a58834-44c9-4f40-b7ad-b5974fb8500e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:48.522661 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-86a58834-44c9-4f40-b7ad-b5974fb8500e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.184949 Apr 06 16:51:48.523271 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 816/1643] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:48 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:48.893205 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-24bcd745-0fb7-4442-93ee-a735ffaed897 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:48.894129 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-24bcd745-0fb7-4442-93ee-a735ffaed897 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:48.901635 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24bcd745-0fb7-4442-93ee-a735ffaed897 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:48.902082 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24bcd745-0fb7-4442-93ee-a735ffaed897 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:48.902925 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24bcd745-0fb7-4442-93ee-a735ffaed897 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:48.903275 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24bcd745-0fb7-4442-93ee-a735ffaed897 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:48.933591 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-24bcd745-0fb7-4442-93ee-a735ffaed897 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044360 Apr 06 16:51:48.934402 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 828/1644] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:48 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:49.544731 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-55140a36-ee80-42f5-84b9-3daa184d2a55 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:49.545528 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-55140a36-ee80-42f5-84b9-3daa184d2a55 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:49.555845 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55140a36-ee80-42f5-84b9-3daa184d2a55 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:49.556392 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55140a36-ee80-42f5-84b9-3daa184d2a55 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:49.557214 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55140a36-ee80-42f5-84b9-3daa184d2a55 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:49.566404 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55140a36-ee80-42f5-84b9-3daa184d2a55 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:49.702935 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-55140a36-ee80-42f5-84b9-3daa184d2a55 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:49.711369 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-55140a36-ee80-42f5-84b9-3daa184d2a55 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.170517 Apr 06 16:51:49.712001 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 817/1645] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:49 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:49.950225 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fdad25b6-c3b4-49b1-81e4-e9e1c0f580d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:49.951168 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fdad25b6-c3b4-49b1-81e4-e9e1c0f580d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:49.958577 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdad25b6-c3b4-49b1-81e4-e9e1c0f580d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:49.959053 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdad25b6-c3b4-49b1-81e4-e9e1c0f580d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:49.959842 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdad25b6-c3b4-49b1-81e4-e9e1c0f580d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:49.960275 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdad25b6-c3b4-49b1-81e4-e9e1c0f580d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:50.003089 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fdad25b6-c3b4-49b1-81e4-e9e1c0f580d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059630 Apr 06 16:51:50.003715 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 829/1646] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:49 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:50.730636 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0e925919-506f-4cae-a9b8-0ec2166fb583 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:50.731248 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0e925919-506f-4cae-a9b8-0ec2166fb583 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:50.737973 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e925919-506f-4cae-a9b8-0ec2166fb583 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:50.738393 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e925919-506f-4cae-a9b8-0ec2166fb583 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:50.739292 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e925919-506f-4cae-a9b8-0ec2166fb583 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:50.739680 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e925919-506f-4cae-a9b8-0ec2166fb583 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:50.885196 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0e925919-506f-4cae-a9b8-0ec2166fb583 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:50.894895 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0e925919-506f-4cae-a9b8-0ec2166fb583 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.169487 Apr 06 16:51:50.895542 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 818/1647] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:50 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:51.016635 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5d0701ae-5e20-4bd4-b80a-626d1fa271c4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:51.017984 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5d0701ae-5e20-4bd4-b80a-626d1fa271c4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:51.025874 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d0701ae-5e20-4bd4-b80a-626d1fa271c4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:51.026321 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d0701ae-5e20-4bd4-b80a-626d1fa271c4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:51.027108 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d0701ae-5e20-4bd4-b80a-626d1fa271c4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:51.027529 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d0701ae-5e20-4bd4-b80a-626d1fa271c4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:51.068248 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5d0701ae-5e20-4bd4-b80a-626d1fa271c4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054973 Apr 06 16:51:51.068248 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 830/1648] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:51 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:51.913174 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c708f7d5-297f-4666-a8fe-07641b42e19a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:51.913804 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c708f7d5-297f-4666-a8fe-07641b42e19a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:51.921176 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c708f7d5-297f-4666-a8fe-07641b42e19a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:51.921592 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c708f7d5-297f-4666-a8fe-07641b42e19a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:51.922384 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c708f7d5-297f-4666-a8fe-07641b42e19a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:51.922840 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c708f7d5-297f-4666-a8fe-07641b42e19a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:52.080818 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-196b6067-97cb-48d3-a0ff-beb99d58b52c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:52.081933 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-196b6067-97cb-48d3-a0ff-beb99d58b52c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:52.092177 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-196b6067-97cb-48d3-a0ff-beb99d58b52c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:52.092364 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-196b6067-97cb-48d3-a0ff-beb99d58b52c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:52.093065 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-196b6067-97cb-48d3-a0ff-beb99d58b52c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:52.093716 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-196b6067-97cb-48d3-a0ff-beb99d58b52c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:52.103418 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c708f7d5-297f-4666-a8fe-07641b42e19a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:52.112045 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c708f7d5-297f-4666-a8fe-07641b42e19a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.202529 Apr 06 16:51:52.112293 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 819/1649] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:51 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:52.136086 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-196b6067-97cb-48d3-a0ff-beb99d58b52c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056725 Apr 06 16:51:52.137529 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 831/1650] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:52 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:53.130036 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fd497f88-f285-4d53-ab3d-b4dc208f5912 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:53.130639 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fd497f88-f285-4d53-ab3d-b4dc208f5912 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:53.138075 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd497f88-f285-4d53-ab3d-b4dc208f5912 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:53.138531 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd497f88-f285-4d53-ab3d-b4dc208f5912 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:53.139339 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd497f88-f285-4d53-ab3d-b4dc208f5912 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:53.139754 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd497f88-f285-4d53-ab3d-b4dc208f5912 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:53.149345 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b5d07bbf-0b29-4cc7-802b-30de252eb526 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:53.150339 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b5d07bbf-0b29-4cc7-802b-30de252eb526 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:53.157037 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5d07bbf-0b29-4cc7-802b-30de252eb526 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:53.157472 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5d07bbf-0b29-4cc7-802b-30de252eb526 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:53.158838 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5d07bbf-0b29-4cc7-802b-30de252eb526 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:53.159274 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5d07bbf-0b29-4cc7-802b-30de252eb526 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:53.190544 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b5d07bbf-0b29-4cc7-802b-30de252eb526 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045510 Apr 06 16:51:53.191097 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 832/1651] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:53 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:51:53.301908 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fd497f88-f285-4d53-ab3d-b4dc208f5912 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:53.310781 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fd497f88-f285-4d53-ab3d-b4dc208f5912 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.184611 Apr 06 16:51:53.311374 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 820/1652] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:53 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:54.202882 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-befe13ec-5112-4016-b918-e7a00938bdf2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:54.203847 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-befe13ec-5112-4016-b918-e7a00938bdf2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:54.211397 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-befe13ec-5112-4016-b918-e7a00938bdf2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:54.211861 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-befe13ec-5112-4016-b918-e7a00938bdf2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:54.212774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-befe13ec-5112-4016-b918-e7a00938bdf2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:54.213218 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-befe13ec-5112-4016-b918-e7a00938bdf2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:54.245218 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-befe13ec-5112-4016-b918-e7a00938bdf2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046343 Apr 06 16:51:54.245796 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 833/1653] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:54 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:54.330144 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3fe308ec-22ec-4c76-b335-147508f8f5ca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:54.331287 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3fe308ec-22ec-4c76-b335-147508f8f5ca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:54.339978 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fe308ec-22ec-4c76-b335-147508f8f5ca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:54.340414 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fe308ec-22ec-4c76-b335-147508f8f5ca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:54.341434 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fe308ec-22ec-4c76-b335-147508f8f5ca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:54.341864 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fe308ec-22ec-4c76-b335-147508f8f5ca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:54.507966 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3fe308ec-22ec-4c76-b335-147508f8f5ca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:54.516312 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3fe308ec-22ec-4c76-b335-147508f8f5ca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.192332 Apr 06 16:51:54.517330 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 821/1654] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:54 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:55.257450 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8b5528c5-a6d2-4000-830c-e3c2f6d01c41 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:55.259518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8b5528c5-a6d2-4000-830c-e3c2f6d01c41 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:55.265884 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b5528c5-a6d2-4000-830c-e3c2f6d01c41 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:55.266306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b5528c5-a6d2-4000-830c-e3c2f6d01c41 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:55.267108 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b5528c5-a6d2-4000-830c-e3c2f6d01c41 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:55.267534 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b5528c5-a6d2-4000-830c-e3c2f6d01c41 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:55.306481 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8b5528c5-a6d2-4000-830c-e3c2f6d01c41 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053332 Apr 06 16:51:55.307072 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 834/1655] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:55 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:55.534388 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d4ceeafe-e145-4414-8164-54b7cedeca60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:55.535027 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d4ceeafe-e145-4414-8164-54b7cedeca60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:55.542000 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4ceeafe-e145-4414-8164-54b7cedeca60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:55.542471 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4ceeafe-e145-4414-8164-54b7cedeca60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:55.543221 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4ceeafe-e145-4414-8164-54b7cedeca60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:55.543665 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4ceeafe-e145-4414-8164-54b7cedeca60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:55.694339 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d4ceeafe-e145-4414-8164-54b7cedeca60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:55.702605 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d4ceeafe-e145-4414-8164-54b7cedeca60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.172272 Apr 06 16:51:55.703177 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 822/1656] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:55 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:56.319653 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9210c5c6-5ca6-4cda-92e0-fba616f1631a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:56.321139 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9210c5c6-5ca6-4cda-92e0-fba616f1631a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:56.327818 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9210c5c6-5ca6-4cda-92e0-fba616f1631a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:56.328533 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9210c5c6-5ca6-4cda-92e0-fba616f1631a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:56.329590 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9210c5c6-5ca6-4cda-92e0-fba616f1631a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:56.330161 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9210c5c6-5ca6-4cda-92e0-fba616f1631a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:56.363819 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9210c5c6-5ca6-4cda-92e0-fba616f1631a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048150 Apr 06 16:51:56.364493 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 835/1657] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:56 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:56.720711 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-aec81b38-5bc0-4055-954b-86bc110580f3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:56.721399 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-aec81b38-5bc0-4055-954b-86bc110580f3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:56.729326 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aec81b38-5bc0-4055-954b-86bc110580f3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:56.729880 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aec81b38-5bc0-4055-954b-86bc110580f3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:56.730978 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aec81b38-5bc0-4055-954b-86bc110580f3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:56.731501 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aec81b38-5bc0-4055-954b-86bc110580f3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:56.884270 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-aec81b38-5bc0-4055-954b-86bc110580f3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:56.893285 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-aec81b38-5bc0-4055-954b-86bc110580f3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.176490 Apr 06 16:51:56.893839 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 823/1658] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:56 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:57.377631 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e8283bae-313e-4b01-b844-a18bdb2ca255 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:57.378626 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e8283bae-313e-4b01-b844-a18bdb2ca255 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:57.387463 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8283bae-313e-4b01-b844-a18bdb2ca255 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:57.387925 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8283bae-313e-4b01-b844-a18bdb2ca255 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:57.388764 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8283bae-313e-4b01-b844-a18bdb2ca255 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:57.389207 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8283bae-313e-4b01-b844-a18bdb2ca255 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:57.424082 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e8283bae-313e-4b01-b844-a18bdb2ca255 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052375 Apr 06 16:51:57.425440 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 836/1659] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:57 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:57.911886 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3393b775-bc86-41b7-b733-2e2d31288f95 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:57.912457 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3393b775-bc86-41b7-b733-2e2d31288f95 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:57.919483 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3393b775-bc86-41b7-b733-2e2d31288f95 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:57.919932 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3393b775-bc86-41b7-b733-2e2d31288f95 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:57.920716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3393b775-bc86-41b7-b733-2e2d31288f95 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:57.921163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3393b775-bc86-41b7-b733-2e2d31288f95 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:58.082961 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3393b775-bc86-41b7-b733-2e2d31288f95 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:58.091821 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3393b775-bc86-41b7-b733-2e2d31288f95 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.183936 Apr 06 16:51:58.092413 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 824/1660] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:57 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:58.126419 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 16:51:58.126675 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 16:51:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 16:51:58.437181 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-10ac2a37-b1ec-402f-9731-e2d2d23290f0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:58.438105 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-10ac2a37-b1ec-402f-9731-e2d2d23290f0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:58.444867 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10ac2a37-b1ec-402f-9731-e2d2d23290f0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:58.445389 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10ac2a37-b1ec-402f-9731-e2d2d23290f0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:58.446550 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10ac2a37-b1ec-402f-9731-e2d2d23290f0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:58.446986 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10ac2a37-b1ec-402f-9731-e2d2d23290f0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:58.479071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-10ac2a37-b1ec-402f-9731-e2d2d23290f0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045890 Apr 06 16:51:58.479674 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 837/1661] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:58 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:51:59.110204 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ed593761-1553-4d57-9bb8-c76e78734597 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:59.110806 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ed593761-1553-4d57-9bb8-c76e78734597 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:59.117937 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed593761-1553-4d57-9bb8-c76e78734597 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:59.118390 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed593761-1553-4d57-9bb8-c76e78734597 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:59.119173 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed593761-1553-4d57-9bb8-c76e78734597 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:59.119623 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed593761-1553-4d57-9bb8-c76e78734597 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:59.271057 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ed593761-1553-4d57-9bb8-c76e78734597 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:51:59.279787 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ed593761-1553-4d57-9bb8-c76e78734597 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.173570 Apr 06 16:51:59.280369 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 825/1662] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:51:59 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:51:59.491482 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-150a8f22-c80e-4235-a233-d9405d26b461 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:51:59.492453 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-150a8f22-c80e-4235-a233-d9405d26b461 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:51:59.499421 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-150a8f22-c80e-4235-a233-d9405d26b461 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:59.499878 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-150a8f22-c80e-4235-a233-d9405d26b461 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:59.500661 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-150a8f22-c80e-4235-a233-d9405d26b461 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:51:59.501133 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-150a8f22-c80e-4235-a233-d9405d26b461 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:51:59.535162 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-150a8f22-c80e-4235-a233-d9405d26b461 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047668 Apr 06 16:51:59.535744 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 838/1663] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:51:59 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:00.299541 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bc349fa8-a472-4247-af73-27ecbd8c0350 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:00.300260 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bc349fa8-a472-4247-af73-27ecbd8c0350 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:00.307180 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc349fa8-a472-4247-af73-27ecbd8c0350 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:00.307653 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc349fa8-a472-4247-af73-27ecbd8c0350 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:00.308414 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc349fa8-a472-4247-af73-27ecbd8c0350 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:00.308895 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc349fa8-a472-4247-af73-27ecbd8c0350 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:00.469724 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-bc349fa8-a472-4247-af73-27ecbd8c0350 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:00.478783 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bc349fa8-a472-4247-af73-27ecbd8c0350 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.185386 Apr 06 16:52:00.479358 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 826/1664] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:00 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:00.547476 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f418076c-4805-4527-a491-12531269fdcf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:00.548433 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f418076c-4805-4527-a491-12531269fdcf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:00.555840 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f418076c-4805-4527-a491-12531269fdcf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:00.556287 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f418076c-4805-4527-a491-12531269fdcf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:00.557072 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f418076c-4805-4527-a491-12531269fdcf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:00.557535 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f418076c-4805-4527-a491-12531269fdcf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:00.588655 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f418076c-4805-4527-a491-12531269fdcf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045197 Apr 06 16:52:00.589361 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 839/1665] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:00 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:01.496713 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-10eec7e4-6514-4e52-b2a7-eea269d2ca3b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:01.497305 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-10eec7e4-6514-4e52-b2a7-eea269d2ca3b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:01.504208 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10eec7e4-6514-4e52-b2a7-eea269d2ca3b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:01.504653 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10eec7e4-6514-4e52-b2a7-eea269d2ca3b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:01.505474 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10eec7e4-6514-4e52-b2a7-eea269d2ca3b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:01.505906 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10eec7e4-6514-4e52-b2a7-eea269d2ca3b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:01.607956 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-518f2387-72c6-498c-b99e-d908183b9377 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:01.607956 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-518f2387-72c6-498c-b99e-d908183b9377 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:01.614547 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-518f2387-72c6-498c-b99e-d908183b9377 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:01.615868 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-518f2387-72c6-498c-b99e-d908183b9377 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:01.617214 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-518f2387-72c6-498c-b99e-d908183b9377 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:01.617886 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-518f2387-72c6-498c-b99e-d908183b9377 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:01.653001 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-518f2387-72c6-498c-b99e-d908183b9377 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056424 Apr 06 16:52:01.653554 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 840/1666] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:01 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:01.662512 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-10eec7e4-6514-4e52-b2a7-eea269d2ca3b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:01.671099 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-10eec7e4-6514-4e52-b2a7-eea269d2ca3b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.178682 Apr 06 16:52:01.676208 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 827/1667] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:01 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:02.666087 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9940c2db-5fd3-4fea-a7bc-587e5d8ab4f7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:02.667061 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9940c2db-5fd3-4fea-a7bc-587e5d8ab4f7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:02.673919 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9940c2db-5fd3-4fea-a7bc-587e5d8ab4f7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:02.674372 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9940c2db-5fd3-4fea-a7bc-587e5d8ab4f7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:02.675135 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9940c2db-5fd3-4fea-a7bc-587e5d8ab4f7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:02.675581 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9940c2db-5fd3-4fea-a7bc-587e5d8ab4f7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:02.689715 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8e0ebfe1-1d4e-46d2-b090-6b93a65532a2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:02.691106 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8e0ebfe1-1d4e-46d2-b090-6b93a65532a2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:02.700609 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e0ebfe1-1d4e-46d2-b090-6b93a65532a2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:02.701054 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e0ebfe1-1d4e-46d2-b090-6b93a65532a2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:02.701880 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e0ebfe1-1d4e-46d2-b090-6b93a65532a2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:02.702314 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e0ebfe1-1d4e-46d2-b090-6b93a65532a2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:02.710942 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9940c2db-5fd3-4fea-a7bc-587e5d8ab4f7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050076 Apr 06 16:52:02.711818 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 841/1668] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:02 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:02.865199 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8e0ebfe1-1d4e-46d2-b090-6b93a65532a2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:02.878982 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8e0ebfe1-1d4e-46d2-b090-6b93a65532a2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.193552 Apr 06 16:52:02.879669 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 828/1669] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:02 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:03.723569 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-24e9756e-1d64-424e-88fb-89d878f81671 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:03.724670 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-24e9756e-1d64-424e-88fb-89d878f81671 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:03.732004 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24e9756e-1d64-424e-88fb-89d878f81671 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:03.732452 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24e9756e-1d64-424e-88fb-89d878f81671 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:03.733252 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24e9756e-1d64-424e-88fb-89d878f81671 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:03.733715 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24e9756e-1d64-424e-88fb-89d878f81671 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:03.770445 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-24e9756e-1d64-424e-88fb-89d878f81671 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050617 Apr 06 16:52:03.771084 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 842/1670] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:03 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:03.900163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-38fddbe5-37ab-45f1-afe5-403a5e25cabb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:03.900789 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-38fddbe5-37ab-45f1-afe5-403a5e25cabb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:03.907691 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38fddbe5-37ab-45f1-afe5-403a5e25cabb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:03.908146 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38fddbe5-37ab-45f1-afe5-403a5e25cabb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:03.908965 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38fddbe5-37ab-45f1-afe5-403a5e25cabb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:03.909406 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38fddbe5-37ab-45f1-afe5-403a5e25cabb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:04.067775 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-38fddbe5-37ab-45f1-afe5-403a5e25cabb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:04.082625 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-38fddbe5-37ab-45f1-afe5-403a5e25cabb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.187802 Apr 06 16:52:04.083178 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 829/1671] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:03 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:04.782827 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c343e019-e1d5-4c1a-af79-bc272032fb63 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:04.783779 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c343e019-e1d5-4c1a-af79-bc272032fb63 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:04.790322 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c343e019-e1d5-4c1a-af79-bc272032fb63 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:04.790768 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c343e019-e1d5-4c1a-af79-bc272032fb63 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:04.791565 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c343e019-e1d5-4c1a-af79-bc272032fb63 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:04.791987 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c343e019-e1d5-4c1a-af79-bc272032fb63 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:04.825015 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c343e019-e1d5-4c1a-af79-bc272032fb63 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046122 Apr 06 16:52:04.828602 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 843/1672] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:04 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:05.101727 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8f4fef4d-e4d3-4b30-87e7-7492a3b6ea6e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:05.102390 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8f4fef4d-e4d3-4b30-87e7-7492a3b6ea6e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:05.110005 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f4fef4d-e4d3-4b30-87e7-7492a3b6ea6e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:05.110458 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f4fef4d-e4d3-4b30-87e7-7492a3b6ea6e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:05.111244 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f4fef4d-e4d3-4b30-87e7-7492a3b6ea6e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:05.111708 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f4fef4d-e4d3-4b30-87e7-7492a3b6ea6e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:05.253915 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8f4fef4d-e4d3-4b30-87e7-7492a3b6ea6e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:05.266054 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8f4fef4d-e4d3-4b30-87e7-7492a3b6ea6e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.169602 Apr 06 16:52:05.266877 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 830/1673] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:05 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:05.836761 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-de80d0ce-6c96-4f02-9537-5861a43fdbd2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:05.837687 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-de80d0ce-6c96-4f02-9537-5861a43fdbd2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:05.844493 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de80d0ce-6c96-4f02-9537-5861a43fdbd2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:05.844979 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de80d0ce-6c96-4f02-9537-5861a43fdbd2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:05.845760 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de80d0ce-6c96-4f02-9537-5861a43fdbd2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:05.846189 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de80d0ce-6c96-4f02-9537-5861a43fdbd2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:05.877487 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-de80d0ce-6c96-4f02-9537-5861a43fdbd2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045523 Apr 06 16:52:05.878080 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 844/1674] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:05 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:06.285453 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-071d26c9-cac3-467c-bd29-f3d01a5cb2a6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:06.286056 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-071d26c9-cac3-467c-bd29-f3d01a5cb2a6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:06.293366 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-071d26c9-cac3-467c-bd29-f3d01a5cb2a6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:06.293996 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-071d26c9-cac3-467c-bd29-f3d01a5cb2a6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:06.295172 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-071d26c9-cac3-467c-bd29-f3d01a5cb2a6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:06.295768 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-071d26c9-cac3-467c-bd29-f3d01a5cb2a6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:06.451164 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-071d26c9-cac3-467c-bd29-f3d01a5cb2a6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:06.460247 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-071d26c9-cac3-467c-bd29-f3d01a5cb2a6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.180074 Apr 06 16:52:06.461224 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 831/1675] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:06 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:06.890477 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-60ba1417-ec0c-40df-864f-bd8e4f1e3ca1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:06.891399 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-60ba1417-ec0c-40df-864f-bd8e4f1e3ca1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:06.898325 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60ba1417-ec0c-40df-864f-bd8e4f1e3ca1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:06.898748 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60ba1417-ec0c-40df-864f-bd8e4f1e3ca1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:06.899546 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60ba1417-ec0c-40df-864f-bd8e4f1e3ca1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:06.899978 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60ba1417-ec0c-40df-864f-bd8e4f1e3ca1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:06.933770 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-60ba1417-ec0c-40df-864f-bd8e4f1e3ca1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047820 Apr 06 16:52:06.934332 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 845/1676] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:06 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:07.480062 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3b9044e4-2121-4141-9295-05f4fde28d72 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:07.480732 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3b9044e4-2121-4141-9295-05f4fde28d72 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:07.487589 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b9044e4-2121-4141-9295-05f4fde28d72 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:07.488079 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b9044e4-2121-4141-9295-05f4fde28d72 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:07.488861 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b9044e4-2121-4141-9295-05f4fde28d72 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:07.489308 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b9044e4-2121-4141-9295-05f4fde28d72 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:07.641484 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3b9044e4-2121-4141-9295-05f4fde28d72 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:07.649929 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3b9044e4-2121-4141-9295-05f4fde28d72 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.174695 Apr 06 16:52:07.650498 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 832/1677] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:07 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:07.946121 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-79ccd659-56eb-4ab8-b5e1-34d7b0fe1f6c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:07.947234 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-79ccd659-56eb-4ab8-b5e1-34d7b0fe1f6c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:07.956284 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79ccd659-56eb-4ab8-b5e1-34d7b0fe1f6c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:07.956736 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79ccd659-56eb-4ab8-b5e1-34d7b0fe1f6c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:07.957518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79ccd659-56eb-4ab8-b5e1-34d7b0fe1f6c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:07.957948 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79ccd659-56eb-4ab8-b5e1-34d7b0fe1f6c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:07.990815 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-79ccd659-56eb-4ab8-b5e1-34d7b0fe1f6c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048742 Apr 06 16:52:07.991087 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 846/1678] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:07 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:08.667613 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-88208fd1-4f9c-44ac-ab48-c3e27394c54b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:08.668225 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-88208fd1-4f9c-44ac-ab48-c3e27394c54b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:08.674879 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88208fd1-4f9c-44ac-ab48-c3e27394c54b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:08.675726 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88208fd1-4f9c-44ac-ab48-c3e27394c54b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:08.676187 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88208fd1-4f9c-44ac-ab48-c3e27394c54b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:08.676627 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88208fd1-4f9c-44ac-ab48-c3e27394c54b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:08.826885 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-88208fd1-4f9c-44ac-ab48-c3e27394c54b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:08.835688 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-88208fd1-4f9c-44ac-ab48-c3e27394c54b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.172529 Apr 06 16:52:08.836702 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 833/1679] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:08 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:09.003182 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7d53f564-b177-4a55-92ec-12cfba19e65f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:09.004002 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7d53f564-b177-4a55-92ec-12cfba19e65f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:09.011961 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d53f564-b177-4a55-92ec-12cfba19e65f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:09.012380 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d53f564-b177-4a55-92ec-12cfba19e65f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:09.013300 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d53f564-b177-4a55-92ec-12cfba19e65f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:09.013726 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d53f564-b177-4a55-92ec-12cfba19e65f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:09.044952 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7d53f564-b177-4a55-92ec-12cfba19e65f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045880 Apr 06 16:52:09.045553 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 847/1680] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:08 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:09.854923 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4844b60f-9f41-498a-aec4-5b2b0b532e03 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:09.855545 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4844b60f-9f41-498a-aec4-5b2b0b532e03 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:09.862627 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4844b60f-9f41-498a-aec4-5b2b0b532e03 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:09.863045 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4844b60f-9f41-498a-aec4-5b2b0b532e03 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:09.863809 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4844b60f-9f41-498a-aec4-5b2b0b532e03 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:09.864242 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4844b60f-9f41-498a-aec4-5b2b0b532e03 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:10.029015 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4844b60f-9f41-498a-aec4-5b2b0b532e03 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:10.037873 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4844b60f-9f41-498a-aec4-5b2b0b532e03 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.187420 Apr 06 16:52:10.038458 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 834/1681] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:09 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:10.057759 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8d992536-7721-45b0-845e-35684f061e02 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:10.058693 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8d992536-7721-45b0-845e-35684f061e02 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:10.065512 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d992536-7721-45b0-845e-35684f061e02 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:10.065912 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d992536-7721-45b0-845e-35684f061e02 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:10.066694 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d992536-7721-45b0-845e-35684f061e02 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:10.067178 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d992536-7721-45b0-845e-35684f061e02 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:10.103155 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8d992536-7721-45b0-845e-35684f061e02 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048867 Apr 06 16:52:10.104322 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 848/1682] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:10 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:11.057733 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ff32eff6-da28-4f9a-b29b-3430ac36e9e6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:11.058328 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ff32eff6-da28-4f9a-b29b-3430ac36e9e6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:11.065977 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff32eff6-da28-4f9a-b29b-3430ac36e9e6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:11.066534 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff32eff6-da28-4f9a-b29b-3430ac36e9e6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:11.067235 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff32eff6-da28-4f9a-b29b-3430ac36e9e6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:11.067686 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff32eff6-da28-4f9a-b29b-3430ac36e9e6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:11.120640 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cbd0f200-3b86-4a27-a9ad-83ac347d5183 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:11.122122 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cbd0f200-3b86-4a27-a9ad-83ac347d5183 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:11.131109 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbd0f200-3b86-4a27-a9ad-83ac347d5183 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:11.131557 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbd0f200-3b86-4a27-a9ad-83ac347d5183 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:11.132658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbd0f200-3b86-4a27-a9ad-83ac347d5183 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:11.133329 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cbd0f200-3b86-4a27-a9ad-83ac347d5183 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:11.173633 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cbd0f200-3b86-4a27-a9ad-83ac347d5183 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060269 Apr 06 16:52:11.174460 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 849/1683] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:11 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:11.221911 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ff32eff6-da28-4f9a-b29b-3430ac36e9e6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:11.230682 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ff32eff6-da28-4f9a-b29b-3430ac36e9e6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.177531 Apr 06 16:52:11.231255 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 835/1684] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:11 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:11.528215 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 16:52:11.528475 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 16:52:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 16:52:12.185983 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-54867a25-6f14-416e-a19d-6d22bd1b992c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:12.186959 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-54867a25-6f14-416e-a19d-6d22bd1b992c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:12.193495 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54867a25-6f14-416e-a19d-6d22bd1b992c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:12.193942 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54867a25-6f14-416e-a19d-6d22bd1b992c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:12.194777 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54867a25-6f14-416e-a19d-6d22bd1b992c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:12.195206 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54867a25-6f14-416e-a19d-6d22bd1b992c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:12.228171 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-54867a25-6f14-416e-a19d-6d22bd1b992c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045694 Apr 06 16:52:12.228500 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 850/1685] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:12 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:12.248983 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b5bb91e7-d243-4d8b-9a27-ae0a7fd0f61e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:12.249585 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b5bb91e7-d243-4d8b-9a27-ae0a7fd0f61e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:12.257429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5bb91e7-d243-4d8b-9a27-ae0a7fd0f61e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:12.257429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5bb91e7-d243-4d8b-9a27-ae0a7fd0f61e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:12.257429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5bb91e7-d243-4d8b-9a27-ae0a7fd0f61e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:12.258196 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5bb91e7-d243-4d8b-9a27-ae0a7fd0f61e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:12.423115 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b5bb91e7-d243-4d8b-9a27-ae0a7fd0f61e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:12.431891 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b5bb91e7-d243-4d8b-9a27-ae0a7fd0f61e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.187889 Apr 06 16:52:12.432470 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 836/1686] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:12 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:13.240262 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-14efe258-dafc-466d-b42b-9d99e86c4da8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:13.241437 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-14efe258-dafc-466d-b42b-9d99e86c4da8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:13.248010 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14efe258-dafc-466d-b42b-9d99e86c4da8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:13.248464 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14efe258-dafc-466d-b42b-9d99e86c4da8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:13.249277 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14efe258-dafc-466d-b42b-9d99e86c4da8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:13.249717 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14efe258-dafc-466d-b42b-9d99e86c4da8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:13.291131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-14efe258-dafc-466d-b42b-9d99e86c4da8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055027 Apr 06 16:52:13.291739 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 851/1687] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:13 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:13.454486 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f50abddb-ee24-4ab1-81bc-662505c604fe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:13.456068 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f50abddb-ee24-4ab1-81bc-662505c604fe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:13.466925 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f50abddb-ee24-4ab1-81bc-662505c604fe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:13.467364 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f50abddb-ee24-4ab1-81bc-662505c604fe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:13.468161 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f50abddb-ee24-4ab1-81bc-662505c604fe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:13.468563 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f50abddb-ee24-4ab1-81bc-662505c604fe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:13.616296 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f50abddb-ee24-4ab1-81bc-662505c604fe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:13.624599 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f50abddb-ee24-4ab1-81bc-662505c604fe tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.178718 Apr 06 16:52:13.625219 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 837/1688] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:13 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:14.303113 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-44f8f2ca-e85d-439d-bd1e-644a16cd0c75 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:14.304031 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-44f8f2ca-e85d-439d-bd1e-644a16cd0c75 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:14.311311 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44f8f2ca-e85d-439d-bd1e-644a16cd0c75 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:14.311766 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44f8f2ca-e85d-439d-bd1e-644a16cd0c75 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:14.312600 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44f8f2ca-e85d-439d-bd1e-644a16cd0c75 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:14.313087 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44f8f2ca-e85d-439d-bd1e-644a16cd0c75 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:14.347139 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-44f8f2ca-e85d-439d-bd1e-644a16cd0c75 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048131 Apr 06 16:52:14.347723 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 852/1689] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:14 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:14.642501 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2dfc1e09-01cf-4383-8735-adcca21dbb4d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:14.643330 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2dfc1e09-01cf-4383-8735-adcca21dbb4d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:14.650466 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2dfc1e09-01cf-4383-8735-adcca21dbb4d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:14.650912 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2dfc1e09-01cf-4383-8735-adcca21dbb4d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:14.651689 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2dfc1e09-01cf-4383-8735-adcca21dbb4d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:14.652138 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2dfc1e09-01cf-4383-8735-adcca21dbb4d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:14.795260 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2dfc1e09-01cf-4383-8735-adcca21dbb4d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:14.803451 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2dfc1e09-01cf-4383-8735-adcca21dbb4d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.164808 Apr 06 16:52:14.804027 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 838/1690] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:14 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:15.364740 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-195f13ed-8e99-4641-ae33-eabb022d70c8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:15.365858 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-195f13ed-8e99-4641-ae33-eabb022d70c8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:15.373200 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-195f13ed-8e99-4641-ae33-eabb022d70c8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:15.373641 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-195f13ed-8e99-4641-ae33-eabb022d70c8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:15.374415 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-195f13ed-8e99-4641-ae33-eabb022d70c8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:15.374841 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-195f13ed-8e99-4641-ae33-eabb022d70c8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:15.419468 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-195f13ed-8e99-4641-ae33-eabb022d70c8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060894 Apr 06 16:52:15.420092 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 853/1691] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:15 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:15.822016 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1e4bca61-2cea-4fa5-a714-30d205d6e10f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:15.822717 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1e4bca61-2cea-4fa5-a714-30d205d6e10f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:15.829577 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e4bca61-2cea-4fa5-a714-30d205d6e10f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:15.830008 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e4bca61-2cea-4fa5-a714-30d205d6e10f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:15.831100 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e4bca61-2cea-4fa5-a714-30d205d6e10f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:15.831535 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e4bca61-2cea-4fa5-a714-30d205d6e10f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:15.982964 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1e4bca61-2cea-4fa5-a714-30d205d6e10f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:15.992392 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1e4bca61-2cea-4fa5-a714-30d205d6e10f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.174792 Apr 06 16:52:15.993119 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 839/1692] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:15 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:16.432507 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bf8f51bc-08f0-4cb7-a5a1-da46e6c37b6f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:16.433371 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bf8f51bc-08f0-4cb7-a5a1-da46e6c37b6f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:16.440154 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf8f51bc-08f0-4cb7-a5a1-da46e6c37b6f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:16.440571 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf8f51bc-08f0-4cb7-a5a1-da46e6c37b6f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:16.441392 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf8f51bc-08f0-4cb7-a5a1-da46e6c37b6f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:16.441827 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf8f51bc-08f0-4cb7-a5a1-da46e6c37b6f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:16.474862 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bf8f51bc-08f0-4cb7-a5a1-da46e6c37b6f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046445 Apr 06 16:52:16.475678 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 854/1693] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:16 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:17.011961 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7c8ecdca-9f60-48f4-8765-026134de403b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:17.012584 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7c8ecdca-9f60-48f4-8765-026134de403b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:17.019603 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c8ecdca-9f60-48f4-8765-026134de403b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:17.020060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c8ecdca-9f60-48f4-8765-026134de403b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:17.020893 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c8ecdca-9f60-48f4-8765-026134de403b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:17.021331 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c8ecdca-9f60-48f4-8765-026134de403b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:17.164506 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7c8ecdca-9f60-48f4-8765-026134de403b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:17.173252 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7c8ecdca-9f60-48f4-8765-026134de403b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.165458 Apr 06 16:52:17.173827 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 840/1694] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:17 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:17.489420 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4ed43c6f-3397-4331-ac44-f10e7ab9c7e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:17.490823 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4ed43c6f-3397-4331-ac44-f10e7ab9c7e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:17.498019 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ed43c6f-3397-4331-ac44-f10e7ab9c7e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:17.498461 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ed43c6f-3397-4331-ac44-f10e7ab9c7e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:17.499240 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ed43c6f-3397-4331-ac44-f10e7ab9c7e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:17.499665 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ed43c6f-3397-4331-ac44-f10e7ab9c7e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:17.536739 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4ed43c6f-3397-4331-ac44-f10e7ab9c7e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052752 Apr 06 16:52:17.537621 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 855/1695] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:17 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:18.193304 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f92e31e0-a091-49db-90ad-962a86d5b6ec tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:18.193925 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f92e31e0-a091-49db-90ad-962a86d5b6ec tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:18.201974 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f92e31e0-a091-49db-90ad-962a86d5b6ec tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:18.202525 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f92e31e0-a091-49db-90ad-962a86d5b6ec tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:18.203681 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f92e31e0-a091-49db-90ad-962a86d5b6ec tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:18.204369 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f92e31e0-a091-49db-90ad-962a86d5b6ec tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:18.371408 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f92e31e0-a091-49db-90ad-962a86d5b6ec tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:18.384267 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f92e31e0-a091-49db-90ad-962a86d5b6ec tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.196486 Apr 06 16:52:18.384952 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 841/1696] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:18 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:18.552559 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9c1ba921-ca4a-4eab-8249-502ce6ddd493 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:18.553590 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9c1ba921-ca4a-4eab-8249-502ce6ddd493 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:18.562788 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c1ba921-ca4a-4eab-8249-502ce6ddd493 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:18.563336 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c1ba921-ca4a-4eab-8249-502ce6ddd493 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:18.564403 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c1ba921-ca4a-4eab-8249-502ce6ddd493 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:18.564931 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c1ba921-ca4a-4eab-8249-502ce6ddd493 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:18.601209 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9c1ba921-ca4a-4eab-8249-502ce6ddd493 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054760 Apr 06 16:52:18.601910 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 856/1697] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:18 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:19.404071 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4a747c01-c04e-43c7-86e2-a48126c7a375 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:19.404733 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4a747c01-c04e-43c7-86e2-a48126c7a375 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:19.412618 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a747c01-c04e-43c7-86e2-a48126c7a375 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:19.413397 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a747c01-c04e-43c7-86e2-a48126c7a375 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:19.414320 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a747c01-c04e-43c7-86e2-a48126c7a375 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:19.414737 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a747c01-c04e-43c7-86e2-a48126c7a375 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:19.577195 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4a747c01-c04e-43c7-86e2-a48126c7a375 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:19.591964 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4a747c01-c04e-43c7-86e2-a48126c7a375 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.192158 Apr 06 16:52:19.592547 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 842/1698] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:19 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:19.616353 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c7e6b9c7-3788-4649-8d93-3345b3701650 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:19.617297 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c7e6b9c7-3788-4649-8d93-3345b3701650 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:19.623865 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7e6b9c7-3788-4649-8d93-3345b3701650 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:19.624308 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7e6b9c7-3788-4649-8d93-3345b3701650 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:19.625112 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7e6b9c7-3788-4649-8d93-3345b3701650 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:19.625541 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c7e6b9c7-3788-4649-8d93-3345b3701650 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:19.656545 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c7e6b9c7-3788-4649-8d93-3345b3701650 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046398 Apr 06 16:52:19.657171 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 857/1699] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:19 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:20.609809 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0a238088-c692-4ae1-af2e-e95625fc6a54 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:20.610410 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0a238088-c692-4ae1-af2e-e95625fc6a54 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:20.617559 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a238088-c692-4ae1-af2e-e95625fc6a54 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:20.618033 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a238088-c692-4ae1-af2e-e95625fc6a54 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:20.618814 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a238088-c692-4ae1-af2e-e95625fc6a54 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:20.619253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a238088-c692-4ae1-af2e-e95625fc6a54 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:20.667925 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-54d87f83-1290-4bf5-a1f2-2f6da567a4ef tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:20.668898 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-54d87f83-1290-4bf5-a1f2-2f6da567a4ef tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:20.675493 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54d87f83-1290-4bf5-a1f2-2f6da567a4ef tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:20.675957 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54d87f83-1290-4bf5-a1f2-2f6da567a4ef tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:20.676757 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54d87f83-1290-4bf5-a1f2-2f6da567a4ef tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:20.677189 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54d87f83-1290-4bf5-a1f2-2f6da567a4ef tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:20.715374 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-54d87f83-1290-4bf5-a1f2-2f6da567a4ef tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050881 Apr 06 16:52:20.716812 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 858/1700] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:20 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:20.774493 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0a238088-c692-4ae1-af2e-e95625fc6a54 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:20.782834 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0a238088-c692-4ae1-af2e-e95625fc6a54 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.177065 Apr 06 16:52:20.783415 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 843/1701] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:20 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:21.728874 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0e56c088-04c4-47e4-9ee6-81be2887f009 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:21.729790 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0e56c088-04c4-47e4-9ee6-81be2887f009 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:21.736375 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e56c088-04c4-47e4-9ee6-81be2887f009 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:21.736868 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e56c088-04c4-47e4-9ee6-81be2887f009 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:21.737634 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e56c088-04c4-47e4-9ee6-81be2887f009 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:21.738060 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0e56c088-04c4-47e4-9ee6-81be2887f009 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:21.771188 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0e56c088-04c4-47e4-9ee6-81be2887f009 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047110 Apr 06 16:52:21.771775 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 859/1702] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:21 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:21.800801 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-905e2fd9-d902-459d-b9e9-199210b98c7f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:21.801495 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-905e2fd9-d902-459d-b9e9-199210b98c7f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:21.808051 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-905e2fd9-d902-459d-b9e9-199210b98c7f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:21.808493 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-905e2fd9-d902-459d-b9e9-199210b98c7f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:21.809306 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-905e2fd9-d902-459d-b9e9-199210b98c7f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:21.809732 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-905e2fd9-d902-459d-b9e9-199210b98c7f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:21.966606 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-905e2fd9-d902-459d-b9e9-199210b98c7f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:21.975094 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-905e2fd9-d902-459d-b9e9-199210b98c7f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.178342 Apr 06 16:52:21.975734 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 844/1703] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:21 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:22.783370 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cef9121c-5ac9-47cd-84ae-140f61afd6c9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:22.784281 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cef9121c-5ac9-47cd-84ae-140f61afd6c9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:22.791323 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cef9121c-5ac9-47cd-84ae-140f61afd6c9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:22.791758 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cef9121c-5ac9-47cd-84ae-140f61afd6c9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:22.792525 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cef9121c-5ac9-47cd-84ae-140f61afd6c9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:22.792985 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cef9121c-5ac9-47cd-84ae-140f61afd6c9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:22.829978 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cef9121c-5ac9-47cd-84ae-140f61afd6c9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050558 Apr 06 16:52:22.830552 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 860/1704] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:22 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:22.996140 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-94fdc732-be46-4ec6-b693-504f49c6ac1e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:22.996750 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-94fdc732-be46-4ec6-b693-504f49c6ac1e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:23.004544 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94fdc732-be46-4ec6-b693-504f49c6ac1e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:23.005442 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94fdc732-be46-4ec6-b693-504f49c6ac1e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:23.006775 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94fdc732-be46-4ec6-b693-504f49c6ac1e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:23.007211 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94fdc732-be46-4ec6-b693-504f49c6ac1e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:23.159716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-94fdc732-be46-4ec6-b693-504f49c6ac1e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:23.168596 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-94fdc732-be46-4ec6-b693-504f49c6ac1e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.178556 Apr 06 16:52:23.169214 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 845/1705] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:22 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:23.842944 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a0022b77-edd2-45b1-9442-a7da3dd76cad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:23.843783 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a0022b77-edd2-45b1-9442-a7da3dd76cad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:23.851029 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0022b77-edd2-45b1-9442-a7da3dd76cad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:23.851477 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0022b77-edd2-45b1-9442-a7da3dd76cad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:23.852567 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0022b77-edd2-45b1-9442-a7da3dd76cad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:23.853034 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0022b77-edd2-45b1-9442-a7da3dd76cad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:23.889250 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a0022b77-edd2-45b1-9442-a7da3dd76cad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050316 Apr 06 16:52:23.890007 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 861/1706] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:23 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:24.186545 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-42d073c7-aade-4af5-80ea-7367416c7d9e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:24.187761 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-42d073c7-aade-4af5-80ea-7367416c7d9e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:24.194368 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42d073c7-aade-4af5-80ea-7367416c7d9e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:24.194811 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42d073c7-aade-4af5-80ea-7367416c7d9e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:24.195588 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42d073c7-aade-4af5-80ea-7367416c7d9e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:24.196019 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42d073c7-aade-4af5-80ea-7367416c7d9e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:24.354617 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-42d073c7-aade-4af5-80ea-7367416c7d9e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:24.367625 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-42d073c7-aade-4af5-80ea-7367416c7d9e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.184617 Apr 06 16:52:24.368663 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 846/1707] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:24 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:24.905768 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-951ca5f5-42fe-425c-bcdd-e4c5c5d7c71e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:24.906761 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-951ca5f5-42fe-425c-bcdd-e4c5c5d7c71e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:24.916283 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-951ca5f5-42fe-425c-bcdd-e4c5c5d7c71e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:24.916722 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-951ca5f5-42fe-425c-bcdd-e4c5c5d7c71e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:24.917514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-951ca5f5-42fe-425c-bcdd-e4c5c5d7c71e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:24.917964 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-951ca5f5-42fe-425c-bcdd-e4c5c5d7c71e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:24.974553 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-951ca5f5-42fe-425c-bcdd-e4c5c5d7c71e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073199 Apr 06 16:52:24.975611 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 862/1708] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:24 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:52:25.387597 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0437350d-0c5f-4251-b7ab-dbc7a91bfe0f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:25.388220 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0437350d-0c5f-4251-b7ab-dbc7a91bfe0f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:25.396515 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0437350d-0c5f-4251-b7ab-dbc7a91bfe0f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:25.397121 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0437350d-0c5f-4251-b7ab-dbc7a91bfe0f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:25.398021 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0437350d-0c5f-4251-b7ab-dbc7a91bfe0f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:25.398521 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0437350d-0c5f-4251-b7ab-dbc7a91bfe0f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:25.552518 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0437350d-0c5f-4251-b7ab-dbc7a91bfe0f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:25.561141 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0437350d-0c5f-4251-b7ab-dbc7a91bfe0f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.178620 Apr 06 16:52:25.561719 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 847/1709] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:25 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:25.989608 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-db2a8dd2-6c56-4e5e-9735-f4e4caac0712 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:25.990534 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-db2a8dd2-6c56-4e5e-9735-f4e4caac0712 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:25.997508 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db2a8dd2-6c56-4e5e-9735-f4e4caac0712 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:25.997983 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db2a8dd2-6c56-4e5e-9735-f4e4caac0712 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:25.998799 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db2a8dd2-6c56-4e5e-9735-f4e4caac0712 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:25.999236 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db2a8dd2-6c56-4e5e-9735-f4e4caac0712 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:26.031595 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-db2a8dd2-6c56-4e5e-9735-f4e4caac0712 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046032 Apr 06 16:52:26.032160 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 863/1710] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:25 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:26.578962 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a82b5814-a4da-4834-8e98-5547854bb0c2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:26.579533 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a82b5814-a4da-4834-8e98-5547854bb0c2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:26.586429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a82b5814-a4da-4834-8e98-5547854bb0c2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:26.586883 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a82b5814-a4da-4834-8e98-5547854bb0c2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:26.587672 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a82b5814-a4da-4834-8e98-5547854bb0c2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:26.588112 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a82b5814-a4da-4834-8e98-5547854bb0c2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:26.735465 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a82b5814-a4da-4834-8e98-5547854bb0c2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:26.747275 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a82b5814-a4da-4834-8e98-5547854bb0c2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.172364 Apr 06 16:52:26.747842 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 848/1711] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:26 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:27.045374 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3418eb86-c580-4e80-b2ff-0aa7c232768f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:27.046413 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3418eb86-c580-4e80-b2ff-0aa7c232768f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:27.056568 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3418eb86-c580-4e80-b2ff-0aa7c232768f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:27.057060 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3418eb86-c580-4e80-b2ff-0aa7c232768f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:27.057817 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3418eb86-c580-4e80-b2ff-0aa7c232768f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:27.058251 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3418eb86-c580-4e80-b2ff-0aa7c232768f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:27.089316 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3418eb86-c580-4e80-b2ff-0aa7c232768f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047871 Apr 06 16:52:27.090134 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 864/1712] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:27 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:27.765844 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a8d981d2-0e0f-4eb4-9b35-fecd19fbfe9a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:27.766475 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a8d981d2-0e0f-4eb4-9b35-fecd19fbfe9a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:27.773276 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8d981d2-0e0f-4eb4-9b35-fecd19fbfe9a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:27.773755 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8d981d2-0e0f-4eb4-9b35-fecd19fbfe9a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:27.774527 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8d981d2-0e0f-4eb4-9b35-fecd19fbfe9a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:27.774947 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8d981d2-0e0f-4eb4-9b35-fecd19fbfe9a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:27.929331 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a8d981d2-0e0f-4eb4-9b35-fecd19fbfe9a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:27.937443 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a8d981d2-0e0f-4eb4-9b35-fecd19fbfe9a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.175525 Apr 06 16:52:27.938008 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 849/1713] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:27 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:28.102850 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1330948b-ce7f-48cc-a6a9-44ed68bef729 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:28.103724 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1330948b-ce7f-48cc-a6a9-44ed68bef729 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:28.110394 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1330948b-ce7f-48cc-a6a9-44ed68bef729 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:28.110838 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1330948b-ce7f-48cc-a6a9-44ed68bef729 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:28.111594 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1330948b-ce7f-48cc-a6a9-44ed68bef729 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:28.112031 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1330948b-ce7f-48cc-a6a9-44ed68bef729 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:28.143317 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1330948b-ce7f-48cc-a6a9-44ed68bef729 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045156 Apr 06 16:52:28.143897 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 865/1714] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:28 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:28.955743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6d5e92f5-61da-43d0-8426-2e49d164be10 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:28.956334 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6d5e92f5-61da-43d0-8426-2e49d164be10 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:28.963821 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d5e92f5-61da-43d0-8426-2e49d164be10 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:28.964265 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d5e92f5-61da-43d0-8426-2e49d164be10 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:28.965117 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d5e92f5-61da-43d0-8426-2e49d164be10 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:28.965529 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d5e92f5-61da-43d0-8426-2e49d164be10 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:29.112903 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6d5e92f5-61da-43d0-8426-2e49d164be10 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:29.122012 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6d5e92f5-61da-43d0-8426-2e49d164be10 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.170206 Apr 06 16:52:29.122613 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 850/1715] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:28 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:29.156707 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-96ea981c-f444-4031-9c69-8a7e5c85dfc9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:29.157737 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-96ea981c-f444-4031-9c69-8a7e5c85dfc9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:29.164508 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96ea981c-f444-4031-9c69-8a7e5c85dfc9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:29.164982 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96ea981c-f444-4031-9c69-8a7e5c85dfc9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:29.165764 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96ea981c-f444-4031-9c69-8a7e5c85dfc9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:29.166204 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96ea981c-f444-4031-9c69-8a7e5c85dfc9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:29.196418 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-96ea981c-f444-4031-9c69-8a7e5c85dfc9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043786 Apr 06 16:52:29.197038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 866/1716] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:29 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:30.149381 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-abf5a004-dced-4bd9-94c2-226d285ddaa4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:30.149997 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-abf5a004-dced-4bd9-94c2-226d285ddaa4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:30.158443 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abf5a004-dced-4bd9-94c2-226d285ddaa4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:30.158838 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abf5a004-dced-4bd9-94c2-226d285ddaa4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:30.159604 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abf5a004-dced-4bd9-94c2-226d285ddaa4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:30.160062 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abf5a004-dced-4bd9-94c2-226d285ddaa4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:30.208435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cec76f75-445d-4e04-9c7f-c2851d91a4f5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:30.209439 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cec76f75-445d-4e04-9c7f-c2851d91a4f5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:30.216461 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cec76f75-445d-4e04-9c7f-c2851d91a4f5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:30.216946 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cec76f75-445d-4e04-9c7f-c2851d91a4f5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:30.217737 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cec76f75-445d-4e04-9c7f-c2851d91a4f5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:30.218149 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cec76f75-445d-4e04-9c7f-c2851d91a4f5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:30.253707 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cec76f75-445d-4e04-9c7f-c2851d91a4f5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049183 Apr 06 16:52:30.254707 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 867/1717] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:30 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:30.308799 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-abf5a004-dced-4bd9-94c2-226d285ddaa4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:30.316819 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-abf5a004-dced-4bd9-94c2-226d285ddaa4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.172465 Apr 06 16:52:30.317405 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 851/1718] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:30 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:31.265915 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0da76c74-1f88-4c6a-96eb-e4d737da0ab8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:31.266913 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0da76c74-1f88-4c6a-96eb-e4d737da0ab8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:31.274284 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0da76c74-1f88-4c6a-96eb-e4d737da0ab8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:31.274757 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0da76c74-1f88-4c6a-96eb-e4d737da0ab8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:31.275550 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0da76c74-1f88-4c6a-96eb-e4d737da0ab8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:31.275978 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0da76c74-1f88-4c6a-96eb-e4d737da0ab8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:31.307467 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0da76c74-1f88-4c6a-96eb-e4d737da0ab8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045380 Apr 06 16:52:31.307961 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 868/1719] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:31 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:31.338577 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6ef5434e-00d6-4411-92a7-332c79ccc48f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:31.339679 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6ef5434e-00d6-4411-92a7-332c79ccc48f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:31.346277 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ef5434e-00d6-4411-92a7-332c79ccc48f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:31.346727 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ef5434e-00d6-4411-92a7-332c79ccc48f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:31.347509 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ef5434e-00d6-4411-92a7-332c79ccc48f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:31.347985 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ef5434e-00d6-4411-92a7-332c79ccc48f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:31.527833 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6ef5434e-00d6-4411-92a7-332c79ccc48f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:31.536101 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6ef5434e-00d6-4411-92a7-332c79ccc48f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.202295 Apr 06 16:52:31.536650 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 852/1720] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:31 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:32.320459 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8f53b16d-9d6c-49fa-be21-999d8177f33b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:32.321379 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8f53b16d-9d6c-49fa-be21-999d8177f33b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:32.328350 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f53b16d-9d6c-49fa-be21-999d8177f33b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:32.328836 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f53b16d-9d6c-49fa-be21-999d8177f33b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:32.329624 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f53b16d-9d6c-49fa-be21-999d8177f33b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:32.330040 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f53b16d-9d6c-49fa-be21-999d8177f33b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:32.362695 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8f53b16d-9d6c-49fa-be21-999d8177f33b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046926 Apr 06 16:52:32.363262 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 869/1721] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:32 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:32.556527 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-19b5041b-affd-4f3a-be72-8154f7b5b97d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:32.557192 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-19b5041b-affd-4f3a-be72-8154f7b5b97d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:32.564166 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19b5041b-affd-4f3a-be72-8154f7b5b97d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:32.564672 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19b5041b-affd-4f3a-be72-8154f7b5b97d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:32.565852 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19b5041b-affd-4f3a-be72-8154f7b5b97d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:32.566572 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19b5041b-affd-4f3a-be72-8154f7b5b97d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:32.728951 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-19b5041b-affd-4f3a-be72-8154f7b5b97d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:32.738057 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-19b5041b-affd-4f3a-be72-8154f7b5b97d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.186435 Apr 06 16:52:32.738663 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 853/1722] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:32 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:33.379008 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-affb91b1-1fac-4bf2-860a-eed2248616f1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:33.380570 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-affb91b1-1fac-4bf2-860a-eed2248616f1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:33.391817 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-affb91b1-1fac-4bf2-860a-eed2248616f1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:33.392583 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-affb91b1-1fac-4bf2-860a-eed2248616f1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:33.393926 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-affb91b1-1fac-4bf2-860a-eed2248616f1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:33.394573 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-affb91b1-1fac-4bf2-860a-eed2248616f1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:33.445181 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-affb91b1-1fac-4bf2-860a-eed2248616f1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073026 Apr 06 16:52:33.446482 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 870/1723] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:33 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:33.756302 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e511ea2d-cf5a-4e41-b366-295576e78d95 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:33.757189 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e511ea2d-cf5a-4e41-b366-295576e78d95 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:33.764826 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e511ea2d-cf5a-4e41-b366-295576e78d95 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:33.765331 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e511ea2d-cf5a-4e41-b366-295576e78d95 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:33.766196 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e511ea2d-cf5a-4e41-b366-295576e78d95 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:33.766686 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e511ea2d-cf5a-4e41-b366-295576e78d95 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:33.908618 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e511ea2d-cf5a-4e41-b366-295576e78d95 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:33.917372 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e511ea2d-cf5a-4e41-b366-295576e78d95 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.165479 Apr 06 16:52:33.917943 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 854/1724] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:33 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:34.460127 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-869833a6-4f95-4676-9163-636d0b717708 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:34.461159 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-869833a6-4f95-4676-9163-636d0b717708 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:34.468001 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-869833a6-4f95-4676-9163-636d0b717708 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:34.468450 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-869833a6-4f95-4676-9163-636d0b717708 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:34.469261 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-869833a6-4f95-4676-9163-636d0b717708 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:34.469696 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-869833a6-4f95-4676-9163-636d0b717708 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:34.499649 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-869833a6-4f95-4676-9163-636d0b717708 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043685 Apr 06 16:52:34.500223 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 871/1725] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:34 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:34.935167 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eab23c35-1ed0-4447-9cb4-73e0bed038f4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:34.935820 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eab23c35-1ed0-4447-9cb4-73e0bed038f4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:34.942542 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eab23c35-1ed0-4447-9cb4-73e0bed038f4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:34.942920 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eab23c35-1ed0-4447-9cb4-73e0bed038f4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:34.943732 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eab23c35-1ed0-4447-9cb4-73e0bed038f4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:34.944203 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eab23c35-1ed0-4447-9cb4-73e0bed038f4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:35.091386 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-eab23c35-1ed0-4447-9cb4-73e0bed038f4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:35.099876 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eab23c35-1ed0-4447-9cb4-73e0bed038f4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.168719 Apr 06 16:52:35.100486 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 855/1726] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:34 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:35.512289 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-65ebf9d3-46d4-442b-ad4b-ccbdc3856444 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:35.513226 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-65ebf9d3-46d4-442b-ad4b-ccbdc3856444 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:35.519975 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65ebf9d3-46d4-442b-ad4b-ccbdc3856444 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:35.520434 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65ebf9d3-46d4-442b-ad4b-ccbdc3856444 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:35.521249 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65ebf9d3-46d4-442b-ad4b-ccbdc3856444 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:35.521687 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65ebf9d3-46d4-442b-ad4b-ccbdc3856444 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:35.551930 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-65ebf9d3-46d4-442b-ad4b-ccbdc3856444 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043878 Apr 06 16:52:35.552495 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 872/1727] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:35 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:36.121171 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0b3d4ab2-5bc0-4a53-853d-61ae53e2c5f5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:36.121898 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0b3d4ab2-5bc0-4a53-853d-61ae53e2c5f5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:36.129253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b3d4ab2-5bc0-4a53-853d-61ae53e2c5f5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:36.129913 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b3d4ab2-5bc0-4a53-853d-61ae53e2c5f5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:36.130827 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b3d4ab2-5bc0-4a53-853d-61ae53e2c5f5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:36.131407 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b3d4ab2-5bc0-4a53-853d-61ae53e2c5f5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:36.276231 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0b3d4ab2-5bc0-4a53-853d-61ae53e2c5f5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:36.284194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0b3d4ab2-5bc0-4a53-853d-61ae53e2c5f5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.167075 Apr 06 16:52:36.284792 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 856/1728] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:36 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:36.564123 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c9f99d53-3b69-448f-be06-c9df09b4f07e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:36.564983 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c9f99d53-3b69-448f-be06-c9df09b4f07e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:36.572071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9f99d53-3b69-448f-be06-c9df09b4f07e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:36.572518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9f99d53-3b69-448f-be06-c9df09b4f07e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:36.573330 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9f99d53-3b69-448f-be06-c9df09b4f07e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:36.573760 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9f99d53-3b69-448f-be06-c9df09b4f07e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:36.605332 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c9f99d53-3b69-448f-be06-c9df09b4f07e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045299 Apr 06 16:52:36.606107 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 873/1729] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:36 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:37.302056 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0aee5f5c-921c-440e-b658-d413ed0008f3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:37.302682 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0aee5f5c-921c-440e-b658-d413ed0008f3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:37.309771 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0aee5f5c-921c-440e-b658-d413ed0008f3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:37.310223 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0aee5f5c-921c-440e-b658-d413ed0008f3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:37.311012 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0aee5f5c-921c-440e-b658-d413ed0008f3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:37.311446 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0aee5f5c-921c-440e-b658-d413ed0008f3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:37.455539 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0aee5f5c-921c-440e-b658-d413ed0008f3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:37.463834 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0aee5f5c-921c-440e-b658-d413ed0008f3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.165724 Apr 06 16:52:37.464379 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 857/1730] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:37 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:37.617812 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-55d3c6ca-31d6-4bc5-b00f-c1f343180710 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:37.618865 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-55d3c6ca-31d6-4bc5-b00f-c1f343180710 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:37.625651 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55d3c6ca-31d6-4bc5-b00f-c1f343180710 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:37.626102 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55d3c6ca-31d6-4bc5-b00f-c1f343180710 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:37.626872 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55d3c6ca-31d6-4bc5-b00f-c1f343180710 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:37.627311 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55d3c6ca-31d6-4bc5-b00f-c1f343180710 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:37.656592 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-55d3c6ca-31d6-4bc5-b00f-c1f343180710 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042986 Apr 06 16:52:37.657203 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 874/1731] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:37 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:38.485614 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a8dbcdf8-dbe7-40e9-b0a6-3882f0fda63d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:38.486203 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a8dbcdf8-dbe7-40e9-b0a6-3882f0fda63d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:38.493500 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8dbcdf8-dbe7-40e9-b0a6-3882f0fda63d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:38.493951 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8dbcdf8-dbe7-40e9-b0a6-3882f0fda63d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:38.494734 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8dbcdf8-dbe7-40e9-b0a6-3882f0fda63d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:38.495170 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8dbcdf8-dbe7-40e9-b0a6-3882f0fda63d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:38.635513 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a8dbcdf8-dbe7-40e9-b0a6-3882f0fda63d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:38.643590 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a8dbcdf8-dbe7-40e9-b0a6-3882f0fda63d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.161947 Apr 06 16:52:38.644166 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 858/1732] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:38 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:38.667910 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-24857746-a160-48fb-b040-074b7abe99bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:38.668913 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-24857746-a160-48fb-b040-074b7abe99bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:38.675666 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24857746-a160-48fb-b040-074b7abe99bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:38.676115 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24857746-a160-48fb-b040-074b7abe99bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:38.676934 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24857746-a160-48fb-b040-074b7abe99bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:38.677375 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24857746-a160-48fb-b040-074b7abe99bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:38.707309 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-24857746-a160-48fb-b040-074b7abe99bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043581 Apr 06 16:52:38.707902 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 875/1733] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:38 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:39.660791 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a770956b-1c88-4df3-af76-91aa672b4312 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:39.661415 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a770956b-1c88-4df3-af76-91aa672b4312 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:39.670566 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a770956b-1c88-4df3-af76-91aa672b4312 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:39.671050 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a770956b-1c88-4df3-af76-91aa672b4312 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:39.671819 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a770956b-1c88-4df3-af76-91aa672b4312 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:39.672243 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a770956b-1c88-4df3-af76-91aa672b4312 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:39.718438 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4c6a8753-beff-47c1-ae20-470445a9382d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:39.719370 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4c6a8753-beff-47c1-ae20-470445a9382d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:39.726135 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c6a8753-beff-47c1-ae20-470445a9382d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:39.727204 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c6a8753-beff-47c1-ae20-470445a9382d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:39.728363 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c6a8753-beff-47c1-ae20-470445a9382d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:39.728834 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c6a8753-beff-47c1-ae20-470445a9382d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:39.758190 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4c6a8753-beff-47c1-ae20-470445a9382d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043713 Apr 06 16:52:39.758773 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 876/1734] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:39 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:39.808090 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a770956b-1c88-4df3-af76-91aa672b4312 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:39.816450 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a770956b-1c88-4df3-af76-91aa672b4312 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.159744 Apr 06 16:52:39.817252 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 859/1735] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:39 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:40.770192 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-920e3913-2b42-4761-a80f-5b53dac329d2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:40.771127 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-920e3913-2b42-4761-a80f-5b53dac329d2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:40.778056 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-920e3913-2b42-4761-a80f-5b53dac329d2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:40.778509 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-920e3913-2b42-4761-a80f-5b53dac329d2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:40.779279 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-920e3913-2b42-4761-a80f-5b53dac329d2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:40.779714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-920e3913-2b42-4761-a80f-5b53dac329d2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:40.810089 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-920e3913-2b42-4761-a80f-5b53dac329d2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043873 Apr 06 16:52:40.810662 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 877/1736] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:40 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:40.833736 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0c382a91-bbcb-40e6-9605-4c1aea826df2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:40.834339 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0c382a91-bbcb-40e6-9605-4c1aea826df2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:40.841194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c382a91-bbcb-40e6-9605-4c1aea826df2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:40.841642 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c382a91-bbcb-40e6-9605-4c1aea826df2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:40.842600 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c382a91-bbcb-40e6-9605-4c1aea826df2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:40.843037 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c382a91-bbcb-40e6-9605-4c1aea826df2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:40.990138 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0c382a91-bbcb-40e6-9605-4c1aea826df2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:40.999756 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0c382a91-bbcb-40e6-9605-4c1aea826df2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.169866 Apr 06 16:52:41.000330 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 860/1737] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:40 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:41.822293 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c5e96330-4437-40e4-921c-aa69c559e427 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:41.823277 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c5e96330-4437-40e4-921c-aa69c559e427 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:41.829990 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5e96330-4437-40e4-921c-aa69c559e427 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:41.830437 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5e96330-4437-40e4-921c-aa69c559e427 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:41.831207 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5e96330-4437-40e4-921c-aa69c559e427 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:41.831635 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5e96330-4437-40e4-921c-aa69c559e427 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:41.861731 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c5e96330-4437-40e4-921c-aa69c559e427 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043872 Apr 06 16:52:41.862294 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 878/1738] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:41 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:42.017830 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c0b18cc2-21cc-4e9f-a4e6-9d73e1a31b6a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:42.018480 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c0b18cc2-21cc-4e9f-a4e6-9d73e1a31b6a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:42.025130 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0b18cc2-21cc-4e9f-a4e6-9d73e1a31b6a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:42.025586 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0b18cc2-21cc-4e9f-a4e6-9d73e1a31b6a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:42.026389 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0b18cc2-21cc-4e9f-a4e6-9d73e1a31b6a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:42.026810 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0b18cc2-21cc-4e9f-a4e6-9d73e1a31b6a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:42.164204 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c0b18cc2-21cc-4e9f-a4e6-9d73e1a31b6a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:42.172318 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c0b18cc2-21cc-4e9f-a4e6-9d73e1a31b6a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.158663 Apr 06 16:52:42.172947 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 861/1739] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:42 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:42.873969 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bd8eecf4-fab3-47f2-91b8-c67529211154 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:42.874888 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bd8eecf4-fab3-47f2-91b8-c67529211154 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:42.881695 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd8eecf4-fab3-47f2-91b8-c67529211154 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:42.882137 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd8eecf4-fab3-47f2-91b8-c67529211154 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:42.882913 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd8eecf4-fab3-47f2-91b8-c67529211154 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:42.883342 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd8eecf4-fab3-47f2-91b8-c67529211154 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:42.912729 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bd8eecf4-fab3-47f2-91b8-c67529211154 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042708 Apr 06 16:52:42.913316 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 879/1740] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:42 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:43.190440 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d45bc444-cac5-4195-a263-a35a775f5f6b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:43.191059 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d45bc444-cac5-4195-a263-a35a775f5f6b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:43.199863 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d45bc444-cac5-4195-a263-a35a775f5f6b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:43.200320 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d45bc444-cac5-4195-a263-a35a775f5f6b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:43.201132 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d45bc444-cac5-4195-a263-a35a775f5f6b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:43.201585 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d45bc444-cac5-4195-a263-a35a775f5f6b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:43.347219 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d45bc444-cac5-4195-a263-a35a775f5f6b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:43.356864 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d45bc444-cac5-4195-a263-a35a775f5f6b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.170492 Apr 06 16:52:43.357439 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 862/1741] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:43 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:43.924936 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b411a0d1-817a-493c-b545-7500d61e218d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:43.925761 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b411a0d1-817a-493c-b545-7500d61e218d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:43.932973 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b411a0d1-817a-493c-b545-7500d61e218d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:43.933426 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b411a0d1-817a-493c-b545-7500d61e218d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:43.934188 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b411a0d1-817a-493c-b545-7500d61e218d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:43.934628 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b411a0d1-817a-493c-b545-7500d61e218d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:43.964770 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b411a0d1-817a-493c-b545-7500d61e218d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043981 Apr 06 16:52:43.965330 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 880/1742] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:43 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:44.374043 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7ecee054-b663-4bc2-9237-6fcb631146a5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:44.374648 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7ecee054-b663-4bc2-9237-6fcb631146a5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:44.381648 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ecee054-b663-4bc2-9237-6fcb631146a5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:44.382104 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ecee054-b663-4bc2-9237-6fcb631146a5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:44.382982 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ecee054-b663-4bc2-9237-6fcb631146a5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:44.383514 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ecee054-b663-4bc2-9237-6fcb631146a5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:44.521628 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7ecee054-b663-4bc2-9237-6fcb631146a5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:44.529887 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7ecee054-b663-4bc2-9237-6fcb631146a5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.159791 Apr 06 16:52:44.530458 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 863/1743] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:44 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:44.976876 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3e23216c-7d65-4224-9bfd-cdfc4fbfc8c0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:44.977901 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3e23216c-7d65-4224-9bfd-cdfc4fbfc8c0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:44.984602 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e23216c-7d65-4224-9bfd-cdfc4fbfc8c0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:44.985096 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e23216c-7d65-4224-9bfd-cdfc4fbfc8c0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:44.985866 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e23216c-7d65-4224-9bfd-cdfc4fbfc8c0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:44.986308 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e23216c-7d65-4224-9bfd-cdfc4fbfc8c0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:45.016050 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3e23216c-7d65-4224-9bfd-cdfc4fbfc8c0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043773 Apr 06 16:52:45.016651 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 881/1744] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:44 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:45.547620 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5c13ed10-76aa-4537-a92e-1d55bf723408 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:45.548250 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5c13ed10-76aa-4537-a92e-1d55bf723408 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:45.555187 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c13ed10-76aa-4537-a92e-1d55bf723408 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:45.555743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c13ed10-76aa-4537-a92e-1d55bf723408 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:45.556543 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c13ed10-76aa-4537-a92e-1d55bf723408 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:45.557016 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c13ed10-76aa-4537-a92e-1d55bf723408 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:45.699213 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5c13ed10-76aa-4537-a92e-1d55bf723408 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:45.707183 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5c13ed10-76aa-4537-a92e-1d55bf723408 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.163592 Apr 06 16:52:45.707741 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 864/1745] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:45 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:46.028479 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1ec85046-0fd5-4b20-b399-1a0e7d242b4e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:46.029349 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1ec85046-0fd5-4b20-b399-1a0e7d242b4e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:46.036238 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ec85046-0fd5-4b20-b399-1a0e7d242b4e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:46.036708 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ec85046-0fd5-4b20-b399-1a0e7d242b4e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:46.037790 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ec85046-0fd5-4b20-b399-1a0e7d242b4e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:46.038450 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ec85046-0fd5-4b20-b399-1a0e7d242b4e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:46.077739 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1ec85046-0fd5-4b20-b399-1a0e7d242b4e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052979 Apr 06 16:52:46.078553 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 882/1746] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:46 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:46.724675 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-df0c324b-1c8e-4b42-adfd-960b89701c6c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:46.725311 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-df0c324b-1c8e-4b42-adfd-960b89701c6c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:46.732487 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df0c324b-1c8e-4b42-adfd-960b89701c6c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:46.732960 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df0c324b-1c8e-4b42-adfd-960b89701c6c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:46.733738 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df0c324b-1c8e-4b42-adfd-960b89701c6c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:46.734170 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df0c324b-1c8e-4b42-adfd-960b89701c6c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:46.882493 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-df0c324b-1c8e-4b42-adfd-960b89701c6c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:46.890972 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-df0c324b-1c8e-4b42-adfd-960b89701c6c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.170185 Apr 06 16:52:46.891554 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 865/1747] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:46 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:47.090348 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a5c24558-af90-4ac1-82c5-10cf6ca6aee6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:47.091182 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a5c24558-af90-4ac1-82c5-10cf6ca6aee6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:47.101396 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5c24558-af90-4ac1-82c5-10cf6ca6aee6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:47.102126 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5c24558-af90-4ac1-82c5-10cf6ca6aee6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:47.103103 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5c24558-af90-4ac1-82c5-10cf6ca6aee6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:47.103535 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5c24558-af90-4ac1-82c5-10cf6ca6aee6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:47.134602 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a5c24558-af90-4ac1-82c5-10cf6ca6aee6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048430 Apr 06 16:52:47.135181 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 883/1748] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:47 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:47.908460 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-181a73f6-33b0-4533-9bc2-cdbae69892cb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:47.909130 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-181a73f6-33b0-4533-9bc2-cdbae69892cb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:47.916080 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-181a73f6-33b0-4533-9bc2-cdbae69892cb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:47.916531 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-181a73f6-33b0-4533-9bc2-cdbae69892cb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:47.917351 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-181a73f6-33b0-4533-9bc2-cdbae69892cb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:47.917786 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-181a73f6-33b0-4533-9bc2-cdbae69892cb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:48.054232 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-181a73f6-33b0-4533-9bc2-cdbae69892cb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:48.062870 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-181a73f6-33b0-4533-9bc2-cdbae69892cb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.158266 Apr 06 16:52:48.063465 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 866/1749] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:47 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:48.146882 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a2687552-4ad8-4cf9-93c6-0d4fd285a60f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:48.147671 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a2687552-4ad8-4cf9-93c6-0d4fd285a60f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:48.156669 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2687552-4ad8-4cf9-93c6-0d4fd285a60f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:48.157140 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2687552-4ad8-4cf9-93c6-0d4fd285a60f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:48.157897 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2687552-4ad8-4cf9-93c6-0d4fd285a60f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:48.158322 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2687552-4ad8-4cf9-93c6-0d4fd285a60f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:48.191895 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a2687552-4ad8-4cf9-93c6-0d4fd285a60f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049019 Apr 06 16:52:48.192396 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 884/1750] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:48 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:49.079789 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fb7bff03-d730-4dad-b09b-57ab151adfca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:49.080433 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fb7bff03-d730-4dad-b09b-57ab151adfca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:49.087688 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb7bff03-d730-4dad-b09b-57ab151adfca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:49.088143 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb7bff03-d730-4dad-b09b-57ab151adfca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:49.088992 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb7bff03-d730-4dad-b09b-57ab151adfca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:49.089438 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb7bff03-d730-4dad-b09b-57ab151adfca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:49.203934 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-537156b4-cddc-4d9f-8bb1-dabc35874cd1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:49.204905 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-537156b4-cddc-4d9f-8bb1-dabc35874cd1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:49.211523 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-537156b4-cddc-4d9f-8bb1-dabc35874cd1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:49.212287 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-537156b4-cddc-4d9f-8bb1-dabc35874cd1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:49.214540 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-537156b4-cddc-4d9f-8bb1-dabc35874cd1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:49.214969 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-537156b4-cddc-4d9f-8bb1-dabc35874cd1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:49.234307 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fb7bff03-d730-4dad-b09b-57ab151adfca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:49.242192 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fb7bff03-d730-4dad-b09b-57ab151adfca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.166437 Apr 06 16:52:49.243065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 867/1751] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:49 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:49.246219 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-537156b4-cddc-4d9f-8bb1-dabc35874cd1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046415 Apr 06 16:52:49.246788 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 885/1752] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:49 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:50.258947 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1745f044-d96d-49b5-af6b-8dacb409e994 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:50.259760 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c089d233-f795-4cdc-a5b6-3f9dc2641fbd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:50.260241 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1745f044-d96d-49b5-af6b-8dacb409e994 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:50.260541 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c089d233-f795-4cdc-a5b6-3f9dc2641fbd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:50.266723 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1745f044-d96d-49b5-af6b-8dacb409e994 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:50.267170 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1745f044-d96d-49b5-af6b-8dacb409e994 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:50.267968 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1745f044-d96d-49b5-af6b-8dacb409e994 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:50.268146 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c089d233-f795-4cdc-a5b6-3f9dc2641fbd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:50.268455 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1745f044-d96d-49b5-af6b-8dacb409e994 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:50.268631 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c089d233-f795-4cdc-a5b6-3f9dc2641fbd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:50.269202 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c089d233-f795-4cdc-a5b6-3f9dc2641fbd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:50.269632 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c089d233-f795-4cdc-a5b6-3f9dc2641fbd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:50.301353 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1745f044-d96d-49b5-af6b-8dacb409e994 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046992 Apr 06 16:52:50.302247 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 868/1753] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:50 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:50.413344 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c089d233-f795-4cdc-a5b6-3f9dc2641fbd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:50.421913 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c089d233-f795-4cdc-a5b6-3f9dc2641fbd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.166235 Apr 06 16:52:50.422495 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 886/1754] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:50 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:51.315560 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-00266e71-4021-469c-9004-801f5de92af5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:51.316368 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-00266e71-4021-469c-9004-801f5de92af5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:51.325522 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00266e71-4021-469c-9004-801f5de92af5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:51.326158 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00266e71-4021-469c-9004-801f5de92af5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:51.327467 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00266e71-4021-469c-9004-801f5de92af5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:51.328134 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00266e71-4021-469c-9004-801f5de92af5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:51.362486 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-00266e71-4021-469c-9004-801f5de92af5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051594 Apr 06 16:52:51.363067 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 869/1755] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:51 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:51.438939 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-60884dae-b20b-4471-aff9-e1756c3ee562 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:51.439512 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-60884dae-b20b-4471-aff9-e1756c3ee562 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:51.446215 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60884dae-b20b-4471-aff9-e1756c3ee562 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:51.448218 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60884dae-b20b-4471-aff9-e1756c3ee562 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:51.448218 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60884dae-b20b-4471-aff9-e1756c3ee562 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:51.448218 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60884dae-b20b-4471-aff9-e1756c3ee562 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:51.606881 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-60884dae-b20b-4471-aff9-e1756c3ee562 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:51.615362 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-60884dae-b20b-4471-aff9-e1756c3ee562 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.180162 Apr 06 16:52:51.616124 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 887/1756] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:51 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:52.376890 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-99798a39-99f4-4956-bd5c-7ed4be7b73e2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:52.377815 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-99798a39-99f4-4956-bd5c-7ed4be7b73e2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:52.384880 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99798a39-99f4-4956-bd5c-7ed4be7b73e2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:52.385327 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99798a39-99f4-4956-bd5c-7ed4be7b73e2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:52.386101 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99798a39-99f4-4956-bd5c-7ed4be7b73e2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:52.386524 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99798a39-99f4-4956-bd5c-7ed4be7b73e2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:52.417284 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-99798a39-99f4-4956-bd5c-7ed4be7b73e2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044758 Apr 06 16:52:52.417921 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 870/1757] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:52 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:52.634221 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7c2e238d-c6f9-44a1-bfc0-0108007df308 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:52.634826 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7c2e238d-c6f9-44a1-bfc0-0108007df308 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:52.641299 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c2e238d-c6f9-44a1-bfc0-0108007df308 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:52.641747 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c2e238d-c6f9-44a1-bfc0-0108007df308 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:52.642518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c2e238d-c6f9-44a1-bfc0-0108007df308 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:52.642951 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c2e238d-c6f9-44a1-bfc0-0108007df308 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:52.791056 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7c2e238d-c6f9-44a1-bfc0-0108007df308 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:52.800521 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7c2e238d-c6f9-44a1-bfc0-0108007df308 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.170684 Apr 06 16:52:52.801323 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 888/1758] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:52 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:53.428743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-89944373-1aac-4be8-b475-8463ebd060a5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:53.429757 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-89944373-1aac-4be8-b475-8463ebd060a5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:53.436614 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89944373-1aac-4be8-b475-8463ebd060a5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:53.437103 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89944373-1aac-4be8-b475-8463ebd060a5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:53.437889 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89944373-1aac-4be8-b475-8463ebd060a5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:53.438322 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89944373-1aac-4be8-b475-8463ebd060a5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:53.469014 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-89944373-1aac-4be8-b475-8463ebd060a5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044374 Apr 06 16:52:53.469580 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 871/1759] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:53 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:53.820114 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-949a0832-0f93-4bb1-93e9-913944af5a38 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:53.821704 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-949a0832-0f93-4bb1-93e9-913944af5a38 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:53.828163 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-949a0832-0f93-4bb1-93e9-913944af5a38 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:53.828605 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-949a0832-0f93-4bb1-93e9-913944af5a38 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:53.829485 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-949a0832-0f93-4bb1-93e9-913944af5a38 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:53.829942 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-949a0832-0f93-4bb1-93e9-913944af5a38 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:53.993931 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-949a0832-0f93-4bb1-93e9-913944af5a38 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:54.003267 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-949a0832-0f93-4bb1-93e9-913944af5a38 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.188197 Apr 06 16:52:54.003963 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 889/1760] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:53 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:54.482331 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-12abb09d-7027-434d-a673-137ccee15ee1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:54.483180 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-12abb09d-7027-434d-a673-137ccee15ee1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:54.489967 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12abb09d-7027-434d-a673-137ccee15ee1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:54.490421 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12abb09d-7027-434d-a673-137ccee15ee1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:54.491201 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12abb09d-7027-434d-a673-137ccee15ee1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:54.491638 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12abb09d-7027-434d-a673-137ccee15ee1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:54.521662 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-12abb09d-7027-434d-a673-137ccee15ee1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043563 Apr 06 16:52:54.522216 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 872/1761] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:54 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:55.021905 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-51c8a316-874b-4022-b728-e546e77ff5b4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:55.022554 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-51c8a316-874b-4022-b728-e546e77ff5b4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:55.031399 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51c8a316-874b-4022-b728-e546e77ff5b4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:55.031859 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51c8a316-874b-4022-b728-e546e77ff5b4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:55.032900 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51c8a316-874b-4022-b728-e546e77ff5b4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:55.033647 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-51c8a316-874b-4022-b728-e546e77ff5b4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:55.182179 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-51c8a316-874b-4022-b728-e546e77ff5b4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:55.190290 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-51c8a316-874b-4022-b728-e546e77ff5b4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.172294 Apr 06 16:52:55.190857 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 890/1762] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:55 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:55.534437 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a2d83d35-9d28-44ff-82c9-15d7151d28c4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:55.535279 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a2d83d35-9d28-44ff-82c9-15d7151d28c4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:55.542034 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2d83d35-9d28-44ff-82c9-15d7151d28c4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:55.542498 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2d83d35-9d28-44ff-82c9-15d7151d28c4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:55.543284 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2d83d35-9d28-44ff-82c9-15d7151d28c4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:55.543717 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2d83d35-9d28-44ff-82c9-15d7151d28c4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:55.577586 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a2d83d35-9d28-44ff-82c9-15d7151d28c4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047347 Apr 06 16:52:55.578161 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 873/1763] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:55 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:56.208119 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-180126a6-a780-4ab5-bef4-35c25d325fbc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:56.208752 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-180126a6-a780-4ab5-bef4-35c25d325fbc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:56.215474 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-180126a6-a780-4ab5-bef4-35c25d325fbc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:56.215917 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-180126a6-a780-4ab5-bef4-35c25d325fbc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:56.216786 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-180126a6-a780-4ab5-bef4-35c25d325fbc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:56.217158 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-180126a6-a780-4ab5-bef4-35c25d325fbc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:56.361767 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-180126a6-a780-4ab5-bef4-35c25d325fbc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:56.370047 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-180126a6-a780-4ab5-bef4-35c25d325fbc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.165959 Apr 06 16:52:56.370632 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 891/1764] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:56 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:56.591030 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-51c55d33-84d8-491c-a970-ec1518aa6ba4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:56.591865 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-51c55d33-84d8-491c-a970-ec1518aa6ba4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:56.598932 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51c55d33-84d8-491c-a970-ec1518aa6ba4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:56.599386 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51c55d33-84d8-491c-a970-ec1518aa6ba4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:56.600162 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51c55d33-84d8-491c-a970-ec1518aa6ba4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:56.600597 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51c55d33-84d8-491c-a970-ec1518aa6ba4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:56.633959 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-51c55d33-84d8-491c-a970-ec1518aa6ba4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047085 Apr 06 16:52:56.634509 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 874/1765] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:56 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:57.391536 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-929cfe35-ac07-4c6c-b134-36bc4933a563 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:57.392352 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-929cfe35-ac07-4c6c-b134-36bc4933a563 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:57.401257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-929cfe35-ac07-4c6c-b134-36bc4933a563 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:57.401865 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-929cfe35-ac07-4c6c-b134-36bc4933a563 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:57.402887 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-929cfe35-ac07-4c6c-b134-36bc4933a563 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:57.403466 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-929cfe35-ac07-4c6c-b134-36bc4933a563 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:57.545309 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-929cfe35-ac07-4c6c-b134-36bc4933a563 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:57.553912 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-929cfe35-ac07-4c6c-b134-36bc4933a563 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.169276 Apr 06 16:52:57.554526 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 892/1766] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:57 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:57.648580 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6f4efab5-2679-470e-ae85-da02344c62ad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:57.649678 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6f4efab5-2679-470e-ae85-da02344c62ad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:57.657844 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f4efab5-2679-470e-ae85-da02344c62ad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:57.658354 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f4efab5-2679-470e-ae85-da02344c62ad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:57.659219 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f4efab5-2679-470e-ae85-da02344c62ad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:57.659702 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f4efab5-2679-470e-ae85-da02344c62ad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:57.690373 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6f4efab5-2679-470e-ae85-da02344c62ad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046252 Apr 06 16:52:57.690919 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 875/1767] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:57 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:58.571660 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d175a747-ea07-4f6e-a292-402491ab2764 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:58.572251 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d175a747-ea07-4f6e-a292-402491ab2764 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:58.579302 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d175a747-ea07-4f6e-a292-402491ab2764 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:58.579742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d175a747-ea07-4f6e-a292-402491ab2764 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:58.580546 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d175a747-ea07-4f6e-a292-402491ab2764 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:58.581125 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d175a747-ea07-4f6e-a292-402491ab2764 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:58.703880 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ac013dd2-5c6b-421e-9fa6-c0289f6108b4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:58.704937 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ac013dd2-5c6b-421e-9fa6-c0289f6108b4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:58.712340 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac013dd2-5c6b-421e-9fa6-c0289f6108b4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:58.712948 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac013dd2-5c6b-421e-9fa6-c0289f6108b4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:58.713744 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac013dd2-5c6b-421e-9fa6-c0289f6108b4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:58.714250 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac013dd2-5c6b-421e-9fa6-c0289f6108b4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:58.742601 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d175a747-ea07-4f6e-a292-402491ab2764 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:58.746196 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ac013dd2-5c6b-421e-9fa6-c0289f6108b4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046344 Apr 06 16:52:58.746832 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 876/1768] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:58 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:52:58.751118 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d175a747-ea07-4f6e-a292-402491ab2764 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.183363 Apr 06 16:52:58.751726 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 893/1769] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:58 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:52:59.758320 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8af59063-3b5e-41a0-94f6-831e1d6ee80c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:59.759284 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8af59063-3b5e-41a0-94f6-831e1d6ee80c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:59.766065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8af59063-3b5e-41a0-94f6-831e1d6ee80c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:59.766413 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8af59063-3b5e-41a0-94f6-831e1d6ee80c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:59.767195 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8af59063-3b5e-41a0-94f6-831e1d6ee80c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:59.767481 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-507c489f-fe9b-4631-a1a7-13647198e036 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:52:59.767961 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8af59063-3b5e-41a0-94f6-831e1d6ee80c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:59.768086 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-507c489f-fe9b-4631-a1a7-13647198e036 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:52:59.776004 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-507c489f-fe9b-4631-a1a7-13647198e036 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:59.776329 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-507c489f-fe9b-4631-a1a7-13647198e036 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:59.777176 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-507c489f-fe9b-4631-a1a7-13647198e036 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:52:59.777596 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-507c489f-fe9b-4631-a1a7-13647198e036 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:52:59.799297 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8af59063-3b5e-41a0-94f6-831e1d6ee80c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045414 Apr 06 16:52:59.799869 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 877/1770] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:52:59 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:52:59.918200 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-507c489f-fe9b-4631-a1a7-13647198e036 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:52:59.926333 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-507c489f-fe9b-4631-a1a7-13647198e036 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.162786 Apr 06 16:52:59.926866 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 894/1771] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:52:59 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:00.813498 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-313a012d-f223-4a13-8714-5fb58765a95c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:00.815127 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-313a012d-f223-4a13-8714-5fb58765a95c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:00.822485 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-313a012d-f223-4a13-8714-5fb58765a95c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:00.822896 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-313a012d-f223-4a13-8714-5fb58765a95c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:00.823659 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-313a012d-f223-4a13-8714-5fb58765a95c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:00.824089 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-313a012d-f223-4a13-8714-5fb58765a95c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:00.858256 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-313a012d-f223-4a13-8714-5fb58765a95c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050094 Apr 06 16:53:00.858850 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 878/1772] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:00 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:00.943458 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dfe9df4c-949c-4fd6-a62f-6bb423790c7b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:00.944039 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dfe9df4c-949c-4fd6-a62f-6bb423790c7b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:00.950869 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfe9df4c-949c-4fd6-a62f-6bb423790c7b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:00.951951 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfe9df4c-949c-4fd6-a62f-6bb423790c7b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:00.952780 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfe9df4c-949c-4fd6-a62f-6bb423790c7b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:00.953194 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dfe9df4c-949c-4fd6-a62f-6bb423790c7b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:01.091558 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-dfe9df4c-949c-4fd6-a62f-6bb423790c7b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:01.099500 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dfe9df4c-949c-4fd6-a62f-6bb423790c7b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.160006 Apr 06 16:53:01.100076 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 895/1773] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:00 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:01.871462 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5d97f36b-63d7-4103-b661-f9c49c462cfb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:01.872398 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5d97f36b-63d7-4103-b661-f9c49c462cfb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:01.879554 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d97f36b-63d7-4103-b661-f9c49c462cfb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:01.879927 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d97f36b-63d7-4103-b661-f9c49c462cfb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:01.880746 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d97f36b-63d7-4103-b661-f9c49c462cfb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:01.881183 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d97f36b-63d7-4103-b661-f9c49c462cfb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:01.918360 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5d97f36b-63d7-4103-b661-f9c49c462cfb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050896 Apr 06 16:53:01.918930 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 879/1774] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:01 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:02.118113 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0cfcde38-a205-4475-a599-700e536d340a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:02.118776 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0cfcde38-a205-4475-a599-700e536d340a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:02.125751 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0cfcde38-a205-4475-a599-700e536d340a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:02.126202 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0cfcde38-a205-4475-a599-700e536d340a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:02.127013 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0cfcde38-a205-4475-a599-700e536d340a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:02.127450 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0cfcde38-a205-4475-a599-700e536d340a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:02.278673 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0cfcde38-a205-4475-a599-700e536d340a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:02.288061 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0cfcde38-a205-4475-a599-700e536d340a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.173870 Apr 06 16:53:02.288984 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 896/1775] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:02 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:02.933999 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3ee68fca-781f-4733-911f-54c248ff1acf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:02.935243 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3ee68fca-781f-4733-911f-54c248ff1acf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:02.946217 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ee68fca-781f-4733-911f-54c248ff1acf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:02.946674 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ee68fca-781f-4733-911f-54c248ff1acf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:02.947462 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ee68fca-781f-4733-911f-54c248ff1acf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:02.947899 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ee68fca-781f-4733-911f-54c248ff1acf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:02.978428 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3ee68fca-781f-4733-911f-54c248ff1acf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051275 Apr 06 16:53:02.979003 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 880/1776] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:02 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:03.310306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f6fff3b1-a6be-4e83-a032-3a076c601ce5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:03.310883 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f6fff3b1-a6be-4e83-a032-3a076c601ce5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:03.318596 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6fff3b1-a6be-4e83-a032-3a076c601ce5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:03.319056 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6fff3b1-a6be-4e83-a032-3a076c601ce5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:03.319873 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6fff3b1-a6be-4e83-a032-3a076c601ce5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:03.320309 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f6fff3b1-a6be-4e83-a032-3a076c601ce5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:03.464022 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f6fff3b1-a6be-4e83-a032-3a076c601ce5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:03.472195 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f6fff3b1-a6be-4e83-a032-3a076c601ce5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.166648 Apr 06 16:53:03.472835 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 897/1777] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:03 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:03.991616 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-98fca17b-8239-4ea1-8a71-ba01508f7922 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:03.992452 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-98fca17b-8239-4ea1-8a71-ba01508f7922 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:03.999424 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98fca17b-8239-4ea1-8a71-ba01508f7922 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:03.999882 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98fca17b-8239-4ea1-8a71-ba01508f7922 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:04.000661 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98fca17b-8239-4ea1-8a71-ba01508f7922 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:04.001127 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98fca17b-8239-4ea1-8a71-ba01508f7922 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:04.030382 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-98fca17b-8239-4ea1-8a71-ba01508f7922 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042930 Apr 06 16:53:04.030951 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 881/1778] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:03 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:04.490445 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4240d714-4245-477c-9a04-fcb8e542e94f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:04.491107 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4240d714-4245-477c-9a04-fcb8e542e94f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:04.498079 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4240d714-4245-477c-9a04-fcb8e542e94f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:04.498533 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4240d714-4245-477c-9a04-fcb8e542e94f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:04.499298 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4240d714-4245-477c-9a04-fcb8e542e94f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:04.499733 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4240d714-4245-477c-9a04-fcb8e542e94f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:04.655079 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4240d714-4245-477c-9a04-fcb8e542e94f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:04.663099 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4240d714-4245-477c-9a04-fcb8e542e94f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.176617 Apr 06 16:53:04.663718 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 898/1779] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:04 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:05.041981 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6def54e3-b6e5-4509-b445-3931f9824c6f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:05.042912 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6def54e3-b6e5-4509-b445-3931f9824c6f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:05.049628 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6def54e3-b6e5-4509-b445-3931f9824c6f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:05.050091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6def54e3-b6e5-4509-b445-3931f9824c6f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:05.050860 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6def54e3-b6e5-4509-b445-3931f9824c6f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:05.051270 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6def54e3-b6e5-4509-b445-3931f9824c6f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:05.079856 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6def54e3-b6e5-4509-b445-3931f9824c6f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042178 Apr 06 16:53:05.080412 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 882/1780] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:05 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:05.680940 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-31d9e99c-ca38-4e93-b6f7-7cf12493f158 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:05.681573 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-31d9e99c-ca38-4e93-b6f7-7cf12493f158 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:05.688343 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31d9e99c-ca38-4e93-b6f7-7cf12493f158 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:05.688830 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31d9e99c-ca38-4e93-b6f7-7cf12493f158 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:05.689594 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31d9e99c-ca38-4e93-b6f7-7cf12493f158 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:05.690023 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31d9e99c-ca38-4e93-b6f7-7cf12493f158 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:05.828993 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-31d9e99c-ca38-4e93-b6f7-7cf12493f158 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:05.838784 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-31d9e99c-ca38-4e93-b6f7-7cf12493f158 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.161803 Apr 06 16:53:05.839381 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 899/1781] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:05 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:06.092153 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-effc5219-a9b5-45f1-8085-f5d2a4edf1eb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:06.093023 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-effc5219-a9b5-45f1-8085-f5d2a4edf1eb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:06.099902 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-effc5219-a9b5-45f1-8085-f5d2a4edf1eb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:06.100733 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-effc5219-a9b5-45f1-8085-f5d2a4edf1eb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:06.101531 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-effc5219-a9b5-45f1-8085-f5d2a4edf1eb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:06.102014 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-effc5219-a9b5-45f1-8085-f5d2a4edf1eb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:06.136091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-effc5219-a9b5-45f1-8085-f5d2a4edf1eb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048060 Apr 06 16:53:06.136773 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 883/1782] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:06 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:06.857425 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-757e661c-63ba-44a0-936c-c5e4813e00c6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:06.858028 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-757e661c-63ba-44a0-936c-c5e4813e00c6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:06.864638 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-757e661c-63ba-44a0-936c-c5e4813e00c6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:06.865124 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-757e661c-63ba-44a0-936c-c5e4813e00c6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:06.865890 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-757e661c-63ba-44a0-936c-c5e4813e00c6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:06.866325 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-757e661c-63ba-44a0-936c-c5e4813e00c6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:07.003121 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-757e661c-63ba-44a0-936c-c5e4813e00c6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:07.011880 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-757e661c-63ba-44a0-936c-c5e4813e00c6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.158462 Apr 06 16:53:07.012456 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 900/1783] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:06 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:07.155702 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ed7ce6ee-e830-42e1-ac3b-988998346a9e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:07.157299 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ed7ce6ee-e830-42e1-ac3b-988998346a9e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:07.166028 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed7ce6ee-e830-42e1-ac3b-988998346a9e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:07.166478 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed7ce6ee-e830-42e1-ac3b-988998346a9e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:07.167302 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed7ce6ee-e830-42e1-ac3b-988998346a9e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:07.167734 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed7ce6ee-e830-42e1-ac3b-988998346a9e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:07.201877 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ed7ce6ee-e830-42e1-ac3b-988998346a9e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053112 Apr 06 16:53:07.202441 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 884/1784] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:07 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:08.030131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a3a7d0ec-b692-426f-ab9f-8442dfa39e46 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:08.030732 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a3a7d0ec-b692-426f-ab9f-8442dfa39e46 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:08.037511 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3a7d0ec-b692-426f-ab9f-8442dfa39e46 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:08.037961 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3a7d0ec-b692-426f-ab9f-8442dfa39e46 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:08.038718 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3a7d0ec-b692-426f-ab9f-8442dfa39e46 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:08.039200 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3a7d0ec-b692-426f-ab9f-8442dfa39e46 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:08.178109 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a3a7d0ec-b692-426f-ab9f-8442dfa39e46 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:08.186393 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a3a7d0ec-b692-426f-ab9f-8442dfa39e46 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.160202 Apr 06 16:53:08.187132 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 901/1785] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:08 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:08.214214 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-16053d1f-f2ff-49e2-b5ec-00b1ddd45e55 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:08.215059 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-16053d1f-f2ff-49e2-b5ec-00b1ddd45e55 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:08.222053 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16053d1f-f2ff-49e2-b5ec-00b1ddd45e55 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:08.222501 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16053d1f-f2ff-49e2-b5ec-00b1ddd45e55 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:08.223318 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16053d1f-f2ff-49e2-b5ec-00b1ddd45e55 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:08.223747 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16053d1f-f2ff-49e2-b5ec-00b1ddd45e55 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:08.254022 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-16053d1f-f2ff-49e2-b5ec-00b1ddd45e55 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044221 Apr 06 16:53:08.254572 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 885/1786] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:08 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:09.204534 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e242299-756b-470f-8b73-bccea161e76a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:09.205136 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1e242299-756b-470f-8b73-bccea161e76a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:09.212143 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e242299-756b-470f-8b73-bccea161e76a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:09.212594 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e242299-756b-470f-8b73-bccea161e76a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:09.213401 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e242299-756b-470f-8b73-bccea161e76a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:09.213835 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e242299-756b-470f-8b73-bccea161e76a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:09.265996 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3c87f5c0-faf5-4b68-a885-cfcafde5457b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:09.266929 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3c87f5c0-faf5-4b68-a885-cfcafde5457b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:09.274163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c87f5c0-faf5-4b68-a885-cfcafde5457b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:09.274817 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c87f5c0-faf5-4b68-a885-cfcafde5457b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:09.275786 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c87f5c0-faf5-4b68-a885-cfcafde5457b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:09.276230 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c87f5c0-faf5-4b68-a885-cfcafde5457b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:09.305472 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3c87f5c0-faf5-4b68-a885-cfcafde5457b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043422 Apr 06 16:53:09.306444 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 886/1787] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:09 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:09.350643 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e242299-756b-470f-8b73-bccea161e76a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:09.358880 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1e242299-756b-470f-8b73-bccea161e76a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.158328 Apr 06 16:53:09.359468 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 902/1788] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:09 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:10.317181 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-94a5d8b6-9baf-4430-b387-2306ac4bb406 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:10.318109 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-94a5d8b6-9baf-4430-b387-2306ac4bb406 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:10.325261 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94a5d8b6-9baf-4430-b387-2306ac4bb406 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:10.325643 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94a5d8b6-9baf-4430-b387-2306ac4bb406 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:10.326422 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94a5d8b6-9baf-4430-b387-2306ac4bb406 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:10.326855 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94a5d8b6-9baf-4430-b387-2306ac4bb406 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:10.357324 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-94a5d8b6-9baf-4430-b387-2306ac4bb406 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044165 Apr 06 16:53:10.357889 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 887/1789] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:10 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:10.376011 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-09a6c6d5-6d1a-457a-b892-b45617845739 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:10.376616 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-09a6c6d5-6d1a-457a-b892-b45617845739 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:10.383497 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09a6c6d5-6d1a-457a-b892-b45617845739 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:10.384048 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09a6c6d5-6d1a-457a-b892-b45617845739 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:10.384699 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09a6c6d5-6d1a-457a-b892-b45617845739 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:10.385141 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09a6c6d5-6d1a-457a-b892-b45617845739 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:10.522339 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-09a6c6d5-6d1a-457a-b892-b45617845739 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:10.530533 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-09a6c6d5-6d1a-457a-b892-b45617845739 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.158428 Apr 06 16:53:10.531104 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 903/1790] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:10 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:11.370197 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-177e4026-7010-4570-a614-bd84fdb77ee8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:11.371149 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-177e4026-7010-4570-a614-bd84fdb77ee8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:11.377704 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-177e4026-7010-4570-a614-bd84fdb77ee8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:11.378080 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-177e4026-7010-4570-a614-bd84fdb77ee8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:11.378846 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-177e4026-7010-4570-a614-bd84fdb77ee8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:11.379268 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-177e4026-7010-4570-a614-bd84fdb77ee8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:11.412120 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-177e4026-7010-4570-a614-bd84fdb77ee8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046246 Apr 06 16:53:11.412711 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 888/1791] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:11 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:11.547930 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-92f7739e-bf72-4742-b9f3-c4c568926c0a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:11.548498 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-92f7739e-bf72-4742-b9f3-c4c568926c0a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:11.554846 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92f7739e-bf72-4742-b9f3-c4c568926c0a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:11.555324 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92f7739e-bf72-4742-b9f3-c4c568926c0a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:11.556087 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92f7739e-bf72-4742-b9f3-c4c568926c0a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:11.556521 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-92f7739e-bf72-4742-b9f3-c4c568926c0a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:11.693334 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-92f7739e-bf72-4742-b9f3-c4c568926c0a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:11.701568 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-92f7739e-bf72-4742-b9f3-c4c568926c0a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.157910 Apr 06 16:53:11.702151 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 904/1792] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:11 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:12.425704 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-77c65e24-0f92-4515-a8ad-e0da25ac6ce7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:12.426640 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-77c65e24-0f92-4515-a8ad-e0da25ac6ce7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:12.433987 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-77c65e24-0f92-4515-a8ad-e0da25ac6ce7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:12.434439 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-77c65e24-0f92-4515-a8ad-e0da25ac6ce7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:12.435200 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-77c65e24-0f92-4515-a8ad-e0da25ac6ce7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:12.435611 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-77c65e24-0f92-4515-a8ad-e0da25ac6ce7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:12.466186 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-77c65e24-0f92-4515-a8ad-e0da25ac6ce7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044426 Apr 06 16:53:12.466657 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 889/1793] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:12 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:12.718930 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-09c5021f-5beb-4612-9eb7-7cca7ed0e311 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:12.719475 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-09c5021f-5beb-4612-9eb7-7cca7ed0e311 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:12.726269 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09c5021f-5beb-4612-9eb7-7cca7ed0e311 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:12.726755 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09c5021f-5beb-4612-9eb7-7cca7ed0e311 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:12.727580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09c5021f-5beb-4612-9eb7-7cca7ed0e311 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:12.728007 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09c5021f-5beb-4612-9eb7-7cca7ed0e311 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:12.881948 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-09c5021f-5beb-4612-9eb7-7cca7ed0e311 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:12.890081 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-09c5021f-5beb-4612-9eb7-7cca7ed0e311 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.175076 Apr 06 16:53:12.890649 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 905/1794] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:12 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:13.478617 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-125ff35a-b4ce-4aab-b1e0-2499ba4f7ae5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:13.479538 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-125ff35a-b4ce-4aab-b1e0-2499ba4f7ae5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:13.486412 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-125ff35a-b4ce-4aab-b1e0-2499ba4f7ae5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:13.486853 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-125ff35a-b4ce-4aab-b1e0-2499ba4f7ae5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:13.487606 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-125ff35a-b4ce-4aab-b1e0-2499ba4f7ae5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:13.488032 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-125ff35a-b4ce-4aab-b1e0-2499ba4f7ae5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:13.519890 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-125ff35a-b4ce-4aab-b1e0-2499ba4f7ae5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045599 Apr 06 16:53:13.520553 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 890/1795] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:13 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:13.908217 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9bde8e50-6637-4224-8b0c-b3c82ac4fc37 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:13.908853 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9bde8e50-6637-4224-8b0c-b3c82ac4fc37 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:13.916146 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9bde8e50-6637-4224-8b0c-b3c82ac4fc37 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:13.916577 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9bde8e50-6637-4224-8b0c-b3c82ac4fc37 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:13.917399 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9bde8e50-6637-4224-8b0c-b3c82ac4fc37 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:13.917862 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9bde8e50-6637-4224-8b0c-b3c82ac4fc37 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:14.053881 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9bde8e50-6637-4224-8b0c-b3c82ac4fc37 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:14.062630 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9bde8e50-6637-4224-8b0c-b3c82ac4fc37 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.158997 Apr 06 16:53:14.063214 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 906/1796] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:13 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:14.531983 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-529cf41d-78b8-438c-9e7b-61f823a4cf58 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:14.532950 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-529cf41d-78b8-438c-9e7b-61f823a4cf58 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:14.539947 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-529cf41d-78b8-438c-9e7b-61f823a4cf58 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:14.540415 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-529cf41d-78b8-438c-9e7b-61f823a4cf58 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:14.541254 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-529cf41d-78b8-438c-9e7b-61f823a4cf58 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:14.541684 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-529cf41d-78b8-438c-9e7b-61f823a4cf58 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:14.578557 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-529cf41d-78b8-438c-9e7b-61f823a4cf58 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050611 Apr 06 16:53:14.579122 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 891/1797] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:14 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:15.080993 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-79988eff-40f1-4cd8-908b-79f2f553c7a7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:15.081642 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-79988eff-40f1-4cd8-908b-79f2f553c7a7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:15.088460 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79988eff-40f1-4cd8-908b-79f2f553c7a7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:15.088943 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79988eff-40f1-4cd8-908b-79f2f553c7a7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:15.089713 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79988eff-40f1-4cd8-908b-79f2f553c7a7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:15.090153 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79988eff-40f1-4cd8-908b-79f2f553c7a7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:15.233909 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-79988eff-40f1-4cd8-908b-79f2f553c7a7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:15.242260 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-79988eff-40f1-4cd8-908b-79f2f553c7a7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.165115 Apr 06 16:53:15.242840 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 907/1798] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:15 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:15.595657 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3cc48079-1904-45af-a019-a9dd06982ece tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:15.596978 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3cc48079-1904-45af-a019-a9dd06982ece tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:15.605584 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cc48079-1904-45af-a019-a9dd06982ece tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:15.606043 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cc48079-1904-45af-a019-a9dd06982ece tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:15.606901 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cc48079-1904-45af-a019-a9dd06982ece tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:15.607338 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cc48079-1904-45af-a019-a9dd06982ece tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:15.636529 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3cc48079-1904-45af-a019-a9dd06982ece tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047266 Apr 06 16:53:15.637121 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 892/1799] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:15 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:16.262577 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c6d879a6-c007-4d6f-8cf7-a87e9f700a60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:16.263295 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c6d879a6-c007-4d6f-8cf7-a87e9f700a60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:16.272012 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6d879a6-c007-4d6f-8cf7-a87e9f700a60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:16.272597 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6d879a6-c007-4d6f-8cf7-a87e9f700a60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:16.273672 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6d879a6-c007-4d6f-8cf7-a87e9f700a60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:16.274245 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6d879a6-c007-4d6f-8cf7-a87e9f700a60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:16.443999 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c6d879a6-c007-4d6f-8cf7-a87e9f700a60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:16.456740 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c6d879a6-c007-4d6f-8cf7-a87e9f700a60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.199675 Apr 06 16:53:16.457603 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 908/1800] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:16 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:16.653202 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9c45c46e-b660-40f9-905a-e2b71288c70d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:16.654651 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9c45c46e-b660-40f9-905a-e2b71288c70d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:16.665323 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c45c46e-b660-40f9-905a-e2b71288c70d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:16.666055 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c45c46e-b660-40f9-905a-e2b71288c70d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:16.667321 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c45c46e-b660-40f9-905a-e2b71288c70d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:16.668021 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c45c46e-b660-40f9-905a-e2b71288c70d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:16.703108 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9c45c46e-b660-40f9-905a-e2b71288c70d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056772 Apr 06 16:53:16.703682 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 893/1801] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:16 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:17.480732 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cc2b01f0-e013-486a-a759-8b1e4b407311 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:17.481723 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cc2b01f0-e013-486a-a759-8b1e4b407311 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:17.493888 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc2b01f0-e013-486a-a759-8b1e4b407311 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:17.494466 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc2b01f0-e013-486a-a759-8b1e4b407311 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:17.495338 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc2b01f0-e013-486a-a759-8b1e4b407311 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:17.495782 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc2b01f0-e013-486a-a759-8b1e4b407311 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:17.642825 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-cc2b01f0-e013-486a-a759-8b1e4b407311 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:17.651840 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cc2b01f0-e013-486a-a759-8b1e4b407311 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.178580 Apr 06 16:53:17.652420 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 909/1802] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:17 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:17.719320 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-508bbce9-3595-42b7-b5ac-3faa33621464 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:17.720839 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-508bbce9-3595-42b7-b5ac-3faa33621464 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:17.729983 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-508bbce9-3595-42b7-b5ac-3faa33621464 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:17.730431 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-508bbce9-3595-42b7-b5ac-3faa33621464 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:17.731205 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-508bbce9-3595-42b7-b5ac-3faa33621464 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:17.731639 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-508bbce9-3595-42b7-b5ac-3faa33621464 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:17.761297 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-508bbce9-3595-42b7-b5ac-3faa33621464 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048829 Apr 06 16:53:17.761860 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 894/1803] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:17 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:18.669514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e9028ce4-3d17-4662-b37e-01633d93f166 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:18.670133 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e9028ce4-3d17-4662-b37e-01633d93f166 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:18.676941 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9028ce4-3d17-4662-b37e-01633d93f166 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:18.677392 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9028ce4-3d17-4662-b37e-01633d93f166 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:18.678166 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9028ce4-3d17-4662-b37e-01633d93f166 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:18.678601 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9028ce4-3d17-4662-b37e-01633d93f166 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:18.774269 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-76884772-6bf6-4e02-a71b-37ca7dd27d42 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:18.775245 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-76884772-6bf6-4e02-a71b-37ca7dd27d42 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:18.781993 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76884772-6bf6-4e02-a71b-37ca7dd27d42 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:18.782832 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76884772-6bf6-4e02-a71b-37ca7dd27d42 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:18.783628 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76884772-6bf6-4e02-a71b-37ca7dd27d42 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:18.784088 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76884772-6bf6-4e02-a71b-37ca7dd27d42 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:18.816952 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-76884772-6bf6-4e02-a71b-37ca7dd27d42 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047619 Apr 06 16:53:18.817601 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 895/1804] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:18 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:18.839354 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e9028ce4-3d17-4662-b37e-01633d93f166 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:18.847934 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e9028ce4-3d17-4662-b37e-01633d93f166 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.182047 Apr 06 16:53:18.848580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 910/1805] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:18 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:19.829509 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-49b11ff7-35f3-4bb6-8adb-db69c0582dad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:19.830432 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-49b11ff7-35f3-4bb6-8adb-db69c0582dad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:19.837483 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49b11ff7-35f3-4bb6-8adb-db69c0582dad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:19.837935 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49b11ff7-35f3-4bb6-8adb-db69c0582dad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:19.838703 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49b11ff7-35f3-4bb6-8adb-db69c0582dad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:19.839137 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49b11ff7-35f3-4bb6-8adb-db69c0582dad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:19.865726 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-19af2fb5-7a0a-4547-8e70-7726af2dd659 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:19.866350 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-19af2fb5-7a0a-4547-8e70-7726af2dd659 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:19.872068 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-49b11ff7-35f3-4bb6-8adb-db69c0582dad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046586 Apr 06 16:53:19.872898 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 896/1806] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:19 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:19.873658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19af2fb5-7a0a-4547-8e70-7726af2dd659 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:19.874098 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19af2fb5-7a0a-4547-8e70-7726af2dd659 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:19.874796 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19af2fb5-7a0a-4547-8e70-7726af2dd659 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:19.875239 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19af2fb5-7a0a-4547-8e70-7726af2dd659 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:20.012460 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-19af2fb5-7a0a-4547-8e70-7726af2dd659 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:20.020403 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-19af2fb5-7a0a-4547-8e70-7726af2dd659 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.158548 Apr 06 16:53:20.021028 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 911/1807] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:19 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:20.885242 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-db2557f9-2715-473d-967c-ac5178222145 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:20.886223 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-db2557f9-2715-473d-967c-ac5178222145 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:20.893320 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db2557f9-2715-473d-967c-ac5178222145 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:20.893777 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db2557f9-2715-473d-967c-ac5178222145 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:20.894557 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db2557f9-2715-473d-967c-ac5178222145 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:20.894998 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db2557f9-2715-473d-967c-ac5178222145 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:20.927095 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-db2557f9-2715-473d-967c-ac5178222145 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046563 Apr 06 16:53:20.927919 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 897/1808] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:20 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:21.037868 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d7dc1fd6-29fc-413a-863a-08ebb1f2aced tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:21.038454 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d7dc1fd6-29fc-413a-863a-08ebb1f2aced tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:21.045802 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7dc1fd6-29fc-413a-863a-08ebb1f2aced tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:21.046257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7dc1fd6-29fc-413a-863a-08ebb1f2aced tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:21.047033 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7dc1fd6-29fc-413a-863a-08ebb1f2aced tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:21.047474 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d7dc1fd6-29fc-413a-863a-08ebb1f2aced tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:21.198202 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d7dc1fd6-29fc-413a-863a-08ebb1f2aced tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:21.206869 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d7dc1fd6-29fc-413a-863a-08ebb1f2aced tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.172881 Apr 06 16:53:21.207439 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 912/1809] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:21 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:21.943989 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8adf708c-9ae4-4955-bf62-3335a2a25c28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:21.945989 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8adf708c-9ae4-4955-bf62-3335a2a25c28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:21.956773 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8adf708c-9ae4-4955-bf62-3335a2a25c28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:21.957532 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8adf708c-9ae4-4955-bf62-3335a2a25c28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:21.958813 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8adf708c-9ae4-4955-bf62-3335a2a25c28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:21.959533 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8adf708c-9ae4-4955-bf62-3335a2a25c28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:21.989914 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8adf708c-9ae4-4955-bf62-3335a2a25c28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052776 Apr 06 16:53:21.990480 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 898/1810] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:21 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:22.228226 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e5f572cd-4e98-4d4e-a901-5f23d17858a3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:22.228838 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e5f572cd-4e98-4d4e-a901-5f23d17858a3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:22.235592 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5f572cd-4e98-4d4e-a901-5f23d17858a3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:22.236041 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5f572cd-4e98-4d4e-a901-5f23d17858a3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:22.236855 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5f572cd-4e98-4d4e-a901-5f23d17858a3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:22.237294 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e5f572cd-4e98-4d4e-a901-5f23d17858a3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:22.393702 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e5f572cd-4e98-4d4e-a901-5f23d17858a3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:22.402302 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e5f572cd-4e98-4d4e-a901-5f23d17858a3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.180044 Apr 06 16:53:22.402858 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 913/1811] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:22 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:23.006147 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4bdc3eca-305a-416b-8ed3-6181b95ebdc3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:23.007577 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4bdc3eca-305a-416b-8ed3-6181b95ebdc3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:23.014363 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bdc3eca-305a-416b-8ed3-6181b95ebdc3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:23.014819 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bdc3eca-305a-416b-8ed3-6181b95ebdc3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:23.015590 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bdc3eca-305a-416b-8ed3-6181b95ebdc3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:23.016026 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bdc3eca-305a-416b-8ed3-6181b95ebdc3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:23.046127 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4bdc3eca-305a-416b-8ed3-6181b95ebdc3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046899 Apr 06 16:53:23.046696 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 899/1812] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:22 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:23.423231 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-23b50fbd-9af8-4f3f-b9fe-2dd475657322 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:23.424374 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-23b50fbd-9af8-4f3f-b9fe-2dd475657322 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:23.432984 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23b50fbd-9af8-4f3f-b9fe-2dd475657322 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:23.433431 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23b50fbd-9af8-4f3f-b9fe-2dd475657322 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:23.434205 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23b50fbd-9af8-4f3f-b9fe-2dd475657322 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:23.434637 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23b50fbd-9af8-4f3f-b9fe-2dd475657322 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:23.574643 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-23b50fbd-9af8-4f3f-b9fe-2dd475657322 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:23.587280 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-23b50fbd-9af8-4f3f-b9fe-2dd475657322 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.170265 Apr 06 16:53:23.588010 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 914/1813] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:23 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:24.057762 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a8e27df8-0071-4e03-804c-239923d5dfd1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:24.058691 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a8e27df8-0071-4e03-804c-239923d5dfd1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:24.065418 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8e27df8-0071-4e03-804c-239923d5dfd1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:24.065883 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8e27df8-0071-4e03-804c-239923d5dfd1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:24.066655 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8e27df8-0071-4e03-804c-239923d5dfd1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:24.067086 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8e27df8-0071-4e03-804c-239923d5dfd1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:24.098316 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a8e27df8-0071-4e03-804c-239923d5dfd1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044710 Apr 06 16:53:24.098899 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 900/1814] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:24 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:24.610800 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-de19bad3-76da-434f-b2f9-a9f79e420f63 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:24.611408 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-de19bad3-76da-434f-b2f9-a9f79e420f63 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:24.618989 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de19bad3-76da-434f-b2f9-a9f79e420f63 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:24.619428 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de19bad3-76da-434f-b2f9-a9f79e420f63 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:24.620223 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de19bad3-76da-434f-b2f9-a9f79e420f63 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:24.620659 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de19bad3-76da-434f-b2f9-a9f79e420f63 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:24.759597 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-de19bad3-76da-434f-b2f9-a9f79e420f63 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:24.767572 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-de19bad3-76da-434f-b2f9-a9f79e420f63 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.160813 Apr 06 16:53:24.768146 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 915/1815] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:24 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:25.111284 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b1026a7a-8696-42b3-ad17-46d8d2d5804e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:25.112155 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b1026a7a-8696-42b3-ad17-46d8d2d5804e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:25.119468 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1026a7a-8696-42b3-ad17-46d8d2d5804e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:25.119923 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1026a7a-8696-42b3-ad17-46d8d2d5804e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:25.120708 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1026a7a-8696-42b3-ad17-46d8d2d5804e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:25.121184 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1026a7a-8696-42b3-ad17-46d8d2d5804e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:25.156952 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b1026a7a-8696-42b3-ad17-46d8d2d5804e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049672 Apr 06 16:53:25.157537 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 901/1816] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:25 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:25.785489 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7e586fb8-1668-433b-8457-6373398865ce tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:25.786073 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7e586fb8-1668-433b-8457-6373398865ce tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:25.792984 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e586fb8-1668-433b-8457-6373398865ce tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:25.793433 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e586fb8-1668-433b-8457-6373398865ce tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:25.794208 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e586fb8-1668-433b-8457-6373398865ce tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:25.794642 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e586fb8-1668-433b-8457-6373398865ce tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:25.934073 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7e586fb8-1668-433b-8457-6373398865ce tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:25.942466 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7e586fb8-1668-433b-8457-6373398865ce tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.161047 Apr 06 16:53:25.943049 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 916/1817] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:25 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:26.169047 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-71df3d50-0928-4e9a-9764-760d89d59312 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:26.169985 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-71df3d50-0928-4e9a-9764-760d89d59312 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:26.176727 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71df3d50-0928-4e9a-9764-760d89d59312 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:26.177202 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71df3d50-0928-4e9a-9764-760d89d59312 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:26.177975 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71df3d50-0928-4e9a-9764-760d89d59312 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:26.178407 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71df3d50-0928-4e9a-9764-760d89d59312 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:26.209508 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-71df3d50-0928-4e9a-9764-760d89d59312 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044549 Apr 06 16:53:26.210080 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 902/1818] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:26 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:26.959721 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c625247-dc31-4922-8849-17dd8525b19d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:26.960390 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2c625247-dc31-4922-8849-17dd8525b19d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:26.967114 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c625247-dc31-4922-8849-17dd8525b19d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:26.967567 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c625247-dc31-4922-8849-17dd8525b19d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:26.968337 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c625247-dc31-4922-8849-17dd8525b19d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:26.968801 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c625247-dc31-4922-8849-17dd8525b19d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:27.106917 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2c625247-dc31-4922-8849-17dd8525b19d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:27.114731 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2c625247-dc31-4922-8849-17dd8525b19d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.158995 Apr 06 16:53:27.115321 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 917/1819] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:26 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:27.221690 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c8462b73-3bc6-4ce5-a267-6a5505d2589d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:27.222535 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c8462b73-3bc6-4ce5-a267-6a5505d2589d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:27.230115 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8462b73-3bc6-4ce5-a267-6a5505d2589d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:27.230571 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8462b73-3bc6-4ce5-a267-6a5505d2589d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:27.231345 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8462b73-3bc6-4ce5-a267-6a5505d2589d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:27.231783 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8462b73-3bc6-4ce5-a267-6a5505d2589d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:27.264889 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c8462b73-3bc6-4ce5-a267-6a5505d2589d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046897 Apr 06 16:53:27.266042 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 903/1820] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:27 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:28.131166 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-78845098-77a3-430a-b6bc-6952d2e3838e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:28.131805 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-78845098-77a3-430a-b6bc-6952d2e3838e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:28.138728 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78845098-77a3-430a-b6bc-6952d2e3838e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:28.139176 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78845098-77a3-430a-b6bc-6952d2e3838e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:28.139962 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78845098-77a3-430a-b6bc-6952d2e3838e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:28.140392 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78845098-77a3-430a-b6bc-6952d2e3838e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:28.276333 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-78845098-77a3-430a-b6bc-6952d2e3838e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:28.276537 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b65f2f9b-4427-4d01-8f0e-0d857a6112e9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:28.277506 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b65f2f9b-4427-4d01-8f0e-0d857a6112e9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:28.284108 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b65f2f9b-4427-4d01-8f0e-0d857a6112e9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:28.284550 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b65f2f9b-4427-4d01-8f0e-0d857a6112e9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:28.284901 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-78845098-77a3-430a-b6bc-6952d2e3838e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.157487 Apr 06 16:53:28.285353 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b65f2f9b-4427-4d01-8f0e-0d857a6112e9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:28.285778 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 918/1821] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:28 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:28.285893 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b65f2f9b-4427-4d01-8f0e-0d857a6112e9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:28.321257 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b65f2f9b-4427-4d01-8f0e-0d857a6112e9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048858 Apr 06 16:53:28.321804 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 904/1822] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:28 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:29.304249 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-95d0ffb5-ad20-4fe8-88f8-ec6cc2a156ed tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:29.305005 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-95d0ffb5-ad20-4fe8-88f8-ec6cc2a156ed tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:29.312916 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95d0ffb5-ad20-4fe8-88f8-ec6cc2a156ed tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:29.313425 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95d0ffb5-ad20-4fe8-88f8-ec6cc2a156ed tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:29.314235 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95d0ffb5-ad20-4fe8-88f8-ec6cc2a156ed tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:29.314713 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95d0ffb5-ad20-4fe8-88f8-ec6cc2a156ed tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:29.333449 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-80b4ea7b-6b73-49bb-9940-c24cc8baa724 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:29.334417 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-80b4ea7b-6b73-49bb-9940-c24cc8baa724 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:29.342743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80b4ea7b-6b73-49bb-9940-c24cc8baa724 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:29.343194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80b4ea7b-6b73-49bb-9940-c24cc8baa724 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:29.343980 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80b4ea7b-6b73-49bb-9940-c24cc8baa724 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:29.344419 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80b4ea7b-6b73-49bb-9940-c24cc8baa724 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:29.376324 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-80b4ea7b-6b73-49bb-9940-c24cc8baa724 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046851 Apr 06 16:53:29.377622 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 905/1823] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:29 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:29.454725 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-95d0ffb5-ad20-4fe8-88f8-ec6cc2a156ed tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:29.463595 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-95d0ffb5-ad20-4fe8-88f8-ec6cc2a156ed tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.163261 Apr 06 16:53:29.464391 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 919/1824] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:29 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:30.389265 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5a71e3cb-110d-4756-b795-616bfdf156d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:30.390196 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5a71e3cb-110d-4756-b795-616bfdf156d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:30.400101 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a71e3cb-110d-4756-b795-616bfdf156d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:30.400553 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a71e3cb-110d-4756-b795-616bfdf156d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:30.401370 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a71e3cb-110d-4756-b795-616bfdf156d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:30.401811 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a71e3cb-110d-4756-b795-616bfdf156d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:30.433813 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5a71e3cb-110d-4756-b795-616bfdf156d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048334 Apr 06 16:53:30.434602 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 906/1825] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:30 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:30.481887 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-974b1475-b9fa-490a-b5ad-b09f7daf6a20 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:30.482477 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-974b1475-b9fa-490a-b5ad-b09f7daf6a20 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:30.489343 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-974b1475-b9fa-490a-b5ad-b09f7daf6a20 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:30.489801 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-974b1475-b9fa-490a-b5ad-b09f7daf6a20 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:30.490584 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-974b1475-b9fa-490a-b5ad-b09f7daf6a20 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:30.491022 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-974b1475-b9fa-490a-b5ad-b09f7daf6a20 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:30.634206 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-974b1475-b9fa-490a-b5ad-b09f7daf6a20 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:30.642448 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-974b1475-b9fa-490a-b5ad-b09f7daf6a20 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.164877 Apr 06 16:53:30.643054 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 920/1826] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:30 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:31.446534 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f8f8fef9-7b6e-4f39-b79f-a1f1fef2fd81 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:31.447481 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f8f8fef9-7b6e-4f39-b79f-a1f1fef2fd81 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:31.454256 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f8f8fef9-7b6e-4f39-b79f-a1f1fef2fd81 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:31.454794 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f8f8fef9-7b6e-4f39-b79f-a1f1fef2fd81 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:31.455755 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f8f8fef9-7b6e-4f39-b79f-a1f1fef2fd81 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:31.456257 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f8f8fef9-7b6e-4f39-b79f-a1f1fef2fd81 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:31.489208 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f8f8fef9-7b6e-4f39-b79f-a1f1fef2fd81 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046777 Apr 06 16:53:31.490051 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 907/1827] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:31 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:31.660797 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-35cadf3f-00c7-4441-bbc4-e0570ea8fe60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:31.661498 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-35cadf3f-00c7-4441-bbc4-e0570ea8fe60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:31.671696 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35cadf3f-00c7-4441-bbc4-e0570ea8fe60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:31.672152 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35cadf3f-00c7-4441-bbc4-e0570ea8fe60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:31.673056 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35cadf3f-00c7-4441-bbc4-e0570ea8fe60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:31.673517 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-35cadf3f-00c7-4441-bbc4-e0570ea8fe60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:31.816549 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-35cadf3f-00c7-4441-bbc4-e0570ea8fe60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:31.826756 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-35cadf3f-00c7-4441-bbc4-e0570ea8fe60 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.170044 Apr 06 16:53:31.827495 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 921/1828] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:31 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:32.502041 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e9f06017-f154-44b4-b539-8749de55e377 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:32.503005 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e9f06017-f154-44b4-b539-8749de55e377 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:32.510350 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9f06017-f154-44b4-b539-8749de55e377 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:32.510810 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9f06017-f154-44b4-b539-8749de55e377 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:32.511596 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9f06017-f154-44b4-b539-8749de55e377 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:32.512010 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9f06017-f154-44b4-b539-8749de55e377 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:32.542584 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e9f06017-f154-44b4-b539-8749de55e377 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044455 Apr 06 16:53:32.543228 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 908/1829] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:32 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:32.846246 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-64f0c9ac-fea8-4649-be47-f8e60832c0c0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:32.846923 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-64f0c9ac-fea8-4649-be47-f8e60832c0c0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:32.853703 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64f0c9ac-fea8-4649-be47-f8e60832c0c0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:32.854144 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64f0c9ac-fea8-4649-be47-f8e60832c0c0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:32.854910 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64f0c9ac-fea8-4649-be47-f8e60832c0c0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:32.855338 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-64f0c9ac-fea8-4649-be47-f8e60832c0c0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:33.008491 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-64f0c9ac-fea8-4649-be47-f8e60832c0c0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:33.016547 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-64f0c9ac-fea8-4649-be47-f8e60832c0c0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.174866 Apr 06 16:53:33.017150 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 922/1830] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:32 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:33.555396 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0874ed6b-e64e-4dff-b139-d01ba640e2da tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:33.556412 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0874ed6b-e64e-4dff-b139-d01ba640e2da tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:33.563439 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0874ed6b-e64e-4dff-b139-d01ba640e2da tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:33.563914 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0874ed6b-e64e-4dff-b139-d01ba640e2da tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:33.564716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0874ed6b-e64e-4dff-b139-d01ba640e2da tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:33.565175 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0874ed6b-e64e-4dff-b139-d01ba640e2da tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:33.608074 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0874ed6b-e64e-4dff-b139-d01ba640e2da tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057047 Apr 06 16:53:33.608718 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 909/1831] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:33 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:34.034774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-22c2f43d-0248-4bdc-ab05-8076aae647b5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:34.035370 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-22c2f43d-0248-4bdc-ab05-8076aae647b5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:34.042482 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22c2f43d-0248-4bdc-ab05-8076aae647b5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:34.042934 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22c2f43d-0248-4bdc-ab05-8076aae647b5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:34.043719 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22c2f43d-0248-4bdc-ab05-8076aae647b5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:34.044158 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22c2f43d-0248-4bdc-ab05-8076aae647b5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:34.200118 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-22c2f43d-0248-4bdc-ab05-8076aae647b5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:34.211835 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-22c2f43d-0248-4bdc-ab05-8076aae647b5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.181045 Apr 06 16:53:34.212473 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 923/1832] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:34 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:34.621502 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-23b3b1bc-6ead-47b8-b6b4-61fb81238095 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:34.622431 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-23b3b1bc-6ead-47b8-b6b4-61fb81238095 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:34.629221 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23b3b1bc-6ead-47b8-b6b4-61fb81238095 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:34.629675 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23b3b1bc-6ead-47b8-b6b4-61fb81238095 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:34.630452 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23b3b1bc-6ead-47b8-b6b4-61fb81238095 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:34.630883 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23b3b1bc-6ead-47b8-b6b4-61fb81238095 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:34.662405 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-23b3b1bc-6ead-47b8-b6b4-61fb81238095 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046062 Apr 06 16:53:34.663002 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 910/1833] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:34 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:35.235605 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ca3c9061-e13f-49ae-854a-62a30ace4fc3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:35.236208 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ca3c9061-e13f-49ae-854a-62a30ace4fc3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:35.243413 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca3c9061-e13f-49ae-854a-62a30ace4fc3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:35.243861 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca3c9061-e13f-49ae-854a-62a30ace4fc3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:35.244637 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca3c9061-e13f-49ae-854a-62a30ace4fc3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:35.245099 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca3c9061-e13f-49ae-854a-62a30ace4fc3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:35.391769 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ca3c9061-e13f-49ae-854a-62a30ace4fc3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:35.400621 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ca3c9061-e13f-49ae-854a-62a30ace4fc3 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.170873 Apr 06 16:53:35.401251 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 924/1834] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:35 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:35.677631 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-59c604b7-de97-4136-9537-8fbd4f5a344c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:35.679051 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-59c604b7-de97-4136-9537-8fbd4f5a344c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:35.686238 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59c604b7-de97-4136-9537-8fbd4f5a344c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:35.686690 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59c604b7-de97-4136-9537-8fbd4f5a344c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:35.687481 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59c604b7-de97-4136-9537-8fbd4f5a344c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:35.687920 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59c604b7-de97-4136-9537-8fbd4f5a344c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:35.730318 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-59c604b7-de97-4136-9537-8fbd4f5a344c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059464 Apr 06 16:53:35.730893 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 911/1835] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:35 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:36.418678 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1ef9f761-4aa1-4e8f-9c8d-4f4fc25c039b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:36.419309 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1ef9f761-4aa1-4e8f-9c8d-4f4fc25c039b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:36.426421 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ef9f761-4aa1-4e8f-9c8d-4f4fc25c039b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:36.426907 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ef9f761-4aa1-4e8f-9c8d-4f4fc25c039b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:36.427699 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ef9f761-4aa1-4e8f-9c8d-4f4fc25c039b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:36.428132 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1ef9f761-4aa1-4e8f-9c8d-4f4fc25c039b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:36.593611 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1ef9f761-4aa1-4e8f-9c8d-4f4fc25c039b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:36.602762 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1ef9f761-4aa1-4e8f-9c8d-4f4fc25c039b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.188172 Apr 06 16:53:36.603347 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 925/1836] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:36 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:36.745235 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-85d66edf-f265-4729-9019-a2e2001d038b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:36.746173 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-85d66edf-f265-4729-9019-a2e2001d038b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:36.753927 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85d66edf-f265-4729-9019-a2e2001d038b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:36.754375 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85d66edf-f265-4729-9019-a2e2001d038b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:36.755194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85d66edf-f265-4729-9019-a2e2001d038b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:36.755630 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85d66edf-f265-4729-9019-a2e2001d038b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:36.790360 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-85d66edf-f265-4729-9019-a2e2001d038b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051514 Apr 06 16:53:36.791011 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 912/1837] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:36 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:37.621178 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-18ee3919-f1ba-4587-897c-0f2d9062b46d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:37.621870 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-18ee3919-f1ba-4587-897c-0f2d9062b46d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:37.628614 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18ee3919-f1ba-4587-897c-0f2d9062b46d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:37.629089 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18ee3919-f1ba-4587-897c-0f2d9062b46d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:37.629894 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18ee3919-f1ba-4587-897c-0f2d9062b46d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:37.630322 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18ee3919-f1ba-4587-897c-0f2d9062b46d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:37.774220 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-18ee3919-f1ba-4587-897c-0f2d9062b46d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:37.782962 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-18ee3919-f1ba-4587-897c-0f2d9062b46d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.165669 Apr 06 16:53:37.783576 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 926/1838] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:37 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:37.802894 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a13f2ace-34b7-4d29-aadb-fce8fb8a4e77 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:37.803811 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a13f2ace-34b7-4d29-aadb-fce8fb8a4e77 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:37.810763 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a13f2ace-34b7-4d29-aadb-fce8fb8a4e77 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:37.811262 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a13f2ace-34b7-4d29-aadb-fce8fb8a4e77 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:37.812035 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a13f2ace-34b7-4d29-aadb-fce8fb8a4e77 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:37.812461 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a13f2ace-34b7-4d29-aadb-fce8fb8a4e77 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:37.842848 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a13f2ace-34b7-4d29-aadb-fce8fb8a4e77 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043964 Apr 06 16:53:37.843438 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 913/1839] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:37 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:38.799966 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f2787522-efad-4f12-91be-dec821a5f536 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:38.800606 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f2787522-efad-4f12-91be-dec821a5f536 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:38.807735 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2787522-efad-4f12-91be-dec821a5f536 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:38.808188 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2787522-efad-4f12-91be-dec821a5f536 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:38.809012 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2787522-efad-4f12-91be-dec821a5f536 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:38.809453 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2787522-efad-4f12-91be-dec821a5f536 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:38.859200 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7f94a34f-4c3a-4161-8370-8c5dc55d796b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:38.860115 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7f94a34f-4c3a-4161-8370-8c5dc55d796b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:38.868128 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f94a34f-4c3a-4161-8370-8c5dc55d796b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:38.869231 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f94a34f-4c3a-4161-8370-8c5dc55d796b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:38.870580 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f94a34f-4c3a-4161-8370-8c5dc55d796b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:38.871174 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f94a34f-4c3a-4161-8370-8c5dc55d796b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:38.905965 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7f94a34f-4c3a-4161-8370-8c5dc55d796b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050937 Apr 06 16:53:38.906823 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 914/1840] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:38 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:38.976169 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f2787522-efad-4f12-91be-dec821a5f536 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:38.984336 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f2787522-efad-4f12-91be-dec821a5f536 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.188243 Apr 06 16:53:38.984967 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 927/1841] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:38 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:39.918003 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d8078f35-7eb3-445a-a195-aced81da70e6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:39.918938 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d8078f35-7eb3-445a-a195-aced81da70e6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:39.925512 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8078f35-7eb3-445a-a195-aced81da70e6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:39.925951 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8078f35-7eb3-445a-a195-aced81da70e6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:39.926725 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8078f35-7eb3-445a-a195-aced81da70e6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:39.927148 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8078f35-7eb3-445a-a195-aced81da70e6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:39.961679 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d8078f35-7eb3-445a-a195-aced81da70e6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047640 Apr 06 16:53:39.962222 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 915/1842] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:39 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:53:40.004008 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-737b2478-4ebe-4b4b-8b36-ab6e221924b1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:40.004574 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-737b2478-4ebe-4b4b-8b36-ab6e221924b1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:40.011920 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-737b2478-4ebe-4b4b-8b36-ab6e221924b1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:40.012362 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-737b2478-4ebe-4b4b-8b36-ab6e221924b1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:40.013179 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-737b2478-4ebe-4b4b-8b36-ab6e221924b1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:40.013608 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-737b2478-4ebe-4b4b-8b36-ab6e221924b1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:40.158573 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-737b2478-4ebe-4b4b-8b36-ab6e221924b1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:40.167067 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-737b2478-4ebe-4b4b-8b36-ab6e221924b1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.167297 Apr 06 16:53:40.167663 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 928/1843] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:39 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:40.973534 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ec7c54b8-fd26-4383-8e68-63e2126f6891 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:40.974849 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ec7c54b8-fd26-4383-8e68-63e2126f6891 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:40.982269 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec7c54b8-fd26-4383-8e68-63e2126f6891 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:40.982474 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec7c54b8-fd26-4383-8e68-63e2126f6891 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:40.983269 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec7c54b8-fd26-4383-8e68-63e2126f6891 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:40.983693 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec7c54b8-fd26-4383-8e68-63e2126f6891 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:41.015381 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ec7c54b8-fd26-4383-8e68-63e2126f6891 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045812 Apr 06 16:53:41.015978 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 916/1844] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:40 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:41.184577 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ae3b1f80-a4a4-4cc4-95ec-7f4cc695a989 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:41.185232 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ae3b1f80-a4a4-4cc4-95ec-7f4cc695a989 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:41.191354 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae3b1f80-a4a4-4cc4-95ec-7f4cc695a989 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:41.191822 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae3b1f80-a4a4-4cc4-95ec-7f4cc695a989 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:41.192580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae3b1f80-a4a4-4cc4-95ec-7f4cc695a989 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:41.193041 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae3b1f80-a4a4-4cc4-95ec-7f4cc695a989 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:41.354098 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ae3b1f80-a4a4-4cc4-95ec-7f4cc695a989 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:41.362817 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ae3b1f80-a4a4-4cc4-95ec-7f4cc695a989 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.183005 Apr 06 16:53:41.363404 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 929/1845] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:41 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:42.029486 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e3715a54-011f-4def-aad0-21b8eba84f5d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:42.030570 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e3715a54-011f-4def-aad0-21b8eba84f5d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:42.038265 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3715a54-011f-4def-aad0-21b8eba84f5d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:42.038720 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3715a54-011f-4def-aad0-21b8eba84f5d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:42.039503 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3715a54-011f-4def-aad0-21b8eba84f5d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:42.039940 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3715a54-011f-4def-aad0-21b8eba84f5d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:42.071371 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e3715a54-011f-4def-aad0-21b8eba84f5d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046899 Apr 06 16:53:42.072041 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 917/1846] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:42 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:42.380922 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-02573248-4937-4cdb-96f8-2f0c1a6be0cd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:42.381514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-02573248-4937-4cdb-96f8-2f0c1a6be0cd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:42.389376 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02573248-4937-4cdb-96f8-2f0c1a6be0cd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:42.389839 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02573248-4937-4cdb-96f8-2f0c1a6be0cd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:42.390674 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02573248-4937-4cdb-96f8-2f0c1a6be0cd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:42.391048 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02573248-4937-4cdb-96f8-2f0c1a6be0cd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:42.563488 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-02573248-4937-4cdb-96f8-2f0c1a6be0cd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:42.571676 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-02573248-4937-4cdb-96f8-2f0c1a6be0cd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.194740 Apr 06 16:53:42.572322 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 930/1847] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:42 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:43.292839 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5b09dce6-c362-4cb9-8949-8d40864b9ac0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:43.293835 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5b09dce6-c362-4cb9-8949-8d40864b9ac0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:43.302838 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b09dce6-c362-4cb9-8949-8d40864b9ac0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:43.303019 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b09dce6-c362-4cb9-8949-8d40864b9ac0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:43.303904 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b09dce6-c362-4cb9-8949-8d40864b9ac0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:43.304493 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b09dce6-c362-4cb9-8949-8d40864b9ac0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:43.339616 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5b09dce6-c362-4cb9-8949-8d40864b9ac0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.259785 Apr 06 16:53:43.340244 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 918/1848] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:43 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:43.590069 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8f523589-2f63-405c-83ad-0629427000e8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:43.590668 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8f523589-2f63-405c-83ad-0629427000e8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:43.597618 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f523589-2f63-405c-83ad-0629427000e8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:43.598063 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f523589-2f63-405c-83ad-0629427000e8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:43.598841 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f523589-2f63-405c-83ad-0629427000e8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:43.599665 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f523589-2f63-405c-83ad-0629427000e8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:43.744587 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8f523589-2f63-405c-83ad-0629427000e8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:43.754540 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8f523589-2f63-405c-83ad-0629427000e8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.168993 Apr 06 16:53:43.755130 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 931/1849] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:43 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:44.023450 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 16:53:44.023709 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 16:53:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 16:53:44.352611 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5a1a9189-b4e8-411c-b325-5373ce1fe07e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:44.353969 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5a1a9189-b4e8-411c-b325-5373ce1fe07e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:44.362410 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a1a9189-b4e8-411c-b325-5373ce1fe07e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:44.362871 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a1a9189-b4e8-411c-b325-5373ce1fe07e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:44.363693 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a1a9189-b4e8-411c-b325-5373ce1fe07e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:44.364114 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a1a9189-b4e8-411c-b325-5373ce1fe07e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:44.397660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5a1a9189-b4e8-411c-b325-5373ce1fe07e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049741 Apr 06 16:53:44.398259 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 919/1850] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:44 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:44.773795 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c56ff91d-edfb-4a2d-9bd9-a2fae7619658 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:44.774421 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c56ff91d-edfb-4a2d-9bd9-a2fae7619658 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:44.781317 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c56ff91d-edfb-4a2d-9bd9-a2fae7619658 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:44.781783 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c56ff91d-edfb-4a2d-9bd9-a2fae7619658 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:44.782723 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c56ff91d-edfb-4a2d-9bd9-a2fae7619658 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:44.783151 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c56ff91d-edfb-4a2d-9bd9-a2fae7619658 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:44.928663 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c56ff91d-edfb-4a2d-9bd9-a2fae7619658 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:44.937484 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c56ff91d-edfb-4a2d-9bd9-a2fae7619658 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.168290 Apr 06 16:53:44.938086 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 932/1851] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:44 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:45.412375 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-51431286-3130-46a1-a6b1-cf88f6accc55 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:45.413345 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-51431286-3130-46a1-a6b1-cf88f6accc55 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:45.420152 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51431286-3130-46a1-a6b1-cf88f6accc55 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:45.420579 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51431286-3130-46a1-a6b1-cf88f6accc55 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:45.422489 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51431286-3130-46a1-a6b1-cf88f6accc55 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:45.422489 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51431286-3130-46a1-a6b1-cf88f6accc55 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:45.456520 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-51431286-3130-46a1-a6b1-cf88f6accc55 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050282 Apr 06 16:53:45.457141 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 920/1852] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:45 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:45.955441 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4fde5842-1725-4478-8883-1491185a94c6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:45.956035 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4fde5842-1725-4478-8883-1491185a94c6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:45.962910 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4fde5842-1725-4478-8883-1491185a94c6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:45.963419 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4fde5842-1725-4478-8883-1491185a94c6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:45.964206 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4fde5842-1725-4478-8883-1491185a94c6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:45.964635 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4fde5842-1725-4478-8883-1491185a94c6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:46.126420 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4fde5842-1725-4478-8883-1491185a94c6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:46.135946 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4fde5842-1725-4478-8883-1491185a94c6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.184438 Apr 06 16:53:46.136561 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 933/1853] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:45 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:46.468919 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4e0c3889-02b1-44d5-b153-00bbd276d66c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:46.470463 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4e0c3889-02b1-44d5-b153-00bbd276d66c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:46.478681 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e0c3889-02b1-44d5-b153-00bbd276d66c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:46.479234 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e0c3889-02b1-44d5-b153-00bbd276d66c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:46.480030 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e0c3889-02b1-44d5-b153-00bbd276d66c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:46.480460 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e0c3889-02b1-44d5-b153-00bbd276d66c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:46.516052 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4e0c3889-02b1-44d5-b153-00bbd276d66c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051145 Apr 06 16:53:46.516632 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 921/1854] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:46 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:47.153434 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-956921f8-4545-4231-ad2c-9e37deb71e0e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:47.153994 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-956921f8-4545-4231-ad2c-9e37deb71e0e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:47.160956 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-956921f8-4545-4231-ad2c-9e37deb71e0e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:47.161431 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-956921f8-4545-4231-ad2c-9e37deb71e0e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:47.162226 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-956921f8-4545-4231-ad2c-9e37deb71e0e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:47.162660 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-956921f8-4545-4231-ad2c-9e37deb71e0e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:47.310530 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-956921f8-4545-4231-ad2c-9e37deb71e0e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:47.318691 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-956921f8-4545-4231-ad2c-9e37deb71e0e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.169199 Apr 06 16:53:47.319230 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 934/1855] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:47 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:47.528676 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cc7309e4-2f41-443b-9de8-30dc59bf035e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:47.529658 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cc7309e4-2f41-443b-9de8-30dc59bf035e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:47.536249 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc7309e4-2f41-443b-9de8-30dc59bf035e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:47.536745 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc7309e4-2f41-443b-9de8-30dc59bf035e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:47.537557 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc7309e4-2f41-443b-9de8-30dc59bf035e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:47.537982 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc7309e4-2f41-443b-9de8-30dc59bf035e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:47.575856 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cc7309e4-2f41-443b-9de8-30dc59bf035e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051579 Apr 06 16:53:47.577000 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 922/1856] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:47 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:48.338603 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f8616e6d-ea11-4b51-9bbd-6219de7cfdb5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:48.339206 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f8616e6d-ea11-4b51-9bbd-6219de7cfdb5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:48.349518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8616e6d-ea11-4b51-9bbd-6219de7cfdb5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:48.350134 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8616e6d-ea11-4b51-9bbd-6219de7cfdb5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:48.351281 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8616e6d-ea11-4b51-9bbd-6219de7cfdb5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:48.351839 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8616e6d-ea11-4b51-9bbd-6219de7cfdb5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:48.493169 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f8616e6d-ea11-4b51-9bbd-6219de7cfdb5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:48.502123 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f8616e6d-ea11-4b51-9bbd-6219de7cfdb5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.169262 Apr 06 16:53:48.502715 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 935/1857] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:48 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:53:48.589765 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fa036ab6-8f8e-4cc6-8f97-e9b303ceefeb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:48.590894 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fa036ab6-8f8e-4cc6-8f97-e9b303ceefeb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:48.597300 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa036ab6-8f8e-4cc6-8f97-e9b303ceefeb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:48.597748 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa036ab6-8f8e-4cc6-8f97-e9b303ceefeb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:48.598499 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa036ab6-8f8e-4cc6-8f97-e9b303ceefeb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:48.599306 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa036ab6-8f8e-4cc6-8f97-e9b303ceefeb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:48.629557 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fa036ab6-8f8e-4cc6-8f97-e9b303ceefeb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044197 Apr 06 16:53:48.630120 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 923/1858] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:48 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:49.520109 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a5354c91-cd28-493b-ae7d-d1e66aa02846 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:49.520832 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a5354c91-cd28-493b-ae7d-d1e66aa02846 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:49.528040 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5354c91-cd28-493b-ae7d-d1e66aa02846 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:49.528483 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5354c91-cd28-493b-ae7d-d1e66aa02846 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:49.529304 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5354c91-cd28-493b-ae7d-d1e66aa02846 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:49.529734 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5354c91-cd28-493b-ae7d-d1e66aa02846 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:49.641497 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-037fac8e-157d-43c4-8a4d-92a16cfe6aee tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:49.642471 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-037fac8e-157d-43c4-8a4d-92a16cfe6aee tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:49.649375 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-037fac8e-157d-43c4-8a4d-92a16cfe6aee tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:49.649867 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-037fac8e-157d-43c4-8a4d-92a16cfe6aee tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:49.650746 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-037fac8e-157d-43c4-8a4d-92a16cfe6aee tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:49.651465 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-037fac8e-157d-43c4-8a4d-92a16cfe6aee tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:49.687765 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a5354c91-cd28-493b-ae7d-d1e66aa02846 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:49.692798 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-037fac8e-157d-43c4-8a4d-92a16cfe6aee tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055203 Apr 06 16:53:49.693484 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 924/1859] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:49 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:49.696312 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a5354c91-cd28-493b-ae7d-d1e66aa02846 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.180135 Apr 06 16:53:49.697045 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 936/1860] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:49 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:50.705630 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-13efc2aa-b7f9-4231-af83-34cf7a9616ad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:50.706565 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-13efc2aa-b7f9-4231-af83-34cf7a9616ad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:50.713997 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13efc2aa-b7f9-4231-af83-34cf7a9616ad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:50.715232 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13efc2aa-b7f9-4231-af83-34cf7a9616ad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:50.715380 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-416eb2fa-61c5-47a3-81da-349181f65a6b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:50.715884 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-416eb2fa-61c5-47a3-81da-349181f65a6b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:50.716859 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13efc2aa-b7f9-4231-af83-34cf7a9616ad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:50.717648 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13efc2aa-b7f9-4231-af83-34cf7a9616ad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:50.722822 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-416eb2fa-61c5-47a3-81da-349181f65a6b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:50.723272 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-416eb2fa-61c5-47a3-81da-349181f65a6b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:50.724426 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-416eb2fa-61c5-47a3-81da-349181f65a6b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:50.724912 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-416eb2fa-61c5-47a3-81da-349181f65a6b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:50.754997 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-13efc2aa-b7f9-4231-af83-34cf7a9616ad tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053327 Apr 06 16:53:50.755584 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 925/1861] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:50 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:50.890013 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-416eb2fa-61c5-47a3-81da-349181f65a6b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:50.902535 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-416eb2fa-61c5-47a3-81da-349181f65a6b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.191750 Apr 06 16:53:50.903112 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 937/1862] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:50 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:53:51.767757 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-55ddec2c-95d4-4e55-b1a4-353dcc996ad3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:51.768714 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-55ddec2c-95d4-4e55-b1a4-353dcc996ad3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:51.775760 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55ddec2c-95d4-4e55-b1a4-353dcc996ad3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:51.776260 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55ddec2c-95d4-4e55-b1a4-353dcc996ad3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:51.777267 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55ddec2c-95d4-4e55-b1a4-353dcc996ad3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:51.778135 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55ddec2c-95d4-4e55-b1a4-353dcc996ad3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:51.810573 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-55ddec2c-95d4-4e55-b1a4-353dcc996ad3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046966 Apr 06 16:53:51.811174 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 926/1863] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:51 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:51.919810 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fe1e2e58-7a67-4081-87a7-8dbcf4a236eb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:51.920475 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fe1e2e58-7a67-4081-87a7-8dbcf4a236eb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:51.927798 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe1e2e58-7a67-4081-87a7-8dbcf4a236eb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:51.928247 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe1e2e58-7a67-4081-87a7-8dbcf4a236eb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:51.929076 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe1e2e58-7a67-4081-87a7-8dbcf4a236eb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:51.929504 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe1e2e58-7a67-4081-87a7-8dbcf4a236eb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:52.072284 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fe1e2e58-7a67-4081-87a7-8dbcf4a236eb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:52.080853 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fe1e2e58-7a67-4081-87a7-8dbcf4a236eb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.164960 Apr 06 16:53:52.081435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 938/1864] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:51 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:52.822355 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e9243cef-50b7-4dd5-80b6-67c3de830ed7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:52.823291 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e9243cef-50b7-4dd5-80b6-67c3de830ed7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:52.830421 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9243cef-50b7-4dd5-80b6-67c3de830ed7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:52.830898 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9243cef-50b7-4dd5-80b6-67c3de830ed7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:52.831678 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9243cef-50b7-4dd5-80b6-67c3de830ed7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:52.832113 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9243cef-50b7-4dd5-80b6-67c3de830ed7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:52.864991 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e9243cef-50b7-4dd5-80b6-67c3de830ed7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046562 Apr 06 16:53:52.868784 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 927/1865] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:52 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:52.925868 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 16:53:52.926498 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 16:53:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 16:53:53.099540 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d791d635-62f5-4a23-91d9-c1858dc4d4ef tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:53.100185 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d791d635-62f5-4a23-91d9-c1858dc4d4ef tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:53.107218 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d791d635-62f5-4a23-91d9-c1858dc4d4ef tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:53.107671 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d791d635-62f5-4a23-91d9-c1858dc4d4ef tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:53.108442 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d791d635-62f5-4a23-91d9-c1858dc4d4ef tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:53.108904 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d791d635-62f5-4a23-91d9-c1858dc4d4ef tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:53.260024 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d791d635-62f5-4a23-91d9-c1858dc4d4ef tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:53.271680 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d791d635-62f5-4a23-91d9-c1858dc4d4ef tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.176394 Apr 06 16:53:53.272338 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 939/1866] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:53 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:53.878622 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2e797e8d-08e8-4954-8d8d-b4387c2a7f9d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:53.879573 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2e797e8d-08e8-4954-8d8d-b4387c2a7f9d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:53.886711 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e797e8d-08e8-4954-8d8d-b4387c2a7f9d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:53.887321 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e797e8d-08e8-4954-8d8d-b4387c2a7f9d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:53.888161 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e797e8d-08e8-4954-8d8d-b4387c2a7f9d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:53.888676 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e797e8d-08e8-4954-8d8d-b4387c2a7f9d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:53.931014 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2e797e8d-08e8-4954-8d8d-b4387c2a7f9d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049955 Apr 06 16:53:53.931014 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 928/1867] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:53 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:54.289635 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eacc81f3-0730-48bf-a66d-8bc6ed4dbaa0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:54.290269 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eacc81f3-0730-48bf-a66d-8bc6ed4dbaa0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:54.298147 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eacc81f3-0730-48bf-a66d-8bc6ed4dbaa0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:54.298621 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eacc81f3-0730-48bf-a66d-8bc6ed4dbaa0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:54.299478 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eacc81f3-0730-48bf-a66d-8bc6ed4dbaa0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:54.299930 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eacc81f3-0730-48bf-a66d-8bc6ed4dbaa0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:54.455903 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-eacc81f3-0730-48bf-a66d-8bc6ed4dbaa0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:54.464861 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eacc81f3-0730-48bf-a66d-8bc6ed4dbaa0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.178722 Apr 06 16:53:54.465595 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 940/1868] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:54 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:54.936086 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c3f43ef8-715d-4107-ae55-08243a8e7a30 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:54.937137 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c3f43ef8-715d-4107-ae55-08243a8e7a30 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:54.944099 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3f43ef8-715d-4107-ae55-08243a8e7a30 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:54.944586 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3f43ef8-715d-4107-ae55-08243a8e7a30 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:54.945433 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3f43ef8-715d-4107-ae55-08243a8e7a30 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:54.945854 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3f43ef8-715d-4107-ae55-08243a8e7a30 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:54.977463 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c3f43ef8-715d-4107-ae55-08243a8e7a30 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045502 Apr 06 16:53:54.978048 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 929/1869] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:54 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:55.488776 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-749d333d-2ed1-4035-91da-774dd53beeaa tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:55.489409 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-749d333d-2ed1-4035-91da-774dd53beeaa tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:55.496347 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-749d333d-2ed1-4035-91da-774dd53beeaa tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:55.496830 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-749d333d-2ed1-4035-91da-774dd53beeaa tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:55.497602 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-749d333d-2ed1-4035-91da-774dd53beeaa tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:55.498058 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-749d333d-2ed1-4035-91da-774dd53beeaa tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:55.658893 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-749d333d-2ed1-4035-91da-774dd53beeaa tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:55.666885 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-749d333d-2ed1-4035-91da-774dd53beeaa tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.183771 Apr 06 16:53:55.667555 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 941/1870] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:55 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:55.990487 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5253eecc-9570-4109-a75f-7335256f63e6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:55.991458 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5253eecc-9570-4109-a75f-7335256f63e6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:55.998751 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5253eecc-9570-4109-a75f-7335256f63e6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:55.999205 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5253eecc-9570-4109-a75f-7335256f63e6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:56.000020 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5253eecc-9570-4109-a75f-7335256f63e6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:56.000458 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5253eecc-9570-4109-a75f-7335256f63e6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:56.030982 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5253eecc-9570-4109-a75f-7335256f63e6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044541 Apr 06 16:53:56.031564 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 930/1871] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:55 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:56.685196 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c976f9ab-120c-4a05-ac4f-d0cc153b5fce tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:56.686110 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c976f9ab-120c-4a05-ac4f-d0cc153b5fce tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:56.696190 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c976f9ab-120c-4a05-ac4f-d0cc153b5fce tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:56.696878 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c976f9ab-120c-4a05-ac4f-d0cc153b5fce tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:56.698082 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c976f9ab-120c-4a05-ac4f-d0cc153b5fce tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:56.699364 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c976f9ab-120c-4a05-ac4f-d0cc153b5fce tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:56.844522 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c976f9ab-120c-4a05-ac4f-d0cc153b5fce tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:56.853487 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c976f9ab-120c-4a05-ac4f-d0cc153b5fce tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.172786 Apr 06 16:53:56.854126 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 942/1872] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:56 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:57.042863 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a5c77c30-dc01-4293-880e-7ca4d19928be tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:57.044006 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a5c77c30-dc01-4293-880e-7ca4d19928be tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:57.051045 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5c77c30-dc01-4293-880e-7ca4d19928be tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:57.051500 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5c77c30-dc01-4293-880e-7ca4d19928be tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:57.052282 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5c77c30-dc01-4293-880e-7ca4d19928be tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:57.052712 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5c77c30-dc01-4293-880e-7ca4d19928be tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:57.088090 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a5c77c30-dc01-4293-880e-7ca4d19928be tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049409 Apr 06 16:53:57.088697 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 931/1873] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:57 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:57.873183 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3fa745b7-d91e-4e0b-becd-3e6c4dfbf257 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:57.873844 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3fa745b7-d91e-4e0b-becd-3e6c4dfbf257 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:57.882648 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fa745b7-d91e-4e0b-becd-3e6c4dfbf257 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:57.883307 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fa745b7-d91e-4e0b-becd-3e6c4dfbf257 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:57.884512 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fa745b7-d91e-4e0b-becd-3e6c4dfbf257 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:57.885129 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fa745b7-d91e-4e0b-becd-3e6c4dfbf257 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:58.040396 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3fa745b7-d91e-4e0b-becd-3e6c4dfbf257 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:58.049359 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3fa745b7-d91e-4e0b-becd-3e6c4dfbf257 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.181577 Apr 06 16:53:58.049950 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 943/1874] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:57 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:53:58.100662 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9bc79746-d4d5-4756-9f00-11158995b850 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:58.101658 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9bc79746-d4d5-4756-9f00-11158995b850 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:58.108721 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bc79746-d4d5-4756-9f00-11158995b850 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:58.109194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bc79746-d4d5-4756-9f00-11158995b850 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:58.110054 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bc79746-d4d5-4756-9f00-11158995b850 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:58.110392 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bc79746-d4d5-4756-9f00-11158995b850 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:58.142488 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9bc79746-d4d5-4756-9f00-11158995b850 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046186 Apr 06 16:53:58.143331 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 932/1875] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:58 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 16:53:59.067040 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-122a3676-fb3d-4d20-bf17-fe5ffb4cff81 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:59.067660 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-122a3676-fb3d-4d20-bf17-fe5ffb4cff81 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:59.074813 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-122a3676-fb3d-4d20-bf17-fe5ffb4cff81 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:59.075271 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-122a3676-fb3d-4d20-bf17-fe5ffb4cff81 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:59.076046 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-122a3676-fb3d-4d20-bf17-fe5ffb4cff81 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:59.076475 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-122a3676-fb3d-4d20-bf17-fe5ffb4cff81 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:59.154854 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-89c50451-704c-430c-ac64-516d647c414a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:53:59.155782 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-89c50451-704c-430c-ac64-516d647c414a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:53:59.162375 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89c50451-704c-430c-ac64-516d647c414a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:59.162834 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89c50451-704c-430c-ac64-516d647c414a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:59.163602 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89c50451-704c-430c-ac64-516d647c414a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:53:59.164029 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89c50451-704c-430c-ac64-516d647c414a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:53:59.198869 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-89c50451-704c-430c-ac64-516d647c414a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048220 Apr 06 16:53:59.199919 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 933/1876] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:53:59 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:53:59.233315 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-122a3676-fb3d-4d20-bf17-fe5ffb4cff81 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:53:59.241579 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-122a3676-fb3d-4d20-bf17-fe5ffb4cff81 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.178545 Apr 06 16:53:59.242149 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 944/1877] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:53:59 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:00.210753 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8d642a5a-857e-4f48-9997-7dfbb5f377a1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:00.211603 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8d642a5a-857e-4f48-9997-7dfbb5f377a1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:00.219651 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d642a5a-857e-4f48-9997-7dfbb5f377a1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:00.220108 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d642a5a-857e-4f48-9997-7dfbb5f377a1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:00.220969 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d642a5a-857e-4f48-9997-7dfbb5f377a1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:00.221407 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d642a5a-857e-4f48-9997-7dfbb5f377a1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:00.253372 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8d642a5a-857e-4f48-9997-7dfbb5f377a1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046630 Apr 06 16:54:00.254117 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 934/1878] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 16:54:00 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:54:00.259460 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9f98db48-cc7d-4d56-9e97-167fbfa53fe1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:00.260057 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9f98db48-cc7d-4d56-9e97-167fbfa53fe1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:00.268223 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f98db48-cc7d-4d56-9e97-167fbfa53fe1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:00.268970 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f98db48-cc7d-4d56-9e97-167fbfa53fe1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:00.270266 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f98db48-cc7d-4d56-9e97-167fbfa53fe1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:00.271029 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f98db48-cc7d-4d56-9e97-167fbfa53fe1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:00.421353 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9f98db48-cc7d-4d56-9e97-167fbfa53fe1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:00.429403 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9f98db48-cc7d-4d56-9e97-167fbfa53fe1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.173891 Apr 06 16:54:00.429984 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 945/1879] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:00 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:01.266554 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-85f11441-a2d4-45e8-87bd-9fae28d08b52 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:54:01.267391 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-85f11441-a2d4-45e8-87bd-9fae28d08b52 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:01.274083 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85f11441-a2d4-45e8-87bd-9fae28d08b52 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:01.274533 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85f11441-a2d4-45e8-87bd-9fae28d08b52 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:01.275317 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85f11441-a2d4-45e8-87bd-9fae28d08b52 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:01.275783 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85f11441-a2d4-45e8-87bd-9fae28d08b52 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:01.386604 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-85f11441-a2d4-45e8-87bd-9fae28d08b52 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "POST /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/action" status: 200 len: 76694 microversion: 2.1 time: 0.123528 Apr 06 16:54:01.387262 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 935/1880] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Apr 6 16:54:01 2022] POST /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96/action => generated 76694 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 16:54:01.447361 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-abe4daaf-d19d-464f-9232-6cf245d2dfca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:01.447971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-abe4daaf-d19d-464f-9232-6cf245d2dfca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:01.455629 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abe4daaf-d19d-464f-9232-6cf245d2dfca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:01.456077 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abe4daaf-d19d-464f-9232-6cf245d2dfca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:01.456908 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abe4daaf-d19d-464f-9232-6cf245d2dfca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:01.457337 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abe4daaf-d19d-464f-9232-6cf245d2dfca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:01.611573 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-abe4daaf-d19d-464f-9232-6cf245d2dfca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:01.619639 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-abe4daaf-d19d-464f-9232-6cf245d2dfca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.176138 Apr 06 16:54:01.620287 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 946/1881] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:01 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:02.638022 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-32d8552a-6ebf-452f-a954-0db11ba79f8f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:02.638762 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-32d8552a-6ebf-452f-a954-0db11ba79f8f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:02.645956 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32d8552a-6ebf-452f-a954-0db11ba79f8f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:02.646403 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32d8552a-6ebf-452f-a954-0db11ba79f8f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:02.647194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32d8552a-6ebf-452f-a954-0db11ba79f8f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:02.647709 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32d8552a-6ebf-452f-a954-0db11ba79f8f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:02.796217 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-32d8552a-6ebf-452f-a954-0db11ba79f8f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:02.805281 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-32d8552a-6ebf-452f-a954-0db11ba79f8f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.171716 Apr 06 16:54:02.805885 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 936/1882] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:02 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:03.149844 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 16:54:03.150446 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 16:54:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 16:54:03.479617 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2d3fb7fe-bc5c-4a33-ac2e-5c5352ecac68 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:03.480261 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2d3fb7fe-bc5c-4a33-ac2e-5c5352ecac68 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:03.487221 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d3fb7fe-bc5c-4a33-ac2e-5c5352ecac68 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:03.487657 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d3fb7fe-bc5c-4a33-ac2e-5c5352ecac68 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:03.488480 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d3fb7fe-bc5c-4a33-ac2e-5c5352ecac68 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:03.488947 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2d3fb7fe-bc5c-4a33-ac2e-5c5352ecac68 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:03.515288 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2d3fb7fe-bc5c-4a33-ac2e-5c5352ecac68 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 06 16:54:03.606537 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2d3fb7fe-bc5c-4a33-ac2e-5c5352ecac68 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 204 len: 0 microversion: 2.1 time: 0.132527 Apr 06 16:54:03.607414 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 947/1883] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 16:54:03 2022] DELETE /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 06 16:54:03.618043 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-31dfb1c4-2a02-45e5-b778-908414ab2c8d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:03.618710 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-31dfb1c4-2a02-45e5-b778-908414ab2c8d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:03.625829 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31dfb1c4-2a02-45e5-b778-908414ab2c8d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:03.626253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31dfb1c4-2a02-45e5-b778-908414ab2c8d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:03.627047 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31dfb1c4-2a02-45e5-b778-908414ab2c8d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:03.627476 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31dfb1c4-2a02-45e5-b778-908414ab2c8d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:03.772017 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-31dfb1c4-2a02-45e5-b778-908414ab2c8d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:03.781163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-31dfb1c4-2a02-45e5-b778-908414ab2c8d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1726 microversion: 2.1 time: 0.167654 Apr 06 16:54:03.781760 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 937/1884] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:03 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:03.824011 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d10f08e7-f6cd-41c9-ac7f-47bb88869772 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:03.824726 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d10f08e7-f6cd-41c9-ac7f-47bb88869772 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:03.831687 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d10f08e7-f6cd-41c9-ac7f-47bb88869772 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:03.832138 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d10f08e7-f6cd-41c9-ac7f-47bb88869772 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:03.832951 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d10f08e7-f6cd-41c9-ac7f-47bb88869772 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:03.833399 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d10f08e7-f6cd-41c9-ac7f-47bb88869772 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:03.985637 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d10f08e7-f6cd-41c9-ac7f-47bb88869772 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:03.998484 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d10f08e7-f6cd-41c9-ac7f-47bb88869772 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.179003 Apr 06 16:54:03.999642 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 948/1885] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:03 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:04.799654 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d3ec4d8e-0219-4e2d-b119-1788a847ce5a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:04.800356 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d3ec4d8e-0219-4e2d-b119-1788a847ce5a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:04.807274 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3ec4d8e-0219-4e2d-b119-1788a847ce5a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:04.807822 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3ec4d8e-0219-4e2d-b119-1788a847ce5a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:04.808998 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3ec4d8e-0219-4e2d-b119-1788a847ce5a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:04.809813 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3ec4d8e-0219-4e2d-b119-1788a847ce5a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:05.016697 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-712cc946-e93a-4a3a-902d-059bf046ba34 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:05.017343 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-712cc946-e93a-4a3a-902d-059bf046ba34 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:05.030543 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-712cc946-e93a-4a3a-902d-059bf046ba34 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:05.031144 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-712cc946-e93a-4a3a-902d-059bf046ba34 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:05.031944 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-712cc946-e93a-4a3a-902d-059bf046ba34 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:05.032611 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-712cc946-e93a-4a3a-902d-059bf046ba34 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:05.064960 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d3ec4d8e-0219-4e2d-b119-1788a847ce5a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:05.074348 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d3ec4d8e-0219-4e2d-b119-1788a847ce5a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1726 microversion: 2.1 time: 0.278487 Apr 06 16:54:05.075394 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 938/1886] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:04 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1726 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:05.190547 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-712cc946-e93a-4a3a-902d-059bf046ba34 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:05.213859 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-712cc946-e93a-4a3a-902d-059bf046ba34 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.200001 Apr 06 16:54:05.215443 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 949/1887] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:05 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:54:05.571146 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-e40cd40f-9ffc-4c38-9a68-aa5fc0f659c5 req-d39bbdd9-21ed-4a67-aa70-2df5181fdcdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b9f9e64-72fd-4e62-bde6-4e44f737c02c", "name": "network-vif-deleted", "tag": "3d9b80f5-284c-42ae-8f89-8ab97694fca5"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:54:05.582997 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e40cd40f-9ffc-4c38-9a68-aa5fc0f659c5 req-d39bbdd9-21ed-4a67-aa70-2df5181fdcdc service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:05.583439 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e40cd40f-9ffc-4c38-9a68-aa5fc0f659c5 req-d39bbdd9-21ed-4a67-aa70-2df5181fdcdc service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:05.603080 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-e40cd40f-9ffc-4c38-9a68-aa5fc0f659c5 req-d39bbdd9-21ed-4a67-aa70-2df5181fdcdc service nova] Creating event network-vif-deleted:3d9b80f5-284c-42ae-8f89-8ab97694fca5 for instance 6b9f9e64-72fd-4e62-bde6-4e44f737c02c on hv-cinder-83684 Apr 06 16:54:05.609702 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-e40cd40f-9ffc-4c38-9a68-aa5fc0f659c5 req-d39bbdd9-21ed-4a67-aa70-2df5181fdcdc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113553 Apr 06 16:54:05.610425 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 939/1888] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:54:06.093270 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b681133c-d0f2-45bb-87cc-621221223674 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:06.093883 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b681133c-d0f2-45bb-87cc-621221223674 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:06.101014 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b681133c-d0f2-45bb-87cc-621221223674 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:06.101433 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b681133c-d0f2-45bb-87cc-621221223674 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:06.102237 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b681133c-d0f2-45bb-87cc-621221223674 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:06.102663 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b681133c-d0f2-45bb-87cc-621221223674 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:06.174853 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b681133c-d0f2-45bb-87cc-621221223674 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:06.183074 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b681133c-d0f2-45bb-87cc-621221223674 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.094241 Apr 06 16:54:06.188990 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 950/1889] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:06 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:06.232274 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-859b264e-8641-4b32-8617-a8236df93eaa tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:06.232982 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-859b264e-8641-4b32-8617-a8236df93eaa tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:06.239635 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-859b264e-8641-4b32-8617-a8236df93eaa tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:06.240043 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-859b264e-8641-4b32-8617-a8236df93eaa tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:06.240891 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-859b264e-8641-4b32-8617-a8236df93eaa tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:06.241326 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-859b264e-8641-4b32-8617-a8236df93eaa tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:06.391828 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-859b264e-8641-4b32-8617-a8236df93eaa tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:06.400715 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-859b264e-8641-4b32-8617-a8236df93eaa tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.172738 Apr 06 16:54:06.401626 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 940/1890] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:06 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:07.206640 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f4dd0094-f746-4bf5-a66e-ea2cabd0e22e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:07.207275 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f4dd0094-f746-4bf5-a66e-ea2cabd0e22e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:07.213812 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4dd0094-f746-4bf5-a66e-ea2cabd0e22e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:07.214244 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4dd0094-f746-4bf5-a66e-ea2cabd0e22e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:07.215026 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4dd0094-f746-4bf5-a66e-ea2cabd0e22e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:07.215610 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4dd0094-f746-4bf5-a66e-ea2cabd0e22e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:07.279566 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f4dd0094-f746-4bf5-a66e-ea2cabd0e22e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:07.287639 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f4dd0094-f746-4bf5-a66e-ea2cabd0e22e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.084965 Apr 06 16:54:07.288211 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 951/1891] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:07 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:07.418880 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fee82ed0-a7d6-4d48-b694-212ef22f4459 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:07.419500 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fee82ed0-a7d6-4d48-b694-212ef22f4459 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:07.428222 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fee82ed0-a7d6-4d48-b694-212ef22f4459 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:07.428924 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fee82ed0-a7d6-4d48-b694-212ef22f4459 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:07.430047 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fee82ed0-a7d6-4d48-b694-212ef22f4459 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:07.430688 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fee82ed0-a7d6-4d48-b694-212ef22f4459 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:07.577571 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fee82ed0-a7d6-4d48-b694-212ef22f4459 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:07.586179 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fee82ed0-a7d6-4d48-b694-212ef22f4459 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.171460 Apr 06 16:54:07.586714 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 941/1892] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:07 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:08.305360 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8c846330-61a3-4e44-936f-363c9a395120 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:08.305912 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8c846330-61a3-4e44-936f-363c9a395120 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:08.313134 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c846330-61a3-4e44-936f-363c9a395120 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:08.313584 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c846330-61a3-4e44-936f-363c9a395120 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:08.314366 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c846330-61a3-4e44-936f-363c9a395120 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:08.314801 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c846330-61a3-4e44-936f-363c9a395120 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:08.379107 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8c846330-61a3-4e44-936f-363c9a395120 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:08.387384 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8c846330-61a3-4e44-936f-363c9a395120 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.085988 Apr 06 16:54:08.387957 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 952/1893] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:08 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:08.605345 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-28528fb9-f3c4-4868-b73b-a2648257c1df tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:08.606212 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-28528fb9-f3c4-4868-b73b-a2648257c1df tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:08.613042 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28528fb9-f3c4-4868-b73b-a2648257c1df tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:08.613494 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28528fb9-f3c4-4868-b73b-a2648257c1df tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:08.614283 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28528fb9-f3c4-4868-b73b-a2648257c1df tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:08.614720 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28528fb9-f3c4-4868-b73b-a2648257c1df tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:08.769077 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-28528fb9-f3c4-4868-b73b-a2648257c1df tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:08.773179 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-28528fb9-f3c4-4868-b73b-a2648257c1df tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.171829 Apr 06 16:54:08.773771 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 942/1894] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:08 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:09.405126 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7b88a048-1828-4687-9a6c-aabe61d52bb2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:09.405752 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7b88a048-1828-4687-9a6c-aabe61d52bb2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:09.412539 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b88a048-1828-4687-9a6c-aabe61d52bb2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:09.413050 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b88a048-1828-4687-9a6c-aabe61d52bb2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:09.413826 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b88a048-1828-4687-9a6c-aabe61d52bb2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:09.414261 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b88a048-1828-4687-9a6c-aabe61d52bb2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:09.477326 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7b88a048-1828-4687-9a6c-aabe61d52bb2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:09.485635 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7b88a048-1828-4687-9a6c-aabe61d52bb2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.084584 Apr 06 16:54:09.486214 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 953/1895] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:09 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:09.791161 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c467baa0-0f85-409d-a15d-89992be036b6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:09.791781 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c467baa0-0f85-409d-a15d-89992be036b6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:09.798804 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c467baa0-0f85-409d-a15d-89992be036b6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:09.799253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c467baa0-0f85-409d-a15d-89992be036b6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:09.800019 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c467baa0-0f85-409d-a15d-89992be036b6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:09.800449 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c467baa0-0f85-409d-a15d-89992be036b6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:09.940347 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c467baa0-0f85-409d-a15d-89992be036b6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:09.948465 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c467baa0-0f85-409d-a15d-89992be036b6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.161320 Apr 06 16:54:09.949068 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 943/1896] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:09 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:10.503027 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-25211896-2039-4de0-9232-cac0a161a383 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:10.503623 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-25211896-2039-4de0-9232-cac0a161a383 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:10.510419 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25211896-2039-4de0-9232-cac0a161a383 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:10.510876 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25211896-2039-4de0-9232-cac0a161a383 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:10.511641 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25211896-2039-4de0-9232-cac0a161a383 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:10.512200 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25211896-2039-4de0-9232-cac0a161a383 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:10.579042 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-25211896-2039-4de0-9232-cac0a161a383 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:10.587442 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-25211896-2039-4de0-9232-cac0a161a383 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.088362 Apr 06 16:54:10.587952 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 954/1897] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:10 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:10.970273 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3cbd540e-25a7-4514-9079-4d68e16e7dad tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:10.970927 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3cbd540e-25a7-4514-9079-4d68e16e7dad tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:10.978308 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cbd540e-25a7-4514-9079-4d68e16e7dad tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:10.978756 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cbd540e-25a7-4514-9079-4d68e16e7dad tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:10.979516 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cbd540e-25a7-4514-9079-4d68e16e7dad tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:10.979945 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cbd540e-25a7-4514-9079-4d68e16e7dad tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:11.129428 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3cbd540e-25a7-4514-9079-4d68e16e7dad tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:11.137908 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3cbd540e-25a7-4514-9079-4d68e16e7dad tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.171652 Apr 06 16:54:11.138491 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 944/1898] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:10 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:11.605759 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8f198f6f-e23d-4ab0-989c-153a6a22552a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:11.606347 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8f198f6f-e23d-4ab0-989c-153a6a22552a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:11.612828 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f198f6f-e23d-4ab0-989c-153a6a22552a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:11.613264 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f198f6f-e23d-4ab0-989c-153a6a22552a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:11.614034 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f198f6f-e23d-4ab0-989c-153a6a22552a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:11.614467 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f198f6f-e23d-4ab0-989c-153a6a22552a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:11.677342 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8f198f6f-e23d-4ab0-989c-153a6a22552a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:11.686578 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8f198f6f-e23d-4ab0-989c-153a6a22552a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.084670 Apr 06 16:54:11.687306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 955/1899] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:11 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:12.155765 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-644db95a-96bd-490c-8b8c-a5f5ac74ab2e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:12.156401 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-644db95a-96bd-490c-8b8c-a5f5ac74ab2e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:12.163143 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-644db95a-96bd-490c-8b8c-a5f5ac74ab2e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:12.163591 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-644db95a-96bd-490c-8b8c-a5f5ac74ab2e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:12.164356 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-644db95a-96bd-490c-8b8c-a5f5ac74ab2e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:12.164817 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-644db95a-96bd-490c-8b8c-a5f5ac74ab2e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:12.300657 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-644db95a-96bd-490c-8b8c-a5f5ac74ab2e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:12.309173 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-644db95a-96bd-490c-8b8c-a5f5ac74ab2e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.157459 Apr 06 16:54:12.309955 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 945/1900] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:12 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:12.707455 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3cc9ea88-704f-4aed-8850-e727e161f514 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:12.708052 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3cc9ea88-704f-4aed-8850-e727e161f514 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:12.715177 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3cc9ea88-704f-4aed-8850-e727e161f514 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:12.715617 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3cc9ea88-704f-4aed-8850-e727e161f514 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:12.716488 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3cc9ea88-704f-4aed-8850-e727e161f514 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:12.716958 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3cc9ea88-704f-4aed-8850-e727e161f514 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:12.782173 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3cc9ea88-704f-4aed-8850-e727e161f514 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:12.790202 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3cc9ea88-704f-4aed-8850-e727e161f514 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086694 Apr 06 16:54:12.790764 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 956/1901] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:12 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:13.327404 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e39ed1ae-fb74-4623-b9ae-f89aea2132d6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:13.328020 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e39ed1ae-fb74-4623-b9ae-f89aea2132d6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:13.334677 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e39ed1ae-fb74-4623-b9ae-f89aea2132d6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:13.335125 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e39ed1ae-fb74-4623-b9ae-f89aea2132d6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:13.335897 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e39ed1ae-fb74-4623-b9ae-f89aea2132d6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:13.336330 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e39ed1ae-fb74-4623-b9ae-f89aea2132d6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:13.475967 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e39ed1ae-fb74-4623-b9ae-f89aea2132d6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:13.484338 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e39ed1ae-fb74-4623-b9ae-f89aea2132d6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.161476 Apr 06 16:54:13.484946 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 946/1902] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:13 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:13.807949 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3aa916b1-f6af-4c91-a805-f9769f34414e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:13.808805 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3aa916b1-f6af-4c91-a805-f9769f34414e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:13.815788 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3aa916b1-f6af-4c91-a805-f9769f34414e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:13.816241 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3aa916b1-f6af-4c91-a805-f9769f34414e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:13.817139 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3aa916b1-f6af-4c91-a805-f9769f34414e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:13.817562 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3aa916b1-f6af-4c91-a805-f9769f34414e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:13.878790 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3aa916b1-f6af-4c91-a805-f9769f34414e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:13.887272 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3aa916b1-f6af-4c91-a805-f9769f34414e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.083203 Apr 06 16:54:13.887853 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 957/1903] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:13 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:14.501449 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-23bd8e67-e9da-4a94-b8c8-4065b4251d9a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:14.502072 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-23bd8e67-e9da-4a94-b8c8-4065b4251d9a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:14.508828 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23bd8e67-e9da-4a94-b8c8-4065b4251d9a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:14.509282 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23bd8e67-e9da-4a94-b8c8-4065b4251d9a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:14.510057 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23bd8e67-e9da-4a94-b8c8-4065b4251d9a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:14.510494 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23bd8e67-e9da-4a94-b8c8-4065b4251d9a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:14.644385 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-23bd8e67-e9da-4a94-b8c8-4065b4251d9a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:14.652542 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-23bd8e67-e9da-4a94-b8c8-4065b4251d9a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.155040 Apr 06 16:54:14.653316 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 947/1904] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:14 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:14.904927 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-22aaabc6-c02c-4b07-8852-812ffb60beb1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:14.905520 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-22aaabc6-c02c-4b07-8852-812ffb60beb1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:14.912281 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22aaabc6-c02c-4b07-8852-812ffb60beb1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:14.912838 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22aaabc6-c02c-4b07-8852-812ffb60beb1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:14.913606 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22aaabc6-c02c-4b07-8852-812ffb60beb1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:14.914037 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22aaabc6-c02c-4b07-8852-812ffb60beb1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:14.977957 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-22aaabc6-c02c-4b07-8852-812ffb60beb1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:14.986317 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-22aaabc6-c02c-4b07-8852-812ffb60beb1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.085698 Apr 06 16:54:14.986901 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 958/1905] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:14 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:15.673069 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-75e367de-e56b-4c18-8aaf-b06afaba7dca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:15.673716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-75e367de-e56b-4c18-8aaf-b06afaba7dca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:15.680502 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75e367de-e56b-4c18-8aaf-b06afaba7dca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:15.680994 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75e367de-e56b-4c18-8aaf-b06afaba7dca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:15.681772 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75e367de-e56b-4c18-8aaf-b06afaba7dca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:15.682207 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75e367de-e56b-4c18-8aaf-b06afaba7dca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:15.820487 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-75e367de-e56b-4c18-8aaf-b06afaba7dca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:15.829462 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-75e367de-e56b-4c18-8aaf-b06afaba7dca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.161495 Apr 06 16:54:15.830044 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 948/1906] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:15 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:16.006295 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-75c9e7c9-7bb4-4720-a93b-cea6bfa9d087 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:16.006951 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-75c9e7c9-7bb4-4720-a93b-cea6bfa9d087 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:16.013719 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75c9e7c9-7bb4-4720-a93b-cea6bfa9d087 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:16.014173 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75c9e7c9-7bb4-4720-a93b-cea6bfa9d087 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:16.014951 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75c9e7c9-7bb4-4720-a93b-cea6bfa9d087 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:16.015384 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75c9e7c9-7bb4-4720-a93b-cea6bfa9d087 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:16.076866 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-75c9e7c9-7bb4-4720-a93b-cea6bfa9d087 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:16.085305 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-75c9e7c9-7bb4-4720-a93b-cea6bfa9d087 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.084942 Apr 06 16:54:16.085883 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 959/1907] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:15 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:16.847060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fbd9388c-e292-48cd-b842-4825c2661b14 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:16.847728 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fbd9388c-e292-48cd-b842-4825c2661b14 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:16.855056 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbd9388c-e292-48cd-b842-4825c2661b14 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:16.855376 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbd9388c-e292-48cd-b842-4825c2661b14 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:16.856149 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbd9388c-e292-48cd-b842-4825c2661b14 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:16.856590 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbd9388c-e292-48cd-b842-4825c2661b14 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:16.998259 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fbd9388c-e292-48cd-b842-4825c2661b14 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:17.006525 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fbd9388c-e292-48cd-b842-4825c2661b14 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.163390 Apr 06 16:54:17.007077 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 949/1908] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:16 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:17.102947 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e6e07afa-e723-4842-9697-5849cff92de4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:17.103561 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e6e07afa-e723-4842-9697-5849cff92de4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:17.110733 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6e07afa-e723-4842-9697-5849cff92de4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:17.111181 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6e07afa-e723-4842-9697-5849cff92de4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:17.111937 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6e07afa-e723-4842-9697-5849cff92de4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:17.112360 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6e07afa-e723-4842-9697-5849cff92de4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:17.171637 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e6e07afa-e723-4842-9697-5849cff92de4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:17.179980 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e6e07afa-e723-4842-9697-5849cff92de4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.080984 Apr 06 16:54:17.180545 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 960/1909] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:17 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:18.024571 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9ec6bdbf-e9ae-44fb-9281-ec4b60ecf81e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:18.025254 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9ec6bdbf-e9ae-44fb-9281-ec4b60ecf81e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:18.032554 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ec6bdbf-e9ae-44fb-9281-ec4b60ecf81e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:18.033044 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ec6bdbf-e9ae-44fb-9281-ec4b60ecf81e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:18.033846 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ec6bdbf-e9ae-44fb-9281-ec4b60ecf81e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:18.034267 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ec6bdbf-e9ae-44fb-9281-ec4b60ecf81e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:18.172210 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9ec6bdbf-e9ae-44fb-9281-ec4b60ecf81e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:18.180592 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9ec6bdbf-e9ae-44fb-9281-ec4b60ecf81e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.160050 Apr 06 16:54:18.181213 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 950/1910] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:18 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:18.197614 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bf83a0f2-58c1-4c54-b641-88800d320512 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:18.198192 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bf83a0f2-58c1-4c54-b641-88800d320512 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:18.205225 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf83a0f2-58c1-4c54-b641-88800d320512 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:18.205673 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf83a0f2-58c1-4c54-b641-88800d320512 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:18.206441 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf83a0f2-58c1-4c54-b641-88800d320512 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:18.206853 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bf83a0f2-58c1-4c54-b641-88800d320512 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:18.267218 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-bf83a0f2-58c1-4c54-b641-88800d320512 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:18.275396 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bf83a0f2-58c1-4c54-b641-88800d320512 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.081650 Apr 06 16:54:18.275903 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 961/1911] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:18 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:19.198600 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a020f16a-0fb4-4953-bd16-944f39564700 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:19.199407 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a020f16a-0fb4-4953-bd16-944f39564700 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:19.206077 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a020f16a-0fb4-4953-bd16-944f39564700 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:19.206526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a020f16a-0fb4-4953-bd16-944f39564700 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:19.207290 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a020f16a-0fb4-4953-bd16-944f39564700 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:19.207720 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a020f16a-0fb4-4953-bd16-944f39564700 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:19.292306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-11700626-97a0-4918-a414-ff2ba7ba33b1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:19.293061 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-11700626-97a0-4918-a414-ff2ba7ba33b1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:19.299579 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11700626-97a0-4918-a414-ff2ba7ba33b1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:19.300050 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11700626-97a0-4918-a414-ff2ba7ba33b1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:19.300856 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11700626-97a0-4918-a414-ff2ba7ba33b1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:19.301289 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-11700626-97a0-4918-a414-ff2ba7ba33b1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:19.357656 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a020f16a-0fb4-4953-bd16-944f39564700 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:19.366907 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a020f16a-0fb4-4953-bd16-944f39564700 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.172204 Apr 06 16:54:19.367535 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 951/1912] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:19 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:19.370758 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-11700626-97a0-4918-a414-ff2ba7ba33b1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:19.377877 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-11700626-97a0-4918-a414-ff2ba7ba33b1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.089489 Apr 06 16:54:19.378496 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 962/1913] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:19 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:20.390000 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-04f0921d-fdb5-45f2-837d-4aa8ad4fe629 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:20.390996 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-04f0921d-fdb5-45f2-837d-4aa8ad4fe629 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:20.399219 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-53de5744-618d-4ac0-8702-a3d24e47d39c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:20.400470 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-53de5744-618d-4ac0-8702-a3d24e47d39c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:20.402108 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04f0921d-fdb5-45f2-837d-4aa8ad4fe629 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:20.402747 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04f0921d-fdb5-45f2-837d-4aa8ad4fe629 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:20.403582 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04f0921d-fdb5-45f2-837d-4aa8ad4fe629 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:20.404265 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04f0921d-fdb5-45f2-837d-4aa8ad4fe629 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:20.408659 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53de5744-618d-4ac0-8702-a3d24e47d39c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:20.409126 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53de5744-618d-4ac0-8702-a3d24e47d39c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:20.409940 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53de5744-618d-4ac0-8702-a3d24e47d39c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:20.410420 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53de5744-618d-4ac0-8702-a3d24e47d39c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:20.471991 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-53de5744-618d-4ac0-8702-a3d24e47d39c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:20.480613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-53de5744-618d-4ac0-8702-a3d24e47d39c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.087663 Apr 06 16:54:20.481468 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 963/1914] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:20 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:20.542191 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-04f0921d-fdb5-45f2-837d-4aa8ad4fe629 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:20.550314 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-04f0921d-fdb5-45f2-837d-4aa8ad4fe629 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.167202 Apr 06 16:54:20.550901 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 952/1915] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:20 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:21.498626 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f1303d9a-dcf8-4a13-8af0-2da82f3c4143 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:21.499260 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f1303d9a-dcf8-4a13-8af0-2da82f3c4143 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:21.505991 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1303d9a-dcf8-4a13-8af0-2da82f3c4143 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:21.506445 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1303d9a-dcf8-4a13-8af0-2da82f3c4143 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:21.507249 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1303d9a-dcf8-4a13-8af0-2da82f3c4143 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:21.507677 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1303d9a-dcf8-4a13-8af0-2da82f3c4143 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:21.567519 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a13c537b-c2e8-42ed-885f-38aad30b92d0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:21.568155 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a13c537b-c2e8-42ed-885f-38aad30b92d0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:21.568288 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f1303d9a-dcf8-4a13-8af0-2da82f3c4143 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:21.575448 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a13c537b-c2e8-42ed-885f-38aad30b92d0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:21.575901 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a13c537b-c2e8-42ed-885f-38aad30b92d0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:21.576720 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a13c537b-c2e8-42ed-885f-38aad30b92d0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:21.577019 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f1303d9a-dcf8-4a13-8af0-2da82f3c4143 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.082981 Apr 06 16:54:21.577202 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a13c537b-c2e8-42ed-885f-38aad30b92d0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:21.577610 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 964/1916] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:21 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:21.713796 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a13c537b-c2e8-42ed-885f-38aad30b92d0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:21.722079 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a13c537b-c2e8-42ed-885f-38aad30b92d0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.158455 Apr 06 16:54:21.728860 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 953/1917] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:21 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:22.595467 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b753589c-f2b9-49a6-b0a6-094a089926f4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:22.596345 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b753589c-f2b9-49a6-b0a6-094a089926f4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:22.605785 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b753589c-f2b9-49a6-b0a6-094a089926f4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:22.606529 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b753589c-f2b9-49a6-b0a6-094a089926f4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:22.607732 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b753589c-f2b9-49a6-b0a6-094a089926f4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:22.608439 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b753589c-f2b9-49a6-b0a6-094a089926f4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:22.677962 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b753589c-f2b9-49a6-b0a6-094a089926f4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:22.688663 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b753589c-f2b9-49a6-b0a6-094a089926f4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.098333 Apr 06 16:54:22.689302 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 965/1918] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:22 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:22.739354 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9324b407-b26f-4f77-8fc9-0d1d335213b1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:22.740003 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9324b407-b26f-4f77-8fc9-0d1d335213b1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:22.750485 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9324b407-b26f-4f77-8fc9-0d1d335213b1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:22.751131 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9324b407-b26f-4f77-8fc9-0d1d335213b1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:22.752386 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9324b407-b26f-4f77-8fc9-0d1d335213b1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:22.753954 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9324b407-b26f-4f77-8fc9-0d1d335213b1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:22.941002 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9324b407-b26f-4f77-8fc9-0d1d335213b1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:22.949975 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9324b407-b26f-4f77-8fc9-0d1d335213b1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.214675 Apr 06 16:54:22.951917 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 954/1919] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:22 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:23.707814 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-885b9c76-4423-4a5a-8a79-b5de1d8621f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:23.708447 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-885b9c76-4423-4a5a-8a79-b5de1d8621f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:23.715390 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-885b9c76-4423-4a5a-8a79-b5de1d8621f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:23.715826 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-885b9c76-4423-4a5a-8a79-b5de1d8621f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:23.716599 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-885b9c76-4423-4a5a-8a79-b5de1d8621f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:23.717069 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-885b9c76-4423-4a5a-8a79-b5de1d8621f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:23.779584 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-885b9c76-4423-4a5a-8a79-b5de1d8621f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:23.793618 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-885b9c76-4423-4a5a-8a79-b5de1d8621f8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.089739 Apr 06 16:54:23.794387 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 966/1920] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:23 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:23.974126 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-014110a5-a97f-462e-8811-3d27b2d2da4c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:23.974715 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-014110a5-a97f-462e-8811-3d27b2d2da4c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:23.981459 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-014110a5-a97f-462e-8811-3d27b2d2da4c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:23.981900 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-014110a5-a97f-462e-8811-3d27b2d2da4c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:23.982665 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-014110a5-a97f-462e-8811-3d27b2d2da4c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:23.983093 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-014110a5-a97f-462e-8811-3d27b2d2da4c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:24.133341 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-014110a5-a97f-462e-8811-3d27b2d2da4c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:24.145064 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-014110a5-a97f-462e-8811-3d27b2d2da4c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.175235 Apr 06 16:54:24.145638 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 955/1921] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:23 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:24.823852 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-db559443-605b-4495-8df0-79c00159dfa5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:24.824571 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-db559443-605b-4495-8df0-79c00159dfa5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:24.832618 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db559443-605b-4495-8df0-79c00159dfa5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:24.833100 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db559443-605b-4495-8df0-79c00159dfa5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:24.833880 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db559443-605b-4495-8df0-79c00159dfa5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:24.834315 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db559443-605b-4495-8df0-79c00159dfa5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:24.900888 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-db559443-605b-4495-8df0-79c00159dfa5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:24.909054 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-db559443-605b-4495-8df0-79c00159dfa5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.091986 Apr 06 16:54:24.909612 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 967/1922] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:24 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:25.163324 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9e965889-0746-4127-8a8a-9edc5361cc68 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:25.164055 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9e965889-0746-4127-8a8a-9edc5361cc68 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:25.171346 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e965889-0746-4127-8a8a-9edc5361cc68 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:25.171797 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e965889-0746-4127-8a8a-9edc5361cc68 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:25.172578 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e965889-0746-4127-8a8a-9edc5361cc68 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:25.173037 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e965889-0746-4127-8a8a-9edc5361cc68 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:25.317900 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9e965889-0746-4127-8a8a-9edc5361cc68 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:25.327097 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9e965889-0746-4127-8a8a-9edc5361cc68 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.167672 Apr 06 16:54:25.327699 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 956/1923] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:25 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:25.927035 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ecb0b26e-b402-48f7-8e88-9d8d7ff741c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:25.927677 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ecb0b26e-b402-48f7-8e88-9d8d7ff741c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:25.934830 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ecb0b26e-b402-48f7-8e88-9d8d7ff741c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:25.935273 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ecb0b26e-b402-48f7-8e88-9d8d7ff741c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:25.936044 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ecb0b26e-b402-48f7-8e88-9d8d7ff741c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:25.936471 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ecb0b26e-b402-48f7-8e88-9d8d7ff741c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:26.006807 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ecb0b26e-b402-48f7-8e88-9d8d7ff741c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:26.015660 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ecb0b26e-b402-48f7-8e88-9d8d7ff741c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.092664 Apr 06 16:54:26.016240 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 968/1924] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:25 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:26.348892 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b483384e-be01-4292-b703-7d79fd9a5d4c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:26.349499 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b483384e-be01-4292-b703-7d79fd9a5d4c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:26.356834 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b483384e-be01-4292-b703-7d79fd9a5d4c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:26.357288 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b483384e-be01-4292-b703-7d79fd9a5d4c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:26.358067 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b483384e-be01-4292-b703-7d79fd9a5d4c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:26.358496 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b483384e-be01-4292-b703-7d79fd9a5d4c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:26.508929 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b483384e-be01-4292-b703-7d79fd9a5d4c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:26.517739 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b483384e-be01-4292-b703-7d79fd9a5d4c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.173229 Apr 06 16:54:26.518326 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 957/1925] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:26 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:27.032643 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3980de36-31ed-4764-981d-88ab1f21bbb8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:27.033261 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3980de36-31ed-4764-981d-88ab1f21bbb8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:27.039903 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3980de36-31ed-4764-981d-88ab1f21bbb8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:27.040349 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3980de36-31ed-4764-981d-88ab1f21bbb8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:27.041156 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3980de36-31ed-4764-981d-88ab1f21bbb8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:27.041587 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3980de36-31ed-4764-981d-88ab1f21bbb8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:27.109690 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3980de36-31ed-4764-981d-88ab1f21bbb8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:27.118532 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3980de36-31ed-4764-981d-88ab1f21bbb8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.090124 Apr 06 16:54:27.119150 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 969/1926] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:27 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:27.539803 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d8a9d354-4f13-4fa8-9bb0-4b7f0fdd3823 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:27.540807 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d8a9d354-4f13-4fa8-9bb0-4b7f0fdd3823 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:27.551854 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8a9d354-4f13-4fa8-9bb0-4b7f0fdd3823 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:27.552620 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8a9d354-4f13-4fa8-9bb0-4b7f0fdd3823 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:27.553927 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8a9d354-4f13-4fa8-9bb0-4b7f0fdd3823 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:27.554658 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8a9d354-4f13-4fa8-9bb0-4b7f0fdd3823 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:27.704171 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d8a9d354-4f13-4fa8-9bb0-4b7f0fdd3823 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:27.712572 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d8a9d354-4f13-4fa8-9bb0-4b7f0fdd3823 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.179442 Apr 06 16:54:27.713174 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 958/1927] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:27 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:28.144907 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6c13428c-a507-4203-bf2b-5c28ade8ae3e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:28.145880 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6c13428c-a507-4203-bf2b-5c28ade8ae3e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:28.155098 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c13428c-a507-4203-bf2b-5c28ade8ae3e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:28.155551 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c13428c-a507-4203-bf2b-5c28ade8ae3e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:28.156326 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c13428c-a507-4203-bf2b-5c28ade8ae3e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:28.156798 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c13428c-a507-4203-bf2b-5c28ade8ae3e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:28.225176 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6c13428c-a507-4203-bf2b-5c28ade8ae3e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:28.233820 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6c13428c-a507-4203-bf2b-5c28ade8ae3e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.095331 Apr 06 16:54:28.234607 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 970/1928] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:28 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:28.732535 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d331a82d-4ea7-4575-a980-3a1222edd775 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:28.733213 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d331a82d-4ea7-4575-a980-3a1222edd775 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:28.739951 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d331a82d-4ea7-4575-a980-3a1222edd775 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:28.740405 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d331a82d-4ea7-4575-a980-3a1222edd775 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:28.741204 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d331a82d-4ea7-4575-a980-3a1222edd775 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:28.741644 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d331a82d-4ea7-4575-a980-3a1222edd775 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:28.879506 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d331a82d-4ea7-4575-a980-3a1222edd775 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:28.887920 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d331a82d-4ea7-4575-a980-3a1222edd775 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.160379 Apr 06 16:54:28.888535 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 959/1929] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:28 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:29.251292 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2959ac78-2b4f-491a-a3bd-08bcfc584ecc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:29.251946 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2959ac78-2b4f-491a-a3bd-08bcfc584ecc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:29.258851 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2959ac78-2b4f-491a-a3bd-08bcfc584ecc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:29.259291 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2959ac78-2b4f-491a-a3bd-08bcfc584ecc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:29.260058 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2959ac78-2b4f-491a-a3bd-08bcfc584ecc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:29.260471 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2959ac78-2b4f-491a-a3bd-08bcfc584ecc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:29.324732 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2959ac78-2b4f-491a-a3bd-08bcfc584ecc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:29.332921 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2959ac78-2b4f-491a-a3bd-08bcfc584ecc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.085432 Apr 06 16:54:29.333484 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 971/1930] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:29 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:29.905174 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-200a485b-58fb-4850-ab3a-4a8bdd3eda9c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:29.905820 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-200a485b-58fb-4850-ab3a-4a8bdd3eda9c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:29.912330 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-200a485b-58fb-4850-ab3a-4a8bdd3eda9c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:29.912803 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-200a485b-58fb-4850-ab3a-4a8bdd3eda9c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:29.913564 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-200a485b-58fb-4850-ab3a-4a8bdd3eda9c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:29.914070 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-200a485b-58fb-4850-ab3a-4a8bdd3eda9c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:30.052606 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-200a485b-58fb-4850-ab3a-4a8bdd3eda9c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:30.061496 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-200a485b-58fb-4850-ab3a-4a8bdd3eda9c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.160145 Apr 06 16:54:30.062348 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 960/1931] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:29 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:30.350577 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-37ab8feb-e239-4ec3-9e8b-31892b24b1be tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:30.351256 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-37ab8feb-e239-4ec3-9e8b-31892b24b1be tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:30.358766 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37ab8feb-e239-4ec3-9e8b-31892b24b1be tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:30.359210 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37ab8feb-e239-4ec3-9e8b-31892b24b1be tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:30.359997 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37ab8feb-e239-4ec3-9e8b-31892b24b1be tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:30.360482 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-37ab8feb-e239-4ec3-9e8b-31892b24b1be tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:30.424038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-37ab8feb-e239-4ec3-9e8b-31892b24b1be tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:30.432337 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-37ab8feb-e239-4ec3-9e8b-31892b24b1be tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086011 Apr 06 16:54:30.433097 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 972/1932] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:30 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:31.083159 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e5108c2e-ef8f-4894-8065-c41e3b3bdf9c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:31.084011 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e5108c2e-ef8f-4894-8065-c41e3b3bdf9c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:31.092787 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5108c2e-ef8f-4894-8065-c41e3b3bdf9c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:31.093240 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5108c2e-ef8f-4894-8065-c41e3b3bdf9c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:31.094014 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5108c2e-ef8f-4894-8065-c41e3b3bdf9c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:31.094451 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5108c2e-ef8f-4894-8065-c41e3b3bdf9c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:31.247245 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e5108c2e-ef8f-4894-8065-c41e3b3bdf9c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:31.256065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e5108c2e-ef8f-4894-8065-c41e3b3bdf9c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.179568 Apr 06 16:54:31.256643 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 961/1933] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:31 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:31.450703 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d0f1bf3e-5e2a-4760-8e4f-49d628a82ab5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:31.451296 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d0f1bf3e-5e2a-4760-8e4f-49d628a82ab5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:31.458231 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0f1bf3e-5e2a-4760-8e4f-49d628a82ab5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:31.458736 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0f1bf3e-5e2a-4760-8e4f-49d628a82ab5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:31.459517 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0f1bf3e-5e2a-4760-8e4f-49d628a82ab5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:31.459955 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0f1bf3e-5e2a-4760-8e4f-49d628a82ab5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:31.527493 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d0f1bf3e-5e2a-4760-8e4f-49d628a82ab5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:31.536237 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d0f1bf3e-5e2a-4760-8e4f-49d628a82ab5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.089692 Apr 06 16:54:31.536857 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 973/1934] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:31 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:32.273836 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4acea2db-1ead-4a79-9d4a-6b0807c6143c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:32.274482 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4acea2db-1ead-4a79-9d4a-6b0807c6143c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:32.281462 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4acea2db-1ead-4a79-9d4a-6b0807c6143c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:32.281920 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4acea2db-1ead-4a79-9d4a-6b0807c6143c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:32.282697 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4acea2db-1ead-4a79-9d4a-6b0807c6143c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:32.283136 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4acea2db-1ead-4a79-9d4a-6b0807c6143c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:32.428105 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4acea2db-1ead-4a79-9d4a-6b0807c6143c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:32.437834 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4acea2db-1ead-4a79-9d4a-6b0807c6143c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.167898 Apr 06 16:54:32.438414 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 962/1935] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:32 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:32.554056 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d1cec76a-56c7-4f57-b0bd-0c0e41aa626e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:32.554640 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d1cec76a-56c7-4f57-b0bd-0c0e41aa626e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:32.561507 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1cec76a-56c7-4f57-b0bd-0c0e41aa626e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:32.561961 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1cec76a-56c7-4f57-b0bd-0c0e41aa626e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:32.562737 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1cec76a-56c7-4f57-b0bd-0c0e41aa626e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:32.563172 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d1cec76a-56c7-4f57-b0bd-0c0e41aa626e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:32.636666 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d1cec76a-56c7-4f57-b0bd-0c0e41aa626e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:32.645350 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d1cec76a-56c7-4f57-b0bd-0c0e41aa626e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.095302 Apr 06 16:54:32.645942 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 974/1936] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:32 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:33.459538 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-565a51fb-3a4c-4ba3-b48d-746c312b1e37 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:33.460424 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-565a51fb-3a4c-4ba3-b48d-746c312b1e37 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:33.467999 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-565a51fb-3a4c-4ba3-b48d-746c312b1e37 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:33.468451 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-565a51fb-3a4c-4ba3-b48d-746c312b1e37 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:33.469296 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-565a51fb-3a4c-4ba3-b48d-746c312b1e37 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:33.469746 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-565a51fb-3a4c-4ba3-b48d-746c312b1e37 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:33.619798 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-565a51fb-3a4c-4ba3-b48d-746c312b1e37 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:33.628720 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-565a51fb-3a4c-4ba3-b48d-746c312b1e37 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.174776 Apr 06 16:54:33.629324 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 963/1937] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:33 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:33.666786 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2406e43e-ae13-4565-9336-3d4eba0ef168 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:33.667541 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2406e43e-ae13-4565-9336-3d4eba0ef168 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:33.674433 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2406e43e-ae13-4565-9336-3d4eba0ef168 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:33.674861 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2406e43e-ae13-4565-9336-3d4eba0ef168 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:33.675678 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2406e43e-ae13-4565-9336-3d4eba0ef168 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:33.676091 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2406e43e-ae13-4565-9336-3d4eba0ef168 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:33.738840 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2406e43e-ae13-4565-9336-3d4eba0ef168 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:33.751578 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2406e43e-ae13-4565-9336-3d4eba0ef168 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.091116 Apr 06 16:54:33.752230 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 975/1938] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:33 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:34.646926 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b7a92512-56fd-4aa8-8930-3f28c40fb8ce tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:34.647555 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b7a92512-56fd-4aa8-8930-3f28c40fb8ce tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:34.654333 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7a92512-56fd-4aa8-8930-3f28c40fb8ce tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:34.654786 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7a92512-56fd-4aa8-8930-3f28c40fb8ce tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:34.655568 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7a92512-56fd-4aa8-8930-3f28c40fb8ce tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:34.656009 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7a92512-56fd-4aa8-8930-3f28c40fb8ce tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:34.771636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7016a071-b111-4982-8fc8-39bedb019cb3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:34.772236 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7016a071-b111-4982-8fc8-39bedb019cb3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:34.779432 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7016a071-b111-4982-8fc8-39bedb019cb3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:34.779877 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7016a071-b111-4982-8fc8-39bedb019cb3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:34.780660 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7016a071-b111-4982-8fc8-39bedb019cb3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:34.781133 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7016a071-b111-4982-8fc8-39bedb019cb3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:34.796315 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b7a92512-56fd-4aa8-8930-3f28c40fb8ce tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:34.804872 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b7a92512-56fd-4aa8-8930-3f28c40fb8ce tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.161869 Apr 06 16:54:34.805513 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 964/1939] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:34 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:34.843022 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7016a071-b111-4982-8fc8-39bedb019cb3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:34.854887 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7016a071-b111-4982-8fc8-39bedb019cb3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086990 Apr 06 16:54:34.855538 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 976/1940] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:34 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:35.822821 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a21db8c9-f116-477e-a0fa-f8f1bad9f617 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:35.823582 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a21db8c9-f116-477e-a0fa-f8f1bad9f617 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:35.830624 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a21db8c9-f116-477e-a0fa-f8f1bad9f617 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:35.831076 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a21db8c9-f116-477e-a0fa-f8f1bad9f617 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:35.831891 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a21db8c9-f116-477e-a0fa-f8f1bad9f617 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:35.832325 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a21db8c9-f116-477e-a0fa-f8f1bad9f617 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:35.875733 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b33c9784-984a-4eaf-8404-95dfdb01d9c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:35.876373 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b33c9784-984a-4eaf-8404-95dfdb01d9c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:35.883100 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b33c9784-984a-4eaf-8404-95dfdb01d9c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:35.883568 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b33c9784-984a-4eaf-8404-95dfdb01d9c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:35.884335 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b33c9784-984a-4eaf-8404-95dfdb01d9c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:35.884789 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b33c9784-984a-4eaf-8404-95dfdb01d9c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:35.945614 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b33c9784-984a-4eaf-8404-95dfdb01d9c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:35.953765 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b33c9784-984a-4eaf-8404-95dfdb01d9c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.082039 Apr 06 16:54:35.954446 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 977/1941] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:35 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:54:35.969903 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a21db8c9-f116-477e-a0fa-f8f1bad9f617 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:35.978571 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a21db8c9-f116-477e-a0fa-f8f1bad9f617 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.159703 Apr 06 16:54:35.979166 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 965/1942] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:35 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:36.971161 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e0af50d8-7a29-4012-b26f-513dbb8ca695 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:36.971772 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e0af50d8-7a29-4012-b26f-513dbb8ca695 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:36.978841 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0af50d8-7a29-4012-b26f-513dbb8ca695 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:36.979316 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0af50d8-7a29-4012-b26f-513dbb8ca695 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:36.980073 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0af50d8-7a29-4012-b26f-513dbb8ca695 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:36.980503 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0af50d8-7a29-4012-b26f-513dbb8ca695 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:36.996237 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-32d02d90-c322-4862-8d90-8d3c1afe8401 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:36.997120 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-32d02d90-c322-4862-8d90-8d3c1afe8401 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:37.004035 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32d02d90-c322-4862-8d90-8d3c1afe8401 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:37.004488 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32d02d90-c322-4862-8d90-8d3c1afe8401 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:37.005338 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32d02d90-c322-4862-8d90-8d3c1afe8401 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:37.005775 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32d02d90-c322-4862-8d90-8d3c1afe8401 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:37.041717 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e0af50d8-7a29-4012-b26f-513dbb8ca695 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:37.050307 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e0af50d8-7a29-4012-b26f-513dbb8ca695 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.083010 Apr 06 16:54:37.050872 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 978/1943] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:36 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:37.142565 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-32d02d90-c322-4862-8d90-8d3c1afe8401 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:37.150992 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-32d02d90-c322-4862-8d90-8d3c1afe8401 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.158916 Apr 06 16:54:37.151564 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 966/1944] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:36 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:38.067709 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eb3b1f16-6710-4ac3-8028-6b131f5380e4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:38.068419 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eb3b1f16-6710-4ac3-8028-6b131f5380e4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:38.074904 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb3b1f16-6710-4ac3-8028-6b131f5380e4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:38.075359 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb3b1f16-6710-4ac3-8028-6b131f5380e4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:38.076130 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb3b1f16-6710-4ac3-8028-6b131f5380e4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:38.076566 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb3b1f16-6710-4ac3-8028-6b131f5380e4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:38.138510 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-eb3b1f16-6710-4ac3-8028-6b131f5380e4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:38.146764 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eb3b1f16-6710-4ac3-8028-6b131f5380e4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.083003 Apr 06 16:54:38.147374 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 979/1945] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:38 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:38.168439 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1baa34e6-45ba-4525-aca3-25512659b965 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:38.169214 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1baa34e6-45ba-4525-aca3-25512659b965 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:38.176012 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1baa34e6-45ba-4525-aca3-25512659b965 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:38.176451 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1baa34e6-45ba-4525-aca3-25512659b965 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:38.177260 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1baa34e6-45ba-4525-aca3-25512659b965 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:38.177683 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1baa34e6-45ba-4525-aca3-25512659b965 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:38.317604 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1baa34e6-45ba-4525-aca3-25512659b965 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:38.326435 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1baa34e6-45ba-4525-aca3-25512659b965 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.161753 Apr 06 16:54:38.326941 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 967/1946] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:38 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:39.164638 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b8405a81-6d86-4858-9bd8-45ef9c8fc1ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:39.165262 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b8405a81-6d86-4858-9bd8-45ef9c8fc1ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:39.172276 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8405a81-6d86-4858-9bd8-45ef9c8fc1ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:39.172729 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8405a81-6d86-4858-9bd8-45ef9c8fc1ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:39.173540 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8405a81-6d86-4858-9bd8-45ef9c8fc1ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:39.173971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8405a81-6d86-4858-9bd8-45ef9c8fc1ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:39.242707 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b8405a81-6d86-4858-9bd8-45ef9c8fc1ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:39.250992 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b8405a81-6d86-4858-9bd8-45ef9c8fc1ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.090309 Apr 06 16:54:39.251570 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 980/1947] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:39 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:39.343991 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0833306a-9f40-4f60-830c-69397d3ff906 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:39.344569 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0833306a-9f40-4f60-830c-69397d3ff906 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:39.351770 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0833306a-9f40-4f60-830c-69397d3ff906 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:39.352224 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0833306a-9f40-4f60-830c-69397d3ff906 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:39.353506 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0833306a-9f40-4f60-830c-69397d3ff906 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:39.354200 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0833306a-9f40-4f60-830c-69397d3ff906 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:39.773405 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0833306a-9f40-4f60-830c-69397d3ff906 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:39.781628 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0833306a-9f40-4f60-830c-69397d3ff906 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.441836 Apr 06 16:54:39.782190 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 968/1948] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:39 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:40.268604 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5fe6d94a-b3c0-4e07-b92f-bf884ea2c1a2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:40.269257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5fe6d94a-b3c0-4e07-b92f-bf884ea2c1a2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:40.276143 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fe6d94a-b3c0-4e07-b92f-bf884ea2c1a2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:40.276596 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fe6d94a-b3c0-4e07-b92f-bf884ea2c1a2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:40.277396 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fe6d94a-b3c0-4e07-b92f-bf884ea2c1a2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:40.277825 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5fe6d94a-b3c0-4e07-b92f-bf884ea2c1a2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:40.338791 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5fe6d94a-b3c0-4e07-b92f-bf884ea2c1a2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:40.347409 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5fe6d94a-b3c0-4e07-b92f-bf884ea2c1a2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.082704 Apr 06 16:54:40.348347 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 981/1949] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:40 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:40.799046 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-abc0ac3f-73c2-47b5-91db-9f5f1cce8b21 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:40.799650 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-abc0ac3f-73c2-47b5-91db-9f5f1cce8b21 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:40.806668 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abc0ac3f-73c2-47b5-91db-9f5f1cce8b21 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:40.807115 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abc0ac3f-73c2-47b5-91db-9f5f1cce8b21 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:40.807883 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abc0ac3f-73c2-47b5-91db-9f5f1cce8b21 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:40.808314 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abc0ac3f-73c2-47b5-91db-9f5f1cce8b21 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:40.942421 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-abc0ac3f-73c2-47b5-91db-9f5f1cce8b21 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:40.950866 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-abc0ac3f-73c2-47b5-91db-9f5f1cce8b21 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.156264 Apr 06 16:54:40.951483 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 969/1950] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:40 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:41.365176 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-63625a1e-2d5e-4b24-9473-494f2ff13b50 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:41.365828 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-63625a1e-2d5e-4b24-9473-494f2ff13b50 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:41.372531 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63625a1e-2d5e-4b24-9473-494f2ff13b50 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:41.373163 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63625a1e-2d5e-4b24-9473-494f2ff13b50 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:41.373943 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63625a1e-2d5e-4b24-9473-494f2ff13b50 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:41.374382 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63625a1e-2d5e-4b24-9473-494f2ff13b50 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:41.434637 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-63625a1e-2d5e-4b24-9473-494f2ff13b50 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:41.442905 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-63625a1e-2d5e-4b24-9473-494f2ff13b50 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.081658 Apr 06 16:54:41.443481 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 982/1951] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:41 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:41.969145 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-530bbed1-085a-4228-a0ed-12290d1e952e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:41.969751 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-530bbed1-085a-4228-a0ed-12290d1e952e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:41.976665 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-530bbed1-085a-4228-a0ed-12290d1e952e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:41.977146 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-530bbed1-085a-4228-a0ed-12290d1e952e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:41.977926 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-530bbed1-085a-4228-a0ed-12290d1e952e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:41.978366 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-530bbed1-085a-4228-a0ed-12290d1e952e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:42.117150 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-530bbed1-085a-4228-a0ed-12290d1e952e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:42.125366 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-530bbed1-085a-4228-a0ed-12290d1e952e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.160313 Apr 06 16:54:42.125943 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 970/1952] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:41 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:42.460338 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6759985b-3d50-42f7-a5d9-8e1cd095f917 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:42.461113 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6759985b-3d50-42f7-a5d9-8e1cd095f917 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:42.468264 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6759985b-3d50-42f7-a5d9-8e1cd095f917 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:42.468707 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6759985b-3d50-42f7-a5d9-8e1cd095f917 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:42.469523 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6759985b-3d50-42f7-a5d9-8e1cd095f917 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:42.469961 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6759985b-3d50-42f7-a5d9-8e1cd095f917 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:42.530367 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6759985b-3d50-42f7-a5d9-8e1cd095f917 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:42.538516 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6759985b-3d50-42f7-a5d9-8e1cd095f917 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.082149 Apr 06 16:54:42.539090 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 983/1953] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:42 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:43.143219 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e278fb2f-0ad1-4d36-9f52-011504ac68eb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:43.143871 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e278fb2f-0ad1-4d36-9f52-011504ac68eb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:43.150499 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e278fb2f-0ad1-4d36-9f52-011504ac68eb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:43.150940 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e278fb2f-0ad1-4d36-9f52-011504ac68eb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:43.151701 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e278fb2f-0ad1-4d36-9f52-011504ac68eb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:43.152128 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e278fb2f-0ad1-4d36-9f52-011504ac68eb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:43.303641 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e278fb2f-0ad1-4d36-9f52-011504ac68eb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:43.312834 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e278fb2f-0ad1-4d36-9f52-011504ac68eb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.173758 Apr 06 16:54:43.313433 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 971/1954] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:43 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:43.555283 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dd58f750-f6b0-4c01-914b-33e569bf753b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:43.555874 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dd58f750-f6b0-4c01-914b-33e569bf753b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:43.562633 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd58f750-f6b0-4c01-914b-33e569bf753b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:43.563076 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd58f750-f6b0-4c01-914b-33e569bf753b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:43.563841 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd58f750-f6b0-4c01-914b-33e569bf753b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:43.564270 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd58f750-f6b0-4c01-914b-33e569bf753b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:43.631584 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-dd58f750-f6b0-4c01-914b-33e569bf753b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:43.640219 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dd58f750-f6b0-4c01-914b-33e569bf753b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.088875 Apr 06 16:54:43.640825 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 984/1955] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:43 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:44.331392 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ccebaa2f-8df2-4a75-a09c-13f50f91849b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:44.331854 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ccebaa2f-8df2-4a75-a09c-13f50f91849b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:44.338567 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccebaa2f-8df2-4a75-a09c-13f50f91849b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:44.339016 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccebaa2f-8df2-4a75-a09c-13f50f91849b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:44.339786 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccebaa2f-8df2-4a75-a09c-13f50f91849b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:44.340220 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccebaa2f-8df2-4a75-a09c-13f50f91849b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:44.476011 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ccebaa2f-8df2-4a75-a09c-13f50f91849b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:44.484669 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ccebaa2f-8df2-4a75-a09c-13f50f91849b tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.157488 Apr 06 16:54:44.485282 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 972/1956] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:44 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:44.658297 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-77874e4a-85a3-4ab5-a85c-0df421878faf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:44.658917 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-77874e4a-85a3-4ab5-a85c-0df421878faf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:44.665745 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77874e4a-85a3-4ab5-a85c-0df421878faf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:44.666188 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77874e4a-85a3-4ab5-a85c-0df421878faf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:44.666941 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77874e4a-85a3-4ab5-a85c-0df421878faf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:44.667364 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-77874e4a-85a3-4ab5-a85c-0df421878faf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:44.732257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-77874e4a-85a3-4ab5-a85c-0df421878faf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:44.740535 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-77874e4a-85a3-4ab5-a85c-0df421878faf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086463 Apr 06 16:54:44.741142 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 985/1957] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:44 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:45.502494 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5540ad65-1594-4a53-a076-19dac827c3cb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:45.503109 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5540ad65-1594-4a53-a076-19dac827c3cb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:45.509863 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5540ad65-1594-4a53-a076-19dac827c3cb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:45.510318 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5540ad65-1594-4a53-a076-19dac827c3cb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:45.511089 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5540ad65-1594-4a53-a076-19dac827c3cb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:45.511527 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5540ad65-1594-4a53-a076-19dac827c3cb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:45.656050 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5540ad65-1594-4a53-a076-19dac827c3cb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:45.664294 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5540ad65-1594-4a53-a076-19dac827c3cb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.165901 Apr 06 16:54:45.664925 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 973/1958] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:45 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:45.758710 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-afe2c7cd-b4b7-4d2c-b255-3c2177e1f627 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:45.759334 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-afe2c7cd-b4b7-4d2c-b255-3c2177e1f627 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:45.766604 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-afe2c7cd-b4b7-4d2c-b255-3c2177e1f627 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:45.767050 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-afe2c7cd-b4b7-4d2c-b255-3c2177e1f627 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:45.767821 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-afe2c7cd-b4b7-4d2c-b255-3c2177e1f627 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:45.768253 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-afe2c7cd-b4b7-4d2c-b255-3c2177e1f627 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:45.831007 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-afe2c7cd-b4b7-4d2c-b255-3c2177e1f627 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:45.839055 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-afe2c7cd-b4b7-4d2c-b255-3c2177e1f627 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.084309 Apr 06 16:54:45.839624 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 986/1959] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:45 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:46.682016 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fa4018e6-5810-4189-9c41-47156970156e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:46.682628 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fa4018e6-5810-4189-9c41-47156970156e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:46.689553 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa4018e6-5810-4189-9c41-47156970156e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:46.689999 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa4018e6-5810-4189-9c41-47156970156e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:46.690767 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa4018e6-5810-4189-9c41-47156970156e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:46.691198 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa4018e6-5810-4189-9c41-47156970156e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:46.835473 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fa4018e6-5810-4189-9c41-47156970156e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:46.844032 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fa4018e6-5810-4189-9c41-47156970156e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.165906 Apr 06 16:54:46.844613 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 974/1960] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:46 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:46.857507 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0425dc5b-f723-4180-b25d-5d2325c8233f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:46.858347 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0425dc5b-f723-4180-b25d-5d2325c8233f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:46.865338 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0425dc5b-f723-4180-b25d-5d2325c8233f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:46.865784 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0425dc5b-f723-4180-b25d-5d2325c8233f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:46.866556 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0425dc5b-f723-4180-b25d-5d2325c8233f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:46.866992 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0425dc5b-f723-4180-b25d-5d2325c8233f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:47.023911 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0425dc5b-f723-4180-b25d-5d2325c8233f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:47.032548 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0425dc5b-f723-4180-b25d-5d2325c8233f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.179338 Apr 06 16:54:47.033163 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 987/1961] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:46 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:47.862330 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e6c9ba75-db68-4dcf-9c45-07ce175cdb34 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:47.862968 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e6c9ba75-db68-4dcf-9c45-07ce175cdb34 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:47.869849 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6c9ba75-db68-4dcf-9c45-07ce175cdb34 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:47.870299 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6c9ba75-db68-4dcf-9c45-07ce175cdb34 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:47.871106 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6c9ba75-db68-4dcf-9c45-07ce175cdb34 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:47.871538 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6c9ba75-db68-4dcf-9c45-07ce175cdb34 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:48.025993 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e6c9ba75-db68-4dcf-9c45-07ce175cdb34 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:48.036032 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e6c9ba75-db68-4dcf-9c45-07ce175cdb34 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.177428 Apr 06 16:54:48.036844 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 975/1962] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:47 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:48.050067 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8c653261-af98-4012-96e2-43176f5b0763 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:48.050673 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8c653261-af98-4012-96e2-43176f5b0763 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:48.062843 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c653261-af98-4012-96e2-43176f5b0763 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:48.063282 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c653261-af98-4012-96e2-43176f5b0763 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:48.064073 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c653261-af98-4012-96e2-43176f5b0763 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:48.064504 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8c653261-af98-4012-96e2-43176f5b0763 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:48.132010 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8c653261-af98-4012-96e2-43176f5b0763 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:48.141871 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8c653261-af98-4012-96e2-43176f5b0763 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.095641 Apr 06 16:54:48.142457 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 988/1963] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:48 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:49.054195 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c28e04b0-8a00-448a-a90d-b0659a29f57f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:49.054797 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c28e04b0-8a00-448a-a90d-b0659a29f57f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:49.061657 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c28e04b0-8a00-448a-a90d-b0659a29f57f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:49.062110 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c28e04b0-8a00-448a-a90d-b0659a29f57f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:49.062890 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c28e04b0-8a00-448a-a90d-b0659a29f57f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:49.063351 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c28e04b0-8a00-448a-a90d-b0659a29f57f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:49.166947 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b848b662-b1a7-40be-9dd5-9bf6eaa55d7e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:49.167547 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b848b662-b1a7-40be-9dd5-9bf6eaa55d7e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:49.175007 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b848b662-b1a7-40be-9dd5-9bf6eaa55d7e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:49.175444 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b848b662-b1a7-40be-9dd5-9bf6eaa55d7e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:49.176210 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b848b662-b1a7-40be-9dd5-9bf6eaa55d7e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:49.176633 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b848b662-b1a7-40be-9dd5-9bf6eaa55d7e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:49.203057 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c28e04b0-8a00-448a-a90d-b0659a29f57f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:49.211369 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c28e04b0-8a00-448a-a90d-b0659a29f57f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.161214 Apr 06 16:54:49.211920 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 976/1964] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:49 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:49.236590 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b848b662-b1a7-40be-9dd5-9bf6eaa55d7e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:49.245380 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b848b662-b1a7-40be-9dd5-9bf6eaa55d7e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.082509 Apr 06 16:54:49.245982 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 989/1965] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:49 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:50.262801 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b8cb8c8d-ba85-4563-8cb5-2df75ddea599 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:50.263510 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b8cb8c8d-ba85-4563-8cb5-2df75ddea599 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:50.270262 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8cb8c8d-ba85-4563-8cb5-2df75ddea599 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:50.270693 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8cb8c8d-ba85-4563-8cb5-2df75ddea599 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:50.271431 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8cb8c8d-ba85-4563-8cb5-2df75ddea599 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:50.271890 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b8cb8c8d-ba85-4563-8cb5-2df75ddea599 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:50.334464 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b8cb8c8d-ba85-4563-8cb5-2df75ddea599 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:50.343037 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b8cb8c8d-ba85-4563-8cb5-2df75ddea599 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.084070 Apr 06 16:54:50.343635 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 990/1966] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:50 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:50.351056 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-22cd08ae-9d04-435a-a941-41c35877f180 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:50.351667 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-22cd08ae-9d04-435a-a941-41c35877f180 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:50.358410 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22cd08ae-9d04-435a-a941-41c35877f180 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:50.358897 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22cd08ae-9d04-435a-a941-41c35877f180 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:50.359674 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22cd08ae-9d04-435a-a941-41c35877f180 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:50.360105 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22cd08ae-9d04-435a-a941-41c35877f180 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:50.497152 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-22cd08ae-9d04-435a-a941-41c35877f180 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:50.505721 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-22cd08ae-9d04-435a-a941-41c35877f180 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.280347 Apr 06 16:54:50.506286 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 977/1967] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:50 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:51.360593 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-94226308-3d8b-4235-85a5-d7dc60b3c318 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:51.361267 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-94226308-3d8b-4235-85a5-d7dc60b3c318 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:51.368018 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94226308-3d8b-4235-85a5-d7dc60b3c318 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:51.368468 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94226308-3d8b-4235-85a5-d7dc60b3c318 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:51.369273 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94226308-3d8b-4235-85a5-d7dc60b3c318 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:51.369709 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-94226308-3d8b-4235-85a5-d7dc60b3c318 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:51.429803 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-94226308-3d8b-4235-85a5-d7dc60b3c318 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:51.438388 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-94226308-3d8b-4235-85a5-d7dc60b3c318 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.081857 Apr 06 16:54:51.439055 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 991/1968] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:51 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:51.522700 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6af0a9b3-ce3b-4621-8f9b-9bbc5cd4b787 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:51.523345 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6af0a9b3-ce3b-4621-8f9b-9bbc5cd4b787 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:51.530122 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6af0a9b3-ce3b-4621-8f9b-9bbc5cd4b787 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:51.530574 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6af0a9b3-ce3b-4621-8f9b-9bbc5cd4b787 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:51.531353 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6af0a9b3-ce3b-4621-8f9b-9bbc5cd4b787 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:51.531793 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6af0a9b3-ce3b-4621-8f9b-9bbc5cd4b787 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:51.701114 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6af0a9b3-ce3b-4621-8f9b-9bbc5cd4b787 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:51.710473 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6af0a9b3-ce3b-4621-8f9b-9bbc5cd4b787 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.191751 Apr 06 16:54:51.711061 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 978/1969] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:51 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:52.455309 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c688e7b8-a58a-486a-955b-f5acb0213d1f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:52.455923 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c688e7b8-a58a-486a-955b-f5acb0213d1f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:52.462686 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c688e7b8-a58a-486a-955b-f5acb0213d1f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:52.463132 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c688e7b8-a58a-486a-955b-f5acb0213d1f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:52.463896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c688e7b8-a58a-486a-955b-f5acb0213d1f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:52.464326 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c688e7b8-a58a-486a-955b-f5acb0213d1f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:52.530090 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c688e7b8-a58a-486a-955b-f5acb0213d1f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:52.538617 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c688e7b8-a58a-486a-955b-f5acb0213d1f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.087677 Apr 06 16:54:52.539197 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 992/1970] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:52 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:52.728430 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4051adf4-fd4e-42c4-87c7-6be860c98cca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:52.729174 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4051adf4-fd4e-42c4-87c7-6be860c98cca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:52.736248 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4051adf4-fd4e-42c4-87c7-6be860c98cca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:52.736720 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4051adf4-fd4e-42c4-87c7-6be860c98cca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:52.737507 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4051adf4-fd4e-42c4-87c7-6be860c98cca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:52.737944 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4051adf4-fd4e-42c4-87c7-6be860c98cca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:52.874240 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4051adf4-fd4e-42c4-87c7-6be860c98cca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:52.882628 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4051adf4-fd4e-42c4-87c7-6be860c98cca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.158201 Apr 06 16:54:52.883230 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 979/1971] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:52 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:53.556665 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f1c9e2ff-9ce9-4b53-8a5a-ab780e27981c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:53.557335 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f1c9e2ff-9ce9-4b53-8a5a-ab780e27981c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:53.564520 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1c9e2ff-9ce9-4b53-8a5a-ab780e27981c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:53.565004 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1c9e2ff-9ce9-4b53-8a5a-ab780e27981c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:53.565774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1c9e2ff-9ce9-4b53-8a5a-ab780e27981c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:53.566212 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f1c9e2ff-9ce9-4b53-8a5a-ab780e27981c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:53.630329 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f1c9e2ff-9ce9-4b53-8a5a-ab780e27981c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:53.638637 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f1c9e2ff-9ce9-4b53-8a5a-ab780e27981c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.085893 Apr 06 16:54:53.639349 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 993/1972] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:53 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:53.900050 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8b748e5a-855a-4fb5-bf34-a00798a69225 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:53.900643 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8b748e5a-855a-4fb5-bf34-a00798a69225 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:53.908231 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b748e5a-855a-4fb5-bf34-a00798a69225 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:53.908700 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b748e5a-855a-4fb5-bf34-a00798a69225 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:53.909496 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b748e5a-855a-4fb5-bf34-a00798a69225 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:53.909936 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b748e5a-855a-4fb5-bf34-a00798a69225 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:54.065137 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8b748e5a-855a-4fb5-bf34-a00798a69225 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:54.073440 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8b748e5a-855a-4fb5-bf34-a00798a69225 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.177447 Apr 06 16:54:54.073990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 980/1973] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:53 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:54.656053 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d5d9b2df-a718-4a6d-b2a5-da04ea1b772b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:54.656829 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d5d9b2df-a718-4a6d-b2a5-da04ea1b772b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:54.663397 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5d9b2df-a718-4a6d-b2a5-da04ea1b772b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:54.663833 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5d9b2df-a718-4a6d-b2a5-da04ea1b772b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:54.664594 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5d9b2df-a718-4a6d-b2a5-da04ea1b772b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:54.665054 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d5d9b2df-a718-4a6d-b2a5-da04ea1b772b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:54.726862 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d5d9b2df-a718-4a6d-b2a5-da04ea1b772b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:54.735051 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d5d9b2df-a718-4a6d-b2a5-da04ea1b772b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.083085 Apr 06 16:54:54.735624 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 994/1974] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:54 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:55.094341 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-62dd55f9-0b07-4092-a350-883970e532e0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:55.094938 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-62dd55f9-0b07-4092-a350-883970e532e0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:55.101788 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62dd55f9-0b07-4092-a350-883970e532e0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:55.102247 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62dd55f9-0b07-4092-a350-883970e532e0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:55.103019 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62dd55f9-0b07-4092-a350-883970e532e0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:55.103458 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62dd55f9-0b07-4092-a350-883970e532e0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:55.247027 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-62dd55f9-0b07-4092-a350-883970e532e0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:55.255546 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-62dd55f9-0b07-4092-a350-883970e532e0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.167135 Apr 06 16:54:55.256123 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 981/1975] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:55 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:55.755088 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d8567ec8-8082-4e84-9667-fe43236c0b6f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:55.756153 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d8567ec8-8082-4e84-9667-fe43236c0b6f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:55.766739 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8567ec8-8082-4e84-9667-fe43236c0b6f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:55.767447 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8567ec8-8082-4e84-9667-fe43236c0b6f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:55.768360 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8567ec8-8082-4e84-9667-fe43236c0b6f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:55.768925 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8567ec8-8082-4e84-9667-fe43236c0b6f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:55.836586 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d8567ec8-8082-4e84-9667-fe43236c0b6f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:55.844889 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d8567ec8-8082-4e84-9667-fe43236c0b6f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.096600 Apr 06 16:54:55.845469 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 995/1976] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:55 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:56.277305 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e3f6c20c-299f-4165-a376-b0bd61559aa0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:56.277933 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e3f6c20c-299f-4165-a376-b0bd61559aa0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:56.284716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3f6c20c-299f-4165-a376-b0bd61559aa0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:56.285212 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3f6c20c-299f-4165-a376-b0bd61559aa0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:56.285969 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3f6c20c-299f-4165-a376-b0bd61559aa0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:56.286397 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3f6c20c-299f-4165-a376-b0bd61559aa0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:56.425143 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e3f6c20c-299f-4165-a376-b0bd61559aa0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:56.434535 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e3f6c20c-299f-4165-a376-b0bd61559aa0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.160747 Apr 06 16:54:56.435377 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 982/1977] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:56 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:56.863790 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fad72873-c2d1-4f4f-931e-a6c016ccde41 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:56.864420 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fad72873-c2d1-4f4f-931e-a6c016ccde41 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:56.871451 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fad72873-c2d1-4f4f-931e-a6c016ccde41 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:56.871901 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fad72873-c2d1-4f4f-931e-a6c016ccde41 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:56.872708 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fad72873-c2d1-4f4f-931e-a6c016ccde41 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:56.873170 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fad72873-c2d1-4f4f-931e-a6c016ccde41 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:56.941726 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fad72873-c2d1-4f4f-931e-a6c016ccde41 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:56.950113 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fad72873-c2d1-4f4f-931e-a6c016ccde41 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.090406 Apr 06 16:54:56.950712 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 996/1978] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:56 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:57.462229 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-aaef2f7c-9047-4ed8-8531-6cb6b52ef7dd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:57.472094 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-aaef2f7c-9047-4ed8-8531-6cb6b52ef7dd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:57.473213 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aaef2f7c-9047-4ed8-8531-6cb6b52ef7dd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:57.474029 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aaef2f7c-9047-4ed8-8531-6cb6b52ef7dd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:57.474815 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aaef2f7c-9047-4ed8-8531-6cb6b52ef7dd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:57.475257 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aaef2f7c-9047-4ed8-8531-6cb6b52ef7dd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:57.621868 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-aaef2f7c-9047-4ed8-8531-6cb6b52ef7dd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:57.631246 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-aaef2f7c-9047-4ed8-8531-6cb6b52ef7dd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.175747 Apr 06 16:54:57.631827 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 983/1979] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:57 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:57.971906 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4bbafe13-e390-4b89-b7e5-dbaf9f79a641 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:57.972500 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4bbafe13-e390-4b89-b7e5-dbaf9f79a641 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:57.979421 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bbafe13-e390-4b89-b7e5-dbaf9f79a641 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:57.979866 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bbafe13-e390-4b89-b7e5-dbaf9f79a641 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:57.980597 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bbafe13-e390-4b89-b7e5-dbaf9f79a641 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:57.981097 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4bbafe13-e390-4b89-b7e5-dbaf9f79a641 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:58.040811 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4bbafe13-e390-4b89-b7e5-dbaf9f79a641 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:58.049155 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4bbafe13-e390-4b89-b7e5-dbaf9f79a641 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.081151 Apr 06 16:54:58.049738 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 997/1980] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:57 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:58.651489 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a83f10a2-ef30-4506-9812-fd45f14024b4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:58.652140 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a83f10a2-ef30-4506-9812-fd45f14024b4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:58.659498 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a83f10a2-ef30-4506-9812-fd45f14024b4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:58.659953 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a83f10a2-ef30-4506-9812-fd45f14024b4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:58.660743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a83f10a2-ef30-4506-9812-fd45f14024b4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:58.661221 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a83f10a2-ef30-4506-9812-fd45f14024b4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:58.802552 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a83f10a2-ef30-4506-9812-fd45f14024b4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:58.810600 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a83f10a2-ef30-4506-9812-fd45f14024b4 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.164748 Apr 06 16:54:58.811172 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 984/1981] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:58 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:59.070769 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f2849ec7-4719-48e2-a8aa-88809c564f4f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:59.071658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f2849ec7-4719-48e2-a8aa-88809c564f4f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:59.080364 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2849ec7-4719-48e2-a8aa-88809c564f4f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:59.080843 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2849ec7-4719-48e2-a8aa-88809c564f4f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:59.081620 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2849ec7-4719-48e2-a8aa-88809c564f4f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:59.082043 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f2849ec7-4719-48e2-a8aa-88809c564f4f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:59.149363 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f2849ec7-4719-48e2-a8aa-88809c564f4f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:59.158168 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f2849ec7-4719-48e2-a8aa-88809c564f4f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.094072 Apr 06 16:54:59.158747 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 998/1982] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:59 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:54:59.831039 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b9b32f69-5131-4669-8840-2fa986e050e5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:54:59.831675 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b9b32f69-5131-4669-8840-2fa986e050e5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:54:59.838609 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9b32f69-5131-4669-8840-2fa986e050e5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:59.839080 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9b32f69-5131-4669-8840-2fa986e050e5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:59.839848 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9b32f69-5131-4669-8840-2fa986e050e5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:54:59.840290 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9b32f69-5131-4669-8840-2fa986e050e5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:54:59.984863 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b9b32f69-5131-4669-8840-2fa986e050e5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:54:59.992953 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b9b32f69-5131-4669-8840-2fa986e050e5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.167628 Apr 06 16:54:59.993518 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 985/1983] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:54:59 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:55:00.176121 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-453d2394-50ea-4b42-a6b8-5b6b3831bfa3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:00.176986 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-453d2394-50ea-4b42-a6b8-5b6b3831bfa3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:00.183809 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-453d2394-50ea-4b42-a6b8-5b6b3831bfa3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:00.184265 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-453d2394-50ea-4b42-a6b8-5b6b3831bfa3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:00.185091 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-453d2394-50ea-4b42-a6b8-5b6b3831bfa3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:00.185538 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-453d2394-50ea-4b42-a6b8-5b6b3831bfa3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:00.247949 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-453d2394-50ea-4b42-a6b8-5b6b3831bfa3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:00.257123 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-453d2394-50ea-4b42-a6b8-5b6b3831bfa3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.085123 Apr 06 16:55:00.257701 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 999/1984] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:00 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:01.010056 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0a39a053-dfb5-4246-86f7-08e8af22d463 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:01.010725 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0a39a053-dfb5-4246-86f7-08e8af22d463 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:01.024019 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a39a053-dfb5-4246-86f7-08e8af22d463 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:01.024915 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a39a053-dfb5-4246-86f7-08e8af22d463 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:01.027956 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a39a053-dfb5-4246-86f7-08e8af22d463 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:01.028663 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a39a053-dfb5-4246-86f7-08e8af22d463 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:01.033115 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ed2b4172-2b4e-4e3b-8567-02fbdc75c88a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:01.033575 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ed2b4172-2b4e-4e3b-8567-02fbdc75c88a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:01.039647 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed2b4172-2b4e-4e3b-8567-02fbdc75c88a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:01.040095 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed2b4172-2b4e-4e3b-8567-02fbdc75c88a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:01.040886 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed2b4172-2b4e-4e3b-8567-02fbdc75c88a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:01.041305 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed2b4172-2b4e-4e3b-8567-02fbdc75c88a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:01.065805 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ed2b4172-2b4e-4e3b-8567-02fbdc75c88a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 06 16:55:01.166934 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ed2b4172-2b4e-4e3b-8567-02fbdc75c88a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "DELETE /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 204 len: 0 microversion: 2.20 time: 0.137657 Apr 06 16:55:01.167636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1000/1985] 10.222.0.64 () {60 vars in 1279 bytes} [Wed Apr 6 16:55:01 2022] DELETE /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 06 16:55:01.177038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-52edc358-35c2-4a9b-80ab-2efe95ff9d5d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:01.177839 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-52edc358-35c2-4a9b-80ab-2efe95ff9d5d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:01.185196 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52edc358-35c2-4a9b-80ab-2efe95ff9d5d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:01.185646 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52edc358-35c2-4a9b-80ab-2efe95ff9d5d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:01.186650 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52edc358-35c2-4a9b-80ab-2efe95ff9d5d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:01.187150 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52edc358-35c2-4a9b-80ab-2efe95ff9d5d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:01.207735 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0a39a053-dfb5-4246-86f7-08e8af22d463 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:01.213059 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0a39a053-dfb5-4246-86f7-08e8af22d463 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.206835 Apr 06 16:55:01.213656 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 986/1986] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:01 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:01.228446 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-02b0fcd6-fabb-46aa-add0-853eeaa9d37b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:01.228446 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-02b0fcd6-fabb-46aa-add0-853eeaa9d37b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:01.228446 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02b0fcd6-fabb-46aa-add0-853eeaa9d37b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:01.228446 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02b0fcd6-fabb-46aa-add0-853eeaa9d37b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:01.228912 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02b0fcd6-fabb-46aa-add0-853eeaa9d37b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:01.228912 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02b0fcd6-fabb-46aa-add0-853eeaa9d37b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:01.253940 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-02b0fcd6-fabb-46aa-add0-853eeaa9d37b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 06 16:55:01.340572 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-02b0fcd6-fabb-46aa-add0-853eeaa9d37b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 204 len: 0 microversion: 2.1 time: 0.125642 Apr 06 16:55:01.341582 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 987/1987] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 16:55:01 2022] DELETE /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 06 16:55:01.345801 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-52edc358-35c2-4a9b-80ab-2efe95ff9d5d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:01.347284 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0b6ba0b7-1d8f-47ad-b6bc-3b6950d3df90 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:01.348054 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0b6ba0b7-1d8f-47ad-b6bc-3b6950d3df90 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:01.356078 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-52edc358-35c2-4a9b-80ab-2efe95ff9d5d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:01.356208 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b6ba0b7-1d8f-47ad-b6bc-3b6950d3df90 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:01.356208 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b6ba0b7-1d8f-47ad-b6bc-3b6950d3df90 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:01.356724 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b6ba0b7-1d8f-47ad-b6bc-3b6950d3df90 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:01.356904 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-52edc358-35c2-4a9b-80ab-2efe95ff9d5d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:01.357173 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b6ba0b7-1d8f-47ad-b6bc-3b6950d3df90 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:01.358072 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-52edc358-35c2-4a9b-80ab-2efe95ff9d5d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.185934 Apr 06 16:55:01.358630 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1001/1988] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:01 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:01.363717 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-684dce89-bb3e-48c8-9f00-b637c8280a20 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:01.364582 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-684dce89-bb3e-48c8-9f00-b637c8280a20 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:01.371062 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-684dce89-bb3e-48c8-9f00-b637c8280a20 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:01.371792 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-684dce89-bb3e-48c8-9f00-b637c8280a20 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:01.372569 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-684dce89-bb3e-48c8-9f00-b637c8280a20 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:01.373024 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-684dce89-bb3e-48c8-9f00-b637c8280a20 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:01.426736 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0b6ba0b7-1d8f-47ad-b6bc-3b6950d3df90 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:01.436100 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0b6ba0b7-1d8f-47ad-b6bc-3b6950d3df90 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.093259 Apr 06 16:55:01.437190 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 988/1989] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:01 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:01.515196 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-684dce89-bb3e-48c8-9f00-b637c8280a20 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:01.523573 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-684dce89-bb3e-48c8-9f00-b637c8280a20 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.163774 Apr 06 16:55:01.524126 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1002/1990] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:01 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:02.231472 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0e9c299d-6abb-4601-9151-064f44975da0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:02.232115 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0e9c299d-6abb-4601-9151-064f44975da0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:02.239924 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e9c299d-6abb-4601-9151-064f44975da0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:02.240369 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e9c299d-6abb-4601-9151-064f44975da0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:02.241184 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e9c299d-6abb-4601-9151-064f44975da0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:02.241619 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e9c299d-6abb-4601-9151-064f44975da0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:02.379675 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-23bbe2c7-f6ed-41e8-996b-13dee05675d9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:02.380274 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-23bbe2c7-f6ed-41e8-996b-13dee05675d9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:02.386852 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23bbe2c7-f6ed-41e8-996b-13dee05675d9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:02.387286 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23bbe2c7-f6ed-41e8-996b-13dee05675d9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:02.388066 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23bbe2c7-f6ed-41e8-996b-13dee05675d9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:02.388496 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23bbe2c7-f6ed-41e8-996b-13dee05675d9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:02.406221 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0e9c299d-6abb-4601-9151-064f44975da0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:02.426342 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0e9c299d-6abb-4601-9151-064f44975da0 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.198376 Apr 06 16:55:02.427403 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 989/1991] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:02 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:02.457443 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c9580af5-0479-401a-add7-86fc8fda760a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:02.458533 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c9580af5-0479-401a-add7-86fc8fda760a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:02.468440 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9580af5-0479-401a-add7-86fc8fda760a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:02.469341 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9580af5-0479-401a-add7-86fc8fda760a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:02.470619 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9580af5-0479-401a-add7-86fc8fda760a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:02.471133 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9580af5-0479-401a-add7-86fc8fda760a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:02.533608 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-23bbe2c7-f6ed-41e8-996b-13dee05675d9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:02.543169 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-23bbe2c7-f6ed-41e8-996b-13dee05675d9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:02.544994 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-23bbe2c7-f6ed-41e8-996b-13dee05675d9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:02.546291 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-23bbe2c7-f6ed-41e8-996b-13dee05675d9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.170839 Apr 06 16:55:02.546930 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1003/1992] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:02 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:02.551929 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-40d106c0-1739-4c6c-8466-4e747f9d8b62 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:02.552462 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c9580af5-0479-401a-add7-86fc8fda760a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:02.552854 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-40d106c0-1739-4c6c-8466-4e747f9d8b62 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:02.559806 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40d106c0-1739-4c6c-8466-4e747f9d8b62 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:02.560260 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40d106c0-1739-4c6c-8466-4e747f9d8b62 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:02.561082 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40d106c0-1739-4c6c-8466-4e747f9d8b62 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:02.561517 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40d106c0-1739-4c6c-8466-4e747f9d8b62 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:02.567083 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c9580af5-0479-401a-add7-86fc8fda760a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.117073 Apr 06 16:55:02.567748 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 990/1993] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:02 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:02.711262 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-40d106c0-1739-4c6c-8466-4e747f9d8b62 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:02.720365 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-40d106c0-1739-4c6c-8466-4e747f9d8b62 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.171835 Apr 06 16:55:02.721003 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1004/1994] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:02 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:03.453035 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cf85f30d-fc39-4468-a42b-a10733ce010e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:03.453924 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cf85f30d-fc39-4468-a42b-a10733ce010e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:03.462756 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf85f30d-fc39-4468-a42b-a10733ce010e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:03.463351 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf85f30d-fc39-4468-a42b-a10733ce010e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:03.464372 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf85f30d-fc39-4468-a42b-a10733ce010e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:03.464999 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf85f30d-fc39-4468-a42b-a10733ce010e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:03.573850 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e13888d3-72a3-436b-a2dd-a5ae78cef885 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:03.574443 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e13888d3-72a3-436b-a2dd-a5ae78cef885 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:03.581967 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e13888d3-72a3-436b-a2dd-a5ae78cef885 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:03.582336 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e13888d3-72a3-436b-a2dd-a5ae78cef885 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:03.583099 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e13888d3-72a3-436b-a2dd-a5ae78cef885 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:03.583523 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e13888d3-72a3-436b-a2dd-a5ae78cef885 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:03.616108 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cf85f30d-fc39-4468-a42b-a10733ce010e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:03.624201 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cf85f30d-fc39-4468-a42b-a10733ce010e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.176492 Apr 06 16:55:03.625009 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 991/1995] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:03 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:03.629258 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c65d8b9f-61ef-487a-8fc0-eadd5989c57f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:03.629853 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c65d8b9f-61ef-487a-8fc0-eadd5989c57f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:03.635972 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c65d8b9f-61ef-487a-8fc0-eadd5989c57f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:03.636410 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c65d8b9f-61ef-487a-8fc0-eadd5989c57f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:03.637191 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c65d8b9f-61ef-487a-8fc0-eadd5989c57f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:03.637620 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c65d8b9f-61ef-487a-8fc0-eadd5989c57f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:03.698953 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c65d8b9f-61ef-487a-8fc0-eadd5989c57f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:03.707067 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c65d8b9f-61ef-487a-8fc0-eadd5989c57f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.081321 Apr 06 16:55:03.708055 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 992/1996] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:03 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:03.726124 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e13888d3-72a3-436b-a2dd-a5ae78cef885 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:03.734542 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e13888d3-72a3-436b-a2dd-a5ae78cef885 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:03.736138 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e13888d3-72a3-436b-a2dd-a5ae78cef885 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:03.736938 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2dd172e7-0caf-4fcd-abec-8bee92093a37 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:03.737341 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e13888d3-72a3-436b-a2dd-a5ae78cef885 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.167446 Apr 06 16:55:03.737557 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2dd172e7-0caf-4fcd-abec-8bee92093a37 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:03.737907 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1005/1997] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:03 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:03.743502 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2dd172e7-0caf-4fcd-abec-8bee92093a37 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:03.743950 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2dd172e7-0caf-4fcd-abec-8bee92093a37 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:03.744740 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2dd172e7-0caf-4fcd-abec-8bee92093a37 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:03.745178 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2dd172e7-0caf-4fcd-abec-8bee92093a37 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:03.891862 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2dd172e7-0caf-4fcd-abec-8bee92093a37 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:03.900387 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2dd172e7-0caf-4fcd-abec-8bee92093a37 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.167375 Apr 06 16:55:03.901074 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 993/1998] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:03 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:55:04.644791 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e2a24b68-7487-4649-9131-a5395fd0b69c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:04.645433 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e2a24b68-7487-4649-9131-a5395fd0b69c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:04.652084 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2a24b68-7487-4649-9131-a5395fd0b69c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:04.652532 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2a24b68-7487-4649-9131-a5395fd0b69c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:04.653324 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2a24b68-7487-4649-9131-a5395fd0b69c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:04.653751 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2a24b68-7487-4649-9131-a5395fd0b69c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:04.724994 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1d474f2d-b8eb-476a-be01-1adff42e8d99 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:04.725985 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1d474f2d-b8eb-476a-be01-1adff42e8d99 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:04.732902 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d474f2d-b8eb-476a-be01-1adff42e8d99 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:04.733499 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d474f2d-b8eb-476a-be01-1adff42e8d99 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:04.734288 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d474f2d-b8eb-476a-be01-1adff42e8d99 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:04.734823 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d474f2d-b8eb-476a-be01-1adff42e8d99 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:04.796721 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e2a24b68-7487-4649-9131-a5395fd0b69c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:04.796918 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1d474f2d-b8eb-476a-be01-1adff42e8d99 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:04.805847 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e2a24b68-7487-4649-9131-a5395fd0b69c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.165995 Apr 06 16:55:04.806434 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1006/1999] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:04 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:04.808447 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1d474f2d-b8eb-476a-be01-1adff42e8d99 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.088078 Apr 06 16:55:04.809305 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 994/2000] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:04 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:04.811047 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-31f03bd0-d421-4f6b-bcc1-5b13047d2f14 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:04.811676 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-31f03bd0-d421-4f6b-bcc1-5b13047d2f14 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:04.818150 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31f03bd0-d421-4f6b-bcc1-5b13047d2f14 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:04.818603 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31f03bd0-d421-4f6b-bcc1-5b13047d2f14 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:04.820247 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31f03bd0-d421-4f6b-bcc1-5b13047d2f14 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:04.820247 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31f03bd0-d421-4f6b-bcc1-5b13047d2f14 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:04.918590 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dcd3be98-251e-4424-9fb7-6adb670c762e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:04.919209 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dcd3be98-251e-4424-9fb7-6adb670c762e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:04.926146 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dcd3be98-251e-4424-9fb7-6adb670c762e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:04.926599 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dcd3be98-251e-4424-9fb7-6adb670c762e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:04.927390 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dcd3be98-251e-4424-9fb7-6adb670c762e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:04.927823 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dcd3be98-251e-4424-9fb7-6adb670c762e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:04.966486 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-31f03bd0-d421-4f6b-bcc1-5b13047d2f14 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:04.975642 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-31f03bd0-d421-4f6b-bcc1-5b13047d2f14 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:04.977187 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-31f03bd0-d421-4f6b-bcc1-5b13047d2f14 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:04.978356 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-31f03bd0-d421-4f6b-bcc1-5b13047d2f14 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.171009 Apr 06 16:55:04.978957 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1007/2001] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:04 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:05.071785 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-dcd3be98-251e-4424-9fb7-6adb670c762e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:05.080160 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dcd3be98-251e-4424-9fb7-6adb670c762e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.166151 Apr 06 16:55:05.080845 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 995/2002] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:04 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:05.827482 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4d32e7a3-62db-4838-a349-1ce408269b33 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:05.828828 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4d32e7a3-62db-4838-a349-1ce408269b33 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:05.829452 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-86ac7c42-19a1-403f-b7bf-9a6c3ac8e341 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:05.830100 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-86ac7c42-19a1-403f-b7bf-9a6c3ac8e341 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:05.835368 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d32e7a3-62db-4838-a349-1ce408269b33 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:05.835814 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d32e7a3-62db-4838-a349-1ce408269b33 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:05.836580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d32e7a3-62db-4838-a349-1ce408269b33 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:05.836818 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86ac7c42-19a1-403f-b7bf-9a6c3ac8e341 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:05.837041 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d32e7a3-62db-4838-a349-1ce408269b33 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:05.837216 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86ac7c42-19a1-403f-b7bf-9a6c3ac8e341 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:05.837970 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86ac7c42-19a1-403f-b7bf-9a6c3ac8e341 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:05.838404 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86ac7c42-19a1-403f-b7bf-9a6c3ac8e341 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:05.853489 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 16:55:05.853716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 16:55:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c (ip 10.222.0.64) !!! Apr 06 16:55:05.901663 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-86ac7c42-19a1-403f-b7bf-9a6c3ac8e341 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:05.909758 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-86ac7c42-19a1-403f-b7bf-9a6c3ac8e341 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086181 Apr 06 16:55:05.910525 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 996/2003] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:05 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:05.973263 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4d32e7a3-62db-4838-a349-1ce408269b33 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:05.982207 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4d32e7a3-62db-4838-a349-1ce408269b33 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.161186 Apr 06 16:55:05.982791 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1008/2004] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:05 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:06.001326 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c80e9729-571b-4398-89c5-0e2df1234e3f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:06.002125 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c80e9729-571b-4398-89c5-0e2df1234e3f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:06.011527 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c80e9729-571b-4398-89c5-0e2df1234e3f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:06.012115 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c80e9729-571b-4398-89c5-0e2df1234e3f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:06.013312 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c80e9729-571b-4398-89c5-0e2df1234e3f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:06.013973 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c80e9729-571b-4398-89c5-0e2df1234e3f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:06.098351 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-06c916cd-417c-43db-847d-946eaa9cf743 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:06.099270 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-06c916cd-417c-43db-847d-946eaa9cf743 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:06.105956 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06c916cd-417c-43db-847d-946eaa9cf743 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:06.106411 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06c916cd-417c-43db-847d-946eaa9cf743 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:06.107203 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06c916cd-417c-43db-847d-946eaa9cf743 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:06.107640 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06c916cd-417c-43db-847d-946eaa9cf743 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:06.183834 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c80e9729-571b-4398-89c5-0e2df1234e3f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:06.196564 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c80e9729-571b-4398-89c5-0e2df1234e3f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:06.198864 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c80e9729-571b-4398-89c5-0e2df1234e3f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:06.201011 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c80e9729-571b-4398-89c5-0e2df1234e3f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.206866 Apr 06 16:55:06.201979 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 997/2005] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:05 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:06.270343 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-06c916cd-417c-43db-847d-946eaa9cf743 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:06.280392 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-06c916cd-417c-43db-847d-946eaa9cf743 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.186310 Apr 06 16:55:06.281176 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1009/2006] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:06 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:06.927443 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b6caed23-21f3-4080-b6df-98ed2c418d3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:06.928068 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b6caed23-21f3-4080-b6df-98ed2c418d3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:06.934779 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6caed23-21f3-4080-b6df-98ed2c418d3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:06.935225 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6caed23-21f3-4080-b6df-98ed2c418d3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:06.935994 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6caed23-21f3-4080-b6df-98ed2c418d3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:06.936419 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6caed23-21f3-4080-b6df-98ed2c418d3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:06.998946 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b6caed23-21f3-4080-b6df-98ed2c418d3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:07.004184 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d14d3943-501c-4c0f-b7b5-43652482acdc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:07.004824 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d14d3943-501c-4c0f-b7b5-43652482acdc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:07.007311 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b6caed23-21f3-4080-b6df-98ed2c418d3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.083864 Apr 06 16:55:07.007876 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 998/2007] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:06 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:07.011678 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d14d3943-501c-4c0f-b7b5-43652482acdc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:07.012129 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d14d3943-501c-4c0f-b7b5-43652482acdc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:07.012943 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d14d3943-501c-4c0f-b7b5-43652482acdc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:07.013387 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d14d3943-501c-4c0f-b7b5-43652482acdc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:07.157284 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d14d3943-501c-4c0f-b7b5-43652482acdc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:07.168045 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d14d3943-501c-4c0f-b7b5-43652482acdc tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.171745 Apr 06 16:55:07.168663 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1010/2008] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:06 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:55:07.227007 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b9f06532-71f9-4a92-a035-85c896ce8a99 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:07.227780 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b9f06532-71f9-4a92-a035-85c896ce8a99 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:07.237324 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9f06532-71f9-4a92-a035-85c896ce8a99 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:07.238021 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9f06532-71f9-4a92-a035-85c896ce8a99 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:07.238823 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9f06532-71f9-4a92-a035-85c896ce8a99 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:07.239261 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9f06532-71f9-4a92-a035-85c896ce8a99 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:07.298866 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-642010ff-84ed-4886-bf9d-2f29cd6a8967 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:07.299503 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-642010ff-84ed-4886-bf9d-2f29cd6a8967 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:07.308020 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-642010ff-84ed-4886-bf9d-2f29cd6a8967 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:07.308020 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-642010ff-84ed-4886-bf9d-2f29cd6a8967 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:07.308020 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-642010ff-84ed-4886-bf9d-2f29cd6a8967 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:07.308020 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-642010ff-84ed-4886-bf9d-2f29cd6a8967 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:07.382866 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b9f06532-71f9-4a92-a035-85c896ce8a99 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:07.391945 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b9f06532-71f9-4a92-a035-85c896ce8a99 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:07.393611 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b9f06532-71f9-4a92-a035-85c896ce8a99 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:07.394779 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b9f06532-71f9-4a92-a035-85c896ce8a99 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.173480 Apr 06 16:55:07.395351 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 999/2009] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:07 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:07.452541 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-642010ff-84ed-4886-bf9d-2f29cd6a8967 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:07.461916 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-642010ff-84ed-4886-bf9d-2f29cd6a8967 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.166963 Apr 06 16:55:07.462514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1011/2010] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:07 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:08.027849 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4075bd31-4142-4c13-922b-a6ed3e362017 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:08.028827 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4075bd31-4142-4c13-922b-a6ed3e362017 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:08.038805 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4075bd31-4142-4c13-922b-a6ed3e362017 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:08.039547 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4075bd31-4142-4c13-922b-a6ed3e362017 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:08.040879 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4075bd31-4142-4c13-922b-a6ed3e362017 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:08.041613 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4075bd31-4142-4c13-922b-a6ed3e362017 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:08.106810 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4075bd31-4142-4c13-922b-a6ed3e362017 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:08.116574 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4075bd31-4142-4c13-922b-a6ed3e362017 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.096584 Apr 06 16:55:08.117185 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1000/2011] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:08 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:08.185712 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6b5ddf89-32c5-4a84-82c3-f1754f14107d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:08.186305 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6b5ddf89-32c5-4a84-82c3-f1754f14107d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:08.194011 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b5ddf89-32c5-4a84-82c3-f1754f14107d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:08.194468 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b5ddf89-32c5-4a84-82c3-f1754f14107d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:08.195255 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b5ddf89-32c5-4a84-82c3-f1754f14107d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:08.195696 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b5ddf89-32c5-4a84-82c3-f1754f14107d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:08.342091 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6b5ddf89-32c5-4a84-82c3-f1754f14107d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:08.351329 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6b5ddf89-32c5-4a84-82c3-f1754f14107d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.169507 Apr 06 16:55:08.351914 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1012/2012] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:08 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:08.418448 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6fc5b577-d157-4bfe-9cb4-bbb6c0495dbd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:08.419061 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6fc5b577-d157-4bfe-9cb4-bbb6c0495dbd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:08.426385 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fc5b577-d157-4bfe-9cb4-bbb6c0495dbd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:08.426849 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fc5b577-d157-4bfe-9cb4-bbb6c0495dbd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:08.427632 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fc5b577-d157-4bfe-9cb4-bbb6c0495dbd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:08.428065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fc5b577-d157-4bfe-9cb4-bbb6c0495dbd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:08.479935 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d3e30ecf-3b11-4310-98a0-94e2d8db6654 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:08.480542 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d3e30ecf-3b11-4310-98a0-94e2d8db6654 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:08.486913 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3e30ecf-3b11-4310-98a0-94e2d8db6654 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:08.487367 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3e30ecf-3b11-4310-98a0-94e2d8db6654 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:08.488279 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3e30ecf-3b11-4310-98a0-94e2d8db6654 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:08.488728 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3e30ecf-3b11-4310-98a0-94e2d8db6654 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:08.571224 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6fc5b577-d157-4bfe-9cb4-bbb6c0495dbd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:08.580397 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6fc5b577-d157-4bfe-9cb4-bbb6c0495dbd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:08.581995 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6fc5b577-d157-4bfe-9cb4-bbb6c0495dbd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:08.583175 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6fc5b577-d157-4bfe-9cb4-bbb6c0495dbd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.168771 Apr 06 16:55:08.583775 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1001/2013] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:08 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:08.627923 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d3e30ecf-3b11-4310-98a0-94e2d8db6654 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:08.636062 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d3e30ecf-3b11-4310-98a0-94e2d8db6654 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.160047 Apr 06 16:55:08.636613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1013/2014] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:08 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:55:09.134638 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c5c76e89-3596-4c06-8b6e-17b2dbb6754f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:09.135408 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c5c76e89-3596-4c06-8b6e-17b2dbb6754f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:09.143146 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5c76e89-3596-4c06-8b6e-17b2dbb6754f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:09.143607 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5c76e89-3596-4c06-8b6e-17b2dbb6754f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:09.144462 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5c76e89-3596-4c06-8b6e-17b2dbb6754f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:09.145059 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5c76e89-3596-4c06-8b6e-17b2dbb6754f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:09.208270 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c5c76e89-3596-4c06-8b6e-17b2dbb6754f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:09.216761 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c5c76e89-3596-4c06-8b6e-17b2dbb6754f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086434 Apr 06 16:55:09.217352 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1002/2015] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:09 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:09.368949 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3e69c7ba-9a01-4f1f-9cb7-03311fadec02 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:09.369573 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3e69c7ba-9a01-4f1f-9cb7-03311fadec02 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:09.376233 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e69c7ba-9a01-4f1f-9cb7-03311fadec02 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:09.376674 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e69c7ba-9a01-4f1f-9cb7-03311fadec02 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:09.377783 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e69c7ba-9a01-4f1f-9cb7-03311fadec02 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:09.378217 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e69c7ba-9a01-4f1f-9cb7-03311fadec02 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:09.521223 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3e69c7ba-9a01-4f1f-9cb7-03311fadec02 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:09.529162 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3e69c7ba-9a01-4f1f-9cb7-03311fadec02 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.164183 Apr 06 16:55:09.529726 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1014/2016] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:09 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:09.602588 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-be8fa318-9354-4abb-b744-199856511e3a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:09.603199 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-be8fa318-9354-4abb-b744-199856511e3a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:09.609737 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be8fa318-9354-4abb-b744-199856511e3a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:09.610187 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be8fa318-9354-4abb-b744-199856511e3a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:09.610964 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be8fa318-9354-4abb-b744-199856511e3a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:09.611400 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be8fa318-9354-4abb-b744-199856511e3a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:09.653603 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-79d1dbd1-60f1-438d-a426-62f1e82d18de tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:09.654347 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-79d1dbd1-60f1-438d-a426-62f1e82d18de tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:09.660617 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79d1dbd1-60f1-438d-a426-62f1e82d18de tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:09.661182 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79d1dbd1-60f1-438d-a426-62f1e82d18de tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:09.662031 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79d1dbd1-60f1-438d-a426-62f1e82d18de tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:09.662514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-79d1dbd1-60f1-438d-a426-62f1e82d18de tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:09.749468 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-be8fa318-9354-4abb-b744-199856511e3a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:09.758670 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-be8fa318-9354-4abb-b744-199856511e3a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:09.760315 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-be8fa318-9354-4abb-b744-199856511e3a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:09.761632 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-be8fa318-9354-4abb-b744-199856511e3a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.163443 Apr 06 16:55:09.762259 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1003/2017] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:09 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:09.798102 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-79d1dbd1-60f1-438d-a426-62f1e82d18de tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:09.806477 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-79d1dbd1-60f1-438d-a426-62f1e82d18de tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.156936 Apr 06 16:55:09.807039 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1015/2018] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:09 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:10.234860 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e4ed8822-a461-4e09-b292-75905a3b1fd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:10.235512 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e4ed8822-a461-4e09-b292-75905a3b1fd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:10.244798 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4ed8822-a461-4e09-b292-75905a3b1fd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:10.245277 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4ed8822-a461-4e09-b292-75905a3b1fd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:10.246088 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4ed8822-a461-4e09-b292-75905a3b1fd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:10.246526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4ed8822-a461-4e09-b292-75905a3b1fd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:10.312522 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e4ed8822-a461-4e09-b292-75905a3b1fd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:10.321843 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e4ed8822-a461-4e09-b292-75905a3b1fd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.090919 Apr 06 16:55:10.322401 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1004/2019] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:10 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:10.547691 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7bf8acc7-42ac-400a-811b-47ef088b3628 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:10.548294 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7bf8acc7-42ac-400a-811b-47ef088b3628 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:10.555727 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bf8acc7-42ac-400a-811b-47ef088b3628 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:10.556170 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bf8acc7-42ac-400a-811b-47ef088b3628 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:10.556978 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bf8acc7-42ac-400a-811b-47ef088b3628 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:10.557413 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bf8acc7-42ac-400a-811b-47ef088b3628 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:10.697245 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7bf8acc7-42ac-400a-811b-47ef088b3628 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:10.705143 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7bf8acc7-42ac-400a-811b-47ef088b3628 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.161888 Apr 06 16:55:10.705753 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1016/2020] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:10 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:10.779641 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8851ef02-6183-4f9b-94ba-5162980c37c8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:10.780504 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8851ef02-6183-4f9b-94ba-5162980c37c8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:10.787198 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8851ef02-6183-4f9b-94ba-5162980c37c8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:10.787646 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8851ef02-6183-4f9b-94ba-5162980c37c8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:10.788430 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8851ef02-6183-4f9b-94ba-5162980c37c8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:10.788907 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8851ef02-6183-4f9b-94ba-5162980c37c8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:10.823768 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-36f375e4-90de-4354-b972-932a99908a7c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:10.824307 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-36f375e4-90de-4354-b972-932a99908a7c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:10.831202 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36f375e4-90de-4354-b972-932a99908a7c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:10.831973 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36f375e4-90de-4354-b972-932a99908a7c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:10.832962 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36f375e4-90de-4354-b972-932a99908a7c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:10.833397 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36f375e4-90de-4354-b972-932a99908a7c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:10.926872 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8851ef02-6183-4f9b-94ba-5162980c37c8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:10.935414 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8851ef02-6183-4f9b-94ba-5162980c37c8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:10.936938 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8851ef02-6183-4f9b-94ba-5162980c37c8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:10.938152 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8851ef02-6183-4f9b-94ba-5162980c37c8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.162510 Apr 06 16:55:10.938707 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1005/2021] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:10 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:10.973685 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-36f375e4-90de-4354-b972-932a99908a7c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:10.982118 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-36f375e4-90de-4354-b972-932a99908a7c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.162527 Apr 06 16:55:10.982703 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1017/2022] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:10 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:11.340040 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dd8c9305-63f3-4dd9-9e05-f733cdebfefb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:11.340653 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dd8c9305-63f3-4dd9-9e05-f733cdebfefb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:11.347704 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd8c9305-63f3-4dd9-9e05-f733cdebfefb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:11.348152 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd8c9305-63f3-4dd9-9e05-f733cdebfefb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:11.349326 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd8c9305-63f3-4dd9-9e05-f733cdebfefb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:11.349766 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd8c9305-63f3-4dd9-9e05-f733cdebfefb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:11.412079 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-dd8c9305-63f3-4dd9-9e05-f733cdebfefb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:11.420721 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dd8c9305-63f3-4dd9-9e05-f733cdebfefb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.084720 Apr 06 16:55:11.421337 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1006/2023] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:11 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:11.723421 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f5f9404b-f5d0-475b-bf5a-765fa34c80e8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:11.724425 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f5f9404b-f5d0-475b-bf5a-765fa34c80e8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:11.730809 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5f9404b-f5d0-475b-bf5a-765fa34c80e8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:11.731255 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5f9404b-f5d0-475b-bf5a-765fa34c80e8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:11.732026 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5f9404b-f5d0-475b-bf5a-765fa34c80e8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:11.732436 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5f9404b-f5d0-475b-bf5a-765fa34c80e8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:11.890655 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f5f9404b-f5d0-475b-bf5a-765fa34c80e8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:11.901420 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f5f9404b-f5d0-475b-bf5a-765fa34c80e8 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.182431 Apr 06 16:55:11.902016 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1018/2024] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:11 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:11.957913 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-afa758b2-dcf2-4697-81d7-267f6f5a44f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:11.958516 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-afa758b2-dcf2-4697-81d7-267f6f5a44f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:11.964803 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afa758b2-dcf2-4697-81d7-267f6f5a44f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:11.965255 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afa758b2-dcf2-4697-81d7-267f6f5a44f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:11.966052 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afa758b2-dcf2-4697-81d7-267f6f5a44f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:11.966477 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afa758b2-dcf2-4697-81d7-267f6f5a44f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:12.002064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4c31247b-016b-4a55-b21e-44ee305a4260 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:12.002789 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4c31247b-016b-4a55-b21e-44ee305a4260 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:12.009619 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c31247b-016b-4a55-b21e-44ee305a4260 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:12.010073 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c31247b-016b-4a55-b21e-44ee305a4260 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:12.010831 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c31247b-016b-4a55-b21e-44ee305a4260 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:12.011257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4c31247b-016b-4a55-b21e-44ee305a4260 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:12.110820 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-afa758b2-dcf2-4697-81d7-267f6f5a44f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:12.119925 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-afa758b2-dcf2-4697-81d7-267f6f5a44f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:12.121445 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-afa758b2-dcf2-4697-81d7-267f6f5a44f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:12.122626 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-afa758b2-dcf2-4697-81d7-267f6f5a44f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.168880 Apr 06 16:55:12.123194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1007/2025] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:11 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:12.157934 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4c31247b-016b-4a55-b21e-44ee305a4260 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:12.166798 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4c31247b-016b-4a55-b21e-44ee305a4260 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.168702 Apr 06 16:55:12.167349 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1019/2026] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:11 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:12.438189 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-884a5fe8-e033-493d-818d-dc84010b25f6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:12.438905 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-884a5fe8-e033-493d-818d-dc84010b25f6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:12.445968 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-884a5fe8-e033-493d-818d-dc84010b25f6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:12.446415 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-884a5fe8-e033-493d-818d-dc84010b25f6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:12.447190 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-884a5fe8-e033-493d-818d-dc84010b25f6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:12.447620 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-884a5fe8-e033-493d-818d-dc84010b25f6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:12.507832 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-884a5fe8-e033-493d-818d-dc84010b25f6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:12.515916 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-884a5fe8-e033-493d-818d-dc84010b25f6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.081671 Apr 06 16:55:12.516477 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1008/2027] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:12 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:12.919381 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-95ec7e00-0452-4e1f-abba-a0178a4ee70f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:12.919961 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-95ec7e00-0452-4e1f-abba-a0178a4ee70f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:12.927269 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95ec7e00-0452-4e1f-abba-a0178a4ee70f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:12.927820 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95ec7e00-0452-4e1f-abba-a0178a4ee70f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:12.928604 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95ec7e00-0452-4e1f-abba-a0178a4ee70f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:12.929075 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95ec7e00-0452-4e1f-abba-a0178a4ee70f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:13.067483 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-95ec7e00-0452-4e1f-abba-a0178a4ee70f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:13.081812 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-95ec7e00-0452-4e1f-abba-a0178a4ee70f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.166272 Apr 06 16:55:13.082429 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1020/2028] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:12 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:13.141515 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-123e7a85-f468-4ebe-861c-43386299432c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:13.142289 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-123e7a85-f468-4ebe-861c-43386299432c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:13.148652 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-123e7a85-f468-4ebe-861c-43386299432c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:13.149098 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-123e7a85-f468-4ebe-861c-43386299432c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:13.150082 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-123e7a85-f468-4ebe-861c-43386299432c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:13.150689 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-123e7a85-f468-4ebe-861c-43386299432c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:13.187244 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6b9c0410-66f0-4f7c-ba1a-edd9e99f4c4a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:13.187974 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6b9c0410-66f0-4f7c-ba1a-edd9e99f4c4a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:13.195487 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b9c0410-66f0-4f7c-ba1a-edd9e99f4c4a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:13.195928 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b9c0410-66f0-4f7c-ba1a-edd9e99f4c4a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:13.196742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b9c0410-66f0-4f7c-ba1a-edd9e99f4c4a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:13.197178 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b9c0410-66f0-4f7c-ba1a-edd9e99f4c4a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:13.317316 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-123e7a85-f468-4ebe-861c-43386299432c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:13.326556 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-123e7a85-f468-4ebe-861c-43386299432c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:13.329194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-123e7a85-f468-4ebe-861c-43386299432c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:13.330697 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-123e7a85-f468-4ebe-861c-43386299432c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.193363 Apr 06 16:55:13.331450 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1009/2029] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:13 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:13.358752 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6b9c0410-66f0-4f7c-ba1a-edd9e99f4c4a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:13.367735 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6b9c0410-66f0-4f7c-ba1a-edd9e99f4c4a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.186386 Apr 06 16:55:13.368747 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1021/2030] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:13 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:13.533769 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-639ccfa4-e8a5-48b5-b9f6-8acef1578796 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:13.534385 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-639ccfa4-e8a5-48b5-b9f6-8acef1578796 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:13.541428 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-639ccfa4-e8a5-48b5-b9f6-8acef1578796 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:13.541896 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-639ccfa4-e8a5-48b5-b9f6-8acef1578796 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:13.542688 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-639ccfa4-e8a5-48b5-b9f6-8acef1578796 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:13.543114 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-639ccfa4-e8a5-48b5-b9f6-8acef1578796 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:13.608356 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-639ccfa4-e8a5-48b5-b9f6-8acef1578796 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:13.616978 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-639ccfa4-e8a5-48b5-b9f6-8acef1578796 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.087289 Apr 06 16:55:13.617526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1010/2031] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:13 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:14.100131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fc611379-3880-4165-8bbd-148c960b338e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:14.100755 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fc611379-3880-4165-8bbd-148c960b338e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:14.107434 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc611379-3880-4165-8bbd-148c960b338e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:14.107893 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc611379-3880-4165-8bbd-148c960b338e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:14.108667 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc611379-3880-4165-8bbd-148c960b338e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:14.109137 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc611379-3880-4165-8bbd-148c960b338e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:14.245276 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fc611379-3880-4165-8bbd-148c960b338e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:14.253911 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fc611379-3880-4165-8bbd-148c960b338e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.158262 Apr 06 16:55:14.254486 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1022/2032] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:14 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:14.350428 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bfa38651-92ab-4008-a5ff-59dccc2e5636 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:14.350956 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bfa38651-92ab-4008-a5ff-59dccc2e5636 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:14.357587 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bfa38651-92ab-4008-a5ff-59dccc2e5636 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:14.358037 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bfa38651-92ab-4008-a5ff-59dccc2e5636 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:14.358814 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bfa38651-92ab-4008-a5ff-59dccc2e5636 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:14.359253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bfa38651-92ab-4008-a5ff-59dccc2e5636 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:14.386877 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-963a9b0d-3368-43b0-8c02-b664af8664ac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:14.387630 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-963a9b0d-3368-43b0-8c02-b664af8664ac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:14.395189 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-963a9b0d-3368-43b0-8c02-b664af8664ac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:14.395647 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-963a9b0d-3368-43b0-8c02-b664af8664ac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:14.396442 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-963a9b0d-3368-43b0-8c02-b664af8664ac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:14.396991 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-963a9b0d-3368-43b0-8c02-b664af8664ac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:14.501684 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-bfa38651-92ab-4008-a5ff-59dccc2e5636 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:14.511442 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-bfa38651-92ab-4008-a5ff-59dccc2e5636 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:14.512960 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-bfa38651-92ab-4008-a5ff-59dccc2e5636 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:14.514139 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bfa38651-92ab-4008-a5ff-59dccc2e5636 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.168341 Apr 06 16:55:14.514705 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1011/2033] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:14 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:14.550660 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-963a9b0d-3368-43b0-8c02-b664af8664ac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:14.560015 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-963a9b0d-3368-43b0-8c02-b664af8664ac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.177058 Apr 06 16:55:14.560617 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1023/2034] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:14 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:14.638513 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2c47f4cd-88fe-4146-8e00-499ce9f54489 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:14.639630 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2c47f4cd-88fe-4146-8e00-499ce9f54489 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:14.649062 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c47f4cd-88fe-4146-8e00-499ce9f54489 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:14.649515 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c47f4cd-88fe-4146-8e00-499ce9f54489 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:14.650320 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c47f4cd-88fe-4146-8e00-499ce9f54489 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:14.650751 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c47f4cd-88fe-4146-8e00-499ce9f54489 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:14.718570 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2c47f4cd-88fe-4146-8e00-499ce9f54489 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:14.728471 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2c47f4cd-88fe-4146-8e00-499ce9f54489 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.097420 Apr 06 16:55:14.729082 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1012/2035] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:14 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:15.271785 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-855bb33c-42dc-45a8-8ba2-bc165d2e4107 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:15.272388 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-855bb33c-42dc-45a8-8ba2-bc165d2e4107 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:15.279791 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-855bb33c-42dc-45a8-8ba2-bc165d2e4107 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:15.280245 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-855bb33c-42dc-45a8-8ba2-bc165d2e4107 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:15.281057 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-855bb33c-42dc-45a8-8ba2-bc165d2e4107 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:15.281498 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-855bb33c-42dc-45a8-8ba2-bc165d2e4107 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:15.419744 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-855bb33c-42dc-45a8-8ba2-bc165d2e4107 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:15.428295 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-855bb33c-42dc-45a8-8ba2-bc165d2e4107 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.160499 Apr 06 16:55:15.428883 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1024/2036] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:15 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:15.532772 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d21e38d9-e646-4f35-a8e2-246409f578e2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:15.533310 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d21e38d9-e646-4f35-a8e2-246409f578e2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:15.539904 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d21e38d9-e646-4f35-a8e2-246409f578e2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:15.540365 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d21e38d9-e646-4f35-a8e2-246409f578e2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:15.541215 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d21e38d9-e646-4f35-a8e2-246409f578e2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:15.541643 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d21e38d9-e646-4f35-a8e2-246409f578e2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:15.638261 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5d220950-7bbb-46d8-87ec-e702f0fca731 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:15.639017 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5d220950-7bbb-46d8-87ec-e702f0fca731 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:15.645420 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d220950-7bbb-46d8-87ec-e702f0fca731 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:15.646349 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d220950-7bbb-46d8-87ec-e702f0fca731 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:15.647072 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d220950-7bbb-46d8-87ec-e702f0fca731 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:15.647492 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d220950-7bbb-46d8-87ec-e702f0fca731 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:15.682250 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d21e38d9-e646-4f35-a8e2-246409f578e2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:15.691002 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d21e38d9-e646-4f35-a8e2-246409f578e2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:15.692514 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d21e38d9-e646-4f35-a8e2-246409f578e2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:15.693740 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d21e38d9-e646-4f35-a8e2-246409f578e2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.165061 Apr 06 16:55:15.694310 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1013/2037] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:15 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:15.751207 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7b52ad67-ddc9-4570-afa2-71ca49364c91 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:15.751803 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7b52ad67-ddc9-4570-afa2-71ca49364c91 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:15.758072 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b52ad67-ddc9-4570-afa2-71ca49364c91 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:15.758526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b52ad67-ddc9-4570-afa2-71ca49364c91 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:15.759297 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b52ad67-ddc9-4570-afa2-71ca49364c91 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:15.759728 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b52ad67-ddc9-4570-afa2-71ca49364c91 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:15.781017 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5d220950-7bbb-46d8-87ec-e702f0fca731 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:15.789680 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5d220950-7bbb-46d8-87ec-e702f0fca731 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.155302 Apr 06 16:55:15.790183 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1025/2038] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:15 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:15.820044 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7b52ad67-ddc9-4570-afa2-71ca49364c91 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:15.828275 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7b52ad67-ddc9-4570-afa2-71ca49364c91 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.080970 Apr 06 16:55:15.828879 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1014/2039] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:15 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:16.449214 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e21dbdcb-f19b-4967-bda9-ff2d34c9ea8a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:16.450216 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e21dbdcb-f19b-4967-bda9-ff2d34c9ea8a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:16.459098 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e21dbdcb-f19b-4967-bda9-ff2d34c9ea8a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:16.459551 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e21dbdcb-f19b-4967-bda9-ff2d34c9ea8a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:16.460326 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e21dbdcb-f19b-4967-bda9-ff2d34c9ea8a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:16.460796 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e21dbdcb-f19b-4967-bda9-ff2d34c9ea8a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:16.600283 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e21dbdcb-f19b-4967-bda9-ff2d34c9ea8a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:16.612510 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e21dbdcb-f19b-4967-bda9-ff2d34c9ea8a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.169859 Apr 06 16:55:16.613152 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1026/2040] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:16 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:16.716593 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f8d15f5f-4948-47f3-942c-7920f3aaa5ec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:16.717555 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f8d15f5f-4948-47f3-942c-7920f3aaa5ec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:16.726203 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f8d15f5f-4948-47f3-942c-7920f3aaa5ec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:16.726657 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f8d15f5f-4948-47f3-942c-7920f3aaa5ec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:16.727444 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f8d15f5f-4948-47f3-942c-7920f3aaa5ec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:16.727880 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f8d15f5f-4948-47f3-942c-7920f3aaa5ec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:16.811730 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4d9c5fd1-f2b6-44d4-9a44-72586a9bef99 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:16.812871 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4d9c5fd1-f2b6-44d4-9a44-72586a9bef99 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:16.823625 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d9c5fd1-f2b6-44d4-9a44-72586a9bef99 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:16.824302 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d9c5fd1-f2b6-44d4-9a44-72586a9bef99 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:16.825971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d9c5fd1-f2b6-44d4-9a44-72586a9bef99 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:16.826281 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d9c5fd1-f2b6-44d4-9a44-72586a9bef99 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:16.881297 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f8d15f5f-4948-47f3-942c-7920f3aaa5ec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:16.890115 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f8d15f5f-4948-47f3-942c-7920f3aaa5ec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:16.891607 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f8d15f5f-4948-47f3-942c-7920f3aaa5ec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:16.892824 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f8d15f5f-4948-47f3-942c-7920f3aaa5ec tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.182818 Apr 06 16:55:16.893850 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1015/2041] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:16 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:16.899901 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2523a469-6f54-4ffb-b321-83979087aafc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:16.900524 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2523a469-6f54-4ffb-b321-83979087aafc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:16.908347 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2523a469-6f54-4ffb-b321-83979087aafc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:16.908900 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2523a469-6f54-4ffb-b321-83979087aafc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:16.909687 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2523a469-6f54-4ffb-b321-83979087aafc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:16.910117 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2523a469-6f54-4ffb-b321-83979087aafc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:16.963060 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4d9c5fd1-f2b6-44d4-9a44-72586a9bef99 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:16.969698 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2523a469-6f54-4ffb-b321-83979087aafc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:16.971226 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4d9c5fd1-f2b6-44d4-9a44-72586a9bef99 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.167693 Apr 06 16:55:16.972003 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1027/2042] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:16 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:16.978191 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2523a469-6f54-4ffb-b321-83979087aafc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.083334 Apr 06 16:55:16.978754 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1016/2043] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:16 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:17.634375 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-716f46d6-ec7b-4b34-a7af-2add7c0a3e4c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:17.635441 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-716f46d6-ec7b-4b34-a7af-2add7c0a3e4c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:17.646000 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-716f46d6-ec7b-4b34-a7af-2add7c0a3e4c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:17.646730 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-716f46d6-ec7b-4b34-a7af-2add7c0a3e4c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:17.647976 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-716f46d6-ec7b-4b34-a7af-2add7c0a3e4c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:17.648719 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-716f46d6-ec7b-4b34-a7af-2add7c0a3e4c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:17.799061 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-716f46d6-ec7b-4b34-a7af-2add7c0a3e4c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:17.807146 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-716f46d6-ec7b-4b34-a7af-2add7c0a3e4c tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.179825 Apr 06 16:55:17.807766 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1028/2044] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:17 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:17.912549 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fd4d15b8-013b-4e6b-86b2-49540c5277f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:17.913241 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fd4d15b8-013b-4e6b-86b2-49540c5277f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:17.920602 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd4d15b8-013b-4e6b-86b2-49540c5277f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:17.921267 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd4d15b8-013b-4e6b-86b2-49540c5277f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:17.922054 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd4d15b8-013b-4e6b-86b2-49540c5277f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:17.922491 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd4d15b8-013b-4e6b-86b2-49540c5277f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:17.990073 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d21d970c-b34e-40c6-9f0d-b76759427347 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:17.990688 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d21d970c-b34e-40c6-9f0d-b76759427347 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:17.998880 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d21d970c-b34e-40c6-9f0d-b76759427347 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:17.998880 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d21d970c-b34e-40c6-9f0d-b76759427347 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:17.998880 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d21d970c-b34e-40c6-9f0d-b76759427347 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:17.998880 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d21d970c-b34e-40c6-9f0d-b76759427347 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:18.067267 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fd4d15b8-013b-4e6b-86b2-49540c5277f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:18.076259 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fd4d15b8-013b-4e6b-86b2-49540c5277f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:18.077968 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fd4d15b8-013b-4e6b-86b2-49540c5277f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:18.079184 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fd4d15b8-013b-4e6b-86b2-49540c5277f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.171248 Apr 06 16:55:18.079748 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1017/2045] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:17 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:18.084549 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d8b9bc2e-c3c6-4590-b477-5da847ad6787 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:18.085186 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d8b9bc2e-c3c6-4590-b477-5da847ad6787 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:18.091196 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8b9bc2e-c3c6-4590-b477-5da847ad6787 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:18.091642 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8b9bc2e-c3c6-4590-b477-5da847ad6787 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:18.092417 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8b9bc2e-c3c6-4590-b477-5da847ad6787 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:18.092883 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8b9bc2e-c3c6-4590-b477-5da847ad6787 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:18.135746 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 16:55:18.136015 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 16:55:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c (ip 10.222.0.64) !!! Apr 06 16:55:18.154047 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d21d970c-b34e-40c6-9f0d-b76759427347 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:18.158573 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d8b9bc2e-c3c6-4590-b477-5da847ad6787 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:18.162432 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d21d970c-b34e-40c6-9f0d-b76759427347 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.177341 Apr 06 16:55:18.163072 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1029/2046] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:17 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:18.167095 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d8b9bc2e-c3c6-4590-b477-5da847ad6787 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086355 Apr 06 16:55:18.167667 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1018/2047] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:18 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:18.829227 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-80a6941f-ac50-46ac-8ec6-8df50433e866 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:18.830178 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-80a6941f-ac50-46ac-8ec6-8df50433e866 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:18.838282 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80a6941f-ac50-46ac-8ec6-8df50433e866 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:18.838717 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80a6941f-ac50-46ac-8ec6-8df50433e866 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:18.839478 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80a6941f-ac50-46ac-8ec6-8df50433e866 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:18.839903 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80a6941f-ac50-46ac-8ec6-8df50433e866 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:18.997294 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-80a6941f-ac50-46ac-8ec6-8df50433e866 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:19.006107 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-80a6941f-ac50-46ac-8ec6-8df50433e866 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.183728 Apr 06 16:55:19.006684 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1030/2048] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:18 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:55:19.100953 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-659a876f-d183-48c8-9227-acb8af1debe8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:19.101567 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-659a876f-d183-48c8-9227-acb8af1debe8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:19.108797 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-659a876f-d183-48c8-9227-acb8af1debe8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:19.109279 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-659a876f-d183-48c8-9227-acb8af1debe8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:19.110119 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-659a876f-d183-48c8-9227-acb8af1debe8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:19.110595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-659a876f-d183-48c8-9227-acb8af1debe8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:19.179645 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2789085d-959b-401b-b9b0-13ec993f5762 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:19.180250 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2789085d-959b-401b-b9b0-13ec993f5762 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:19.186069 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2789085d-959b-401b-b9b0-13ec993f5762 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:19.186543 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2789085d-959b-401b-b9b0-13ec993f5762 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:19.187304 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2789085d-959b-401b-b9b0-13ec993f5762 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:19.187727 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2789085d-959b-401b-b9b0-13ec993f5762 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:19.259912 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-659a876f-d183-48c8-9227-acb8af1debe8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:19.273138 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-659a876f-d183-48c8-9227-acb8af1debe8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:19.274632 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-659a876f-d183-48c8-9227-acb8af1debe8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:19.275828 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-659a876f-d183-48c8-9227-acb8af1debe8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.180707 Apr 06 16:55:19.276380 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1019/2049] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:19 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:19.280896 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-49a06b11-7d66-4687-af9d-afc7061d0bc3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:19.281495 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-49a06b11-7d66-4687-af9d-afc7061d0bc3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:19.288239 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49a06b11-7d66-4687-af9d-afc7061d0bc3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:19.288707 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49a06b11-7d66-4687-af9d-afc7061d0bc3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:19.289476 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49a06b11-7d66-4687-af9d-afc7061d0bc3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:19.289915 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49a06b11-7d66-4687-af9d-afc7061d0bc3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:19.329828 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2789085d-959b-401b-b9b0-13ec993f5762 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:19.338339 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2789085d-959b-401b-b9b0-13ec993f5762 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.162638 Apr 06 16:55:19.338931 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1031/2050] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:19 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:55:19.353559 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-49a06b11-7d66-4687-af9d-afc7061d0bc3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:19.361339 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-49a06b11-7d66-4687-af9d-afc7061d0bc3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.083956 Apr 06 16:55:19.361874 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1020/2051] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:19 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:20.025263 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2af36049-575d-4db3-b6bf-067900d72dc9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:20.025884 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2af36049-575d-4db3-b6bf-067900d72dc9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:20.034270 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2af36049-575d-4db3-b6bf-067900d72dc9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:20.035166 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2af36049-575d-4db3-b6bf-067900d72dc9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:20.036444 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2af36049-575d-4db3-b6bf-067900d72dc9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:20.037203 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2af36049-575d-4db3-b6bf-067900d72dc9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:20.185579 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2af36049-575d-4db3-b6bf-067900d72dc9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:20.193909 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2af36049-575d-4db3-b6bf-067900d72dc9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.173307 Apr 06 16:55:20.194467 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1032/2052] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:20 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:20.294627 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1bd81cb8-6c90-49a3-82c5-a9f3f98311b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:20.295192 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1bd81cb8-6c90-49a3-82c5-a9f3f98311b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:20.302241 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1bd81cb8-6c90-49a3-82c5-a9f3f98311b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:20.302664 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1bd81cb8-6c90-49a3-82c5-a9f3f98311b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:20.303942 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1bd81cb8-6c90-49a3-82c5-a9f3f98311b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:20.304378 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1bd81cb8-6c90-49a3-82c5-a9f3f98311b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:20.356244 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-19e6c129-43d4-45a1-ab4f-9f7e77f6a19f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:20.357001 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-19e6c129-43d4-45a1-ab4f-9f7e77f6a19f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:20.363270 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19e6c129-43d4-45a1-ab4f-9f7e77f6a19f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:20.363970 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19e6c129-43d4-45a1-ab4f-9f7e77f6a19f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:20.364926 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19e6c129-43d4-45a1-ab4f-9f7e77f6a19f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:20.365364 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19e6c129-43d4-45a1-ab4f-9f7e77f6a19f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:20.446633 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1bd81cb8-6c90-49a3-82c5-a9f3f98311b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:20.455772 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1bd81cb8-6c90-49a3-82c5-a9f3f98311b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:20.457468 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1bd81cb8-6c90-49a3-82c5-a9f3f98311b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:20.458690 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1bd81cb8-6c90-49a3-82c5-a9f3f98311b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.168117 Apr 06 16:55:20.459261 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1021/2053] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:20 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:20.475558 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ace1df90-81e0-42e7-b485-67660f4f632f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:20.476340 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ace1df90-81e0-42e7-b485-67660f4f632f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:20.482508 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ace1df90-81e0-42e7-b485-67660f4f632f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:20.482957 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ace1df90-81e0-42e7-b485-67660f4f632f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:20.483750 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ace1df90-81e0-42e7-b485-67660f4f632f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:20.484184 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ace1df90-81e0-42e7-b485-67660f4f632f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:20.514040 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-19e6c129-43d4-45a1-ab4f-9f7e77f6a19f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:20.523723 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-19e6c129-43d4-45a1-ab4f-9f7e77f6a19f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.171326 Apr 06 16:55:20.524519 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1033/2054] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:20 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:20.551219 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ace1df90-81e0-42e7-b485-67660f4f632f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:20.560056 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ace1df90-81e0-42e7-b485-67660f4f632f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.090026 Apr 06 16:55:20.560632 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1022/2055] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:20 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:21.211649 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0689019e-22f5-41be-b90f-80f46b91f78e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:21.212293 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0689019e-22f5-41be-b90f-80f46b91f78e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:21.219150 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0689019e-22f5-41be-b90f-80f46b91f78e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:21.219595 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0689019e-22f5-41be-b90f-80f46b91f78e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:21.220355 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0689019e-22f5-41be-b90f-80f46b91f78e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:21.220819 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0689019e-22f5-41be-b90f-80f46b91f78e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:21.357714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0689019e-22f5-41be-b90f-80f46b91f78e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:21.366269 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0689019e-22f5-41be-b90f-80f46b91f78e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.158787 Apr 06 16:55:21.366847 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1034/2056] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:21 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:21.478893 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e963bd83-9f15-4e67-b222-e3a4abe5851a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:21.479472 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e963bd83-9f15-4e67-b222-e3a4abe5851a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:21.486215 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e963bd83-9f15-4e67-b222-e3a4abe5851a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:21.486664 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e963bd83-9f15-4e67-b222-e3a4abe5851a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:21.487427 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e963bd83-9f15-4e67-b222-e3a4abe5851a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:21.487862 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e963bd83-9f15-4e67-b222-e3a4abe5851a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:21.540599 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b4d61ebf-b951-4ba2-abdc-ae0f6bb9d051 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:21.541271 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b4d61ebf-b951-4ba2-abdc-ae0f6bb9d051 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:21.547734 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4d61ebf-b951-4ba2-abdc-ae0f6bb9d051 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:21.548189 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4d61ebf-b951-4ba2-abdc-ae0f6bb9d051 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:21.549004 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4d61ebf-b951-4ba2-abdc-ae0f6bb9d051 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:21.549450 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b4d61ebf-b951-4ba2-abdc-ae0f6bb9d051 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:21.627210 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e963bd83-9f15-4e67-b222-e3a4abe5851a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:21.636165 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e963bd83-9f15-4e67-b222-e3a4abe5851a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:21.637693 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e963bd83-9f15-4e67-b222-e3a4abe5851a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:21.638874 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e963bd83-9f15-4e67-b222-e3a4abe5851a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.164521 Apr 06 16:55:21.639442 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1023/2057] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:21 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:21.643828 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dcd573e0-774c-4bba-b4d3-5402a2fc17aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:21.644592 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dcd573e0-774c-4bba-b4d3-5402a2fc17aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:21.651028 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dcd573e0-774c-4bba-b4d3-5402a2fc17aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:21.651478 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dcd573e0-774c-4bba-b4d3-5402a2fc17aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:21.652230 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dcd573e0-774c-4bba-b4d3-5402a2fc17aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:21.652662 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dcd573e0-774c-4bba-b4d3-5402a2fc17aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:21.686380 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b4d61ebf-b951-4ba2-abdc-ae0f6bb9d051 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:21.694870 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b4d61ebf-b951-4ba2-abdc-ae0f6bb9d051 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.158188 Apr 06 16:55:21.695452 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1035/2058] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:21 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:21.712212 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-dcd573e0-774c-4bba-b4d3-5402a2fc17aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:21.720406 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dcd573e0-774c-4bba-b4d3-5402a2fc17aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.080022 Apr 06 16:55:21.721050 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1024/2059] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:21 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:22.383837 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f584022c-4476-41a5-b375-7f1d594061a9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:22.384429 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f584022c-4476-41a5-b375-7f1d594061a9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:22.391107 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f584022c-4476-41a5-b375-7f1d594061a9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:22.391556 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f584022c-4476-41a5-b375-7f1d594061a9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:22.392321 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f584022c-4476-41a5-b375-7f1d594061a9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:22.392812 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f584022c-4476-41a5-b375-7f1d594061a9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:22.539138 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f584022c-4476-41a5-b375-7f1d594061a9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:22.546988 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f584022c-4476-41a5-b375-7f1d594061a9 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.167150 Apr 06 16:55:22.547531 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1036/2060] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:22 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:22.659414 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0c4b41ca-d2d9-4571-8247-b5370aee7c59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:22.660280 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0c4b41ca-d2d9-4571-8247-b5370aee7c59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:22.670173 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c4b41ca-d2d9-4571-8247-b5370aee7c59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:22.670877 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c4b41ca-d2d9-4571-8247-b5370aee7c59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:22.672112 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c4b41ca-d2d9-4571-8247-b5370aee7c59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:22.672737 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c4b41ca-d2d9-4571-8247-b5370aee7c59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:22.711756 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-faa5699f-e0e4-47c7-9385-b292405853b1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:22.712500 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-faa5699f-e0e4-47c7-9385-b292405853b1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:22.719233 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-faa5699f-e0e4-47c7-9385-b292405853b1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:22.719812 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-faa5699f-e0e4-47c7-9385-b292405853b1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:22.720665 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-faa5699f-e0e4-47c7-9385-b292405853b1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:22.721144 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-faa5699f-e0e4-47c7-9385-b292405853b1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:22.832379 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0c4b41ca-d2d9-4571-8247-b5370aee7c59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:22.841778 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0c4b41ca-d2d9-4571-8247-b5370aee7c59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:22.843258 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0c4b41ca-d2d9-4571-8247-b5370aee7c59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:22.844489 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0c4b41ca-d2d9-4571-8247-b5370aee7c59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.190015 Apr 06 16:55:22.845623 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1025/2061] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:22 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:22.851854 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-178a96c0-b289-4532-b57b-bc38ecaa21bb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:22.852476 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-178a96c0-b289-4532-b57b-bc38ecaa21bb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:22.859338 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-178a96c0-b289-4532-b57b-bc38ecaa21bb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:22.859790 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-178a96c0-b289-4532-b57b-bc38ecaa21bb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:22.860761 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-178a96c0-b289-4532-b57b-bc38ecaa21bb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:22.861224 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-178a96c0-b289-4532-b57b-bc38ecaa21bb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:22.869080 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-faa5699f-e0e4-47c7-9385-b292405853b1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:22.880002 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-faa5699f-e0e4-47c7-9385-b292405853b1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.172002 Apr 06 16:55:22.880822 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1037/2062] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:22 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:55:22.934601 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-178a96c0-b289-4532-b57b-bc38ecaa21bb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:22.943543 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-178a96c0-b289-4532-b57b-bc38ecaa21bb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.096791 Apr 06 16:55:22.944132 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1026/2063] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:22 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:23.564847 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a3549627-daa3-4be7-8a7f-adfcfbb4718a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:23.565474 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a3549627-daa3-4be7-8a7f-adfcfbb4718a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:23.572257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3549627-daa3-4be7-8a7f-adfcfbb4718a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:23.572710 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3549627-daa3-4be7-8a7f-adfcfbb4718a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:23.573483 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3549627-daa3-4be7-8a7f-adfcfbb4718a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:23.573938 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a3549627-daa3-4be7-8a7f-adfcfbb4718a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:23.717997 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a3549627-daa3-4be7-8a7f-adfcfbb4718a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:23.726849 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a3549627-daa3-4be7-8a7f-adfcfbb4718a tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.165968 Apr 06 16:55:23.727463 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1038/2064] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:23 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:23.867862 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1aef921f-53eb-42b2-98ac-41a4aef758af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:23.868593 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1aef921f-53eb-42b2-98ac-41a4aef758af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:23.875658 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1aef921f-53eb-42b2-98ac-41a4aef758af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:23.876111 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1aef921f-53eb-42b2-98ac-41a4aef758af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:23.876940 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1aef921f-53eb-42b2-98ac-41a4aef758af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:23.877376 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1aef921f-53eb-42b2-98ac-41a4aef758af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:23.899458 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ea2c41cb-055b-4405-aa10-a843edad4dc9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:23.900094 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ea2c41cb-055b-4405-aa10-a843edad4dc9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:23.906071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea2c41cb-055b-4405-aa10-a843edad4dc9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:23.906515 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea2c41cb-055b-4405-aa10-a843edad4dc9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:23.907282 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea2c41cb-055b-4405-aa10-a843edad4dc9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:23.907715 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea2c41cb-055b-4405-aa10-a843edad4dc9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:24.024056 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1aef921f-53eb-42b2-98ac-41a4aef758af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:24.032409 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1aef921f-53eb-42b2-98ac-41a4aef758af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:24.033935 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1aef921f-53eb-42b2-98ac-41a4aef758af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:24.035142 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1aef921f-53eb-42b2-98ac-41a4aef758af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.171365 Apr 06 16:55:24.036089 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1027/2065] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:23 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:24.045917 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ea2c41cb-055b-4405-aa10-a843edad4dc9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:24.048505 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f0cfe3ac-befb-4821-816f-bbf9ee144686 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:24.049178 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f0cfe3ac-befb-4821-816f-bbf9ee144686 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:24.054440 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ea2c41cb-055b-4405-aa10-a843edad4dc9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.158825 Apr 06 16:55:24.055012 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1039/2066] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:23 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:24.055777 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0cfe3ac-befb-4821-816f-bbf9ee144686 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:24.056378 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0cfe3ac-befb-4821-816f-bbf9ee144686 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:24.057192 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0cfe3ac-befb-4821-816f-bbf9ee144686 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:24.057622 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0cfe3ac-befb-4821-816f-bbf9ee144686 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:24.120545 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f0cfe3ac-befb-4821-816f-bbf9ee144686 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:24.129747 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f0cfe3ac-befb-4821-816f-bbf9ee144686 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.092592 Apr 06 16:55:24.130328 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1028/2067] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:24 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:24.747603 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d80d7b7c-c03e-4b31-b800-69fb1452f9e5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:24.748232 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d80d7b7c-c03e-4b31-b800-69fb1452f9e5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:24.758074 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d80d7b7c-c03e-4b31-b800-69fb1452f9e5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:24.758888 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d80d7b7c-c03e-4b31-b800-69fb1452f9e5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:24.760274 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d80d7b7c-c03e-4b31-b800-69fb1452f9e5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:24.761118 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d80d7b7c-c03e-4b31-b800-69fb1452f9e5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:24.904115 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d80d7b7c-c03e-4b31-b800-69fb1452f9e5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:24.912970 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d80d7b7c-c03e-4b31-b800-69fb1452f9e5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.171541 Apr 06 16:55:24.913553 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1040/2068] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:24 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:25.053702 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-58551ef4-1ca8-4e11-9e8f-ec38d05fb5f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:25.054289 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-58551ef4-1ca8-4e11-9e8f-ec38d05fb5f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:25.060988 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58551ef4-1ca8-4e11-9e8f-ec38d05fb5f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:25.061434 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58551ef4-1ca8-4e11-9e8f-ec38d05fb5f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:25.062193 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58551ef4-1ca8-4e11-9e8f-ec38d05fb5f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:25.062636 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58551ef4-1ca8-4e11-9e8f-ec38d05fb5f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:25.076571 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-33d2f5fb-f557-4fa5-9331-902ae7833639 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:25.077213 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-33d2f5fb-f557-4fa5-9331-902ae7833639 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:25.083470 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33d2f5fb-f557-4fa5-9331-902ae7833639 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:25.086035 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33d2f5fb-f557-4fa5-9331-902ae7833639 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:25.086035 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33d2f5fb-f557-4fa5-9331-902ae7833639 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:25.086035 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-33d2f5fb-f557-4fa5-9331-902ae7833639 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:25.207046 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-58551ef4-1ca8-4e11-9e8f-ec38d05fb5f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:25.216367 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-58551ef4-1ca8-4e11-9e8f-ec38d05fb5f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:25.217898 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-58551ef4-1ca8-4e11-9e8f-ec38d05fb5f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:25.219085 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-58551ef4-1ca8-4e11-9e8f-ec38d05fb5f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.169702 Apr 06 16:55:25.219628 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1029/2069] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:25 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:25.225294 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-79702b05-72e4-4a8f-aeb2-494e60060f76 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:25.225917 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-79702b05-72e4-4a8f-aeb2-494e60060f76 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:25.232636 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79702b05-72e4-4a8f-aeb2-494e60060f76 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:25.233113 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79702b05-72e4-4a8f-aeb2-494e60060f76 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:25.233904 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79702b05-72e4-4a8f-aeb2-494e60060f76 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:25.234329 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79702b05-72e4-4a8f-aeb2-494e60060f76 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:25.297751 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-79702b05-72e4-4a8f-aeb2-494e60060f76 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:25.308340 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-79702b05-72e4-4a8f-aeb2-494e60060f76 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.087495 Apr 06 16:55:25.309151 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1030/2070] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:25 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:25.444286 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-33d2f5fb-f557-4fa5-9331-902ae7833639 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:25.452647 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-33d2f5fb-f557-4fa5-9331-902ae7833639 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.379939 Apr 06 16:55:25.453258 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1041/2071] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:25 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:25.930852 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-772bede1-a5a6-43af-ae6b-2f03f4db6280 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:25.931463 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-772bede1-a5a6-43af-ae6b-2f03f4db6280 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:25.937976 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-772bede1-a5a6-43af-ae6b-2f03f4db6280 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:25.938429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-772bede1-a5a6-43af-ae6b-2f03f4db6280 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:25.939194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-772bede1-a5a6-43af-ae6b-2f03f4db6280 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:25.939627 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-772bede1-a5a6-43af-ae6b-2f03f4db6280 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:26.079949 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-772bede1-a5a6-43af-ae6b-2f03f4db6280 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:26.088645 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-772bede1-a5a6-43af-ae6b-2f03f4db6280 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.162026 Apr 06 16:55:26.089273 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1031/2072] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:25 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:26.238892 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-56cece61-f8e3-48a7-a4f0-e7b7a9b9a5d1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:26.239742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-56cece61-f8e3-48a7-a4f0-e7b7a9b9a5d1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:26.246600 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56cece61-f8e3-48a7-a4f0-e7b7a9b9a5d1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:26.247043 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56cece61-f8e3-48a7-a4f0-e7b7a9b9a5d1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:26.247874 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56cece61-f8e3-48a7-a4f0-e7b7a9b9a5d1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:26.248309 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-56cece61-f8e3-48a7-a4f0-e7b7a9b9a5d1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:26.325437 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-90632429-2b3f-4bd9-b5eb-8cc637659760 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:26.326080 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-90632429-2b3f-4bd9-b5eb-8cc637659760 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:26.332458 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90632429-2b3f-4bd9-b5eb-8cc637659760 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:26.332944 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90632429-2b3f-4bd9-b5eb-8cc637659760 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:26.333702 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90632429-2b3f-4bd9-b5eb-8cc637659760 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:26.334150 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90632429-2b3f-4bd9-b5eb-8cc637659760 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:26.390118 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-56cece61-f8e3-48a7-a4f0-e7b7a9b9a5d1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:26.398958 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-56cece61-f8e3-48a7-a4f0-e7b7a9b9a5d1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:26.399643 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-90632429-2b3f-4bd9-b5eb-8cc637659760 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:26.400442 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-56cece61-f8e3-48a7-a4f0-e7b7a9b9a5d1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:26.401626 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-56cece61-f8e3-48a7-a4f0-e7b7a9b9a5d1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.166845 Apr 06 16:55:26.402194 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1042/2073] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:26 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:26.407944 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-90632429-2b3f-4bd9-b5eb-8cc637659760 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086581 Apr 06 16:55:26.408478 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1032/2074] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:26 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:26.470578 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-95381602-d70d-4b05-bf17-fbc2f1007029 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:26.471181 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-95381602-d70d-4b05-bf17-fbc2f1007029 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:26.478291 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95381602-d70d-4b05-bf17-fbc2f1007029 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:26.478741 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95381602-d70d-4b05-bf17-fbc2f1007029 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:26.479509 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95381602-d70d-4b05-bf17-fbc2f1007029 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:26.479941 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95381602-d70d-4b05-bf17-fbc2f1007029 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:26.620472 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-95381602-d70d-4b05-bf17-fbc2f1007029 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:26.628708 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-95381602-d70d-4b05-bf17-fbc2f1007029 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.162142 Apr 06 16:55:26.629316 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1043/2075] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:26 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:27.110680 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a54c82a3-f9c1-4b30-8ebb-2fd41c282bca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:27.111636 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a54c82a3-f9c1-4b30-8ebb-2fd41c282bca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:27.122531 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a54c82a3-f9c1-4b30-8ebb-2fd41c282bca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:27.123273 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a54c82a3-f9c1-4b30-8ebb-2fd41c282bca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:27.124512 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a54c82a3-f9c1-4b30-8ebb-2fd41c282bca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:27.125275 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a54c82a3-f9c1-4b30-8ebb-2fd41c282bca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:27.271531 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a54c82a3-f9c1-4b30-8ebb-2fd41c282bca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:27.279822 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a54c82a3-f9c1-4b30-8ebb-2fd41c282bca tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.175864 Apr 06 16:55:27.280407 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1033/2076] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:27 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:27.423802 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3ecc3c84-f063-491f-a438-3ba2accedf8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:27.424819 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3ecc3c84-f063-491f-a438-3ba2accedf8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:27.428909 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1b7ffab5-b1de-419d-8d1a-53782a3ddbd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:27.429896 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1b7ffab5-b1de-419d-8d1a-53782a3ddbd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:27.433496 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ecc3c84-f063-491f-a438-3ba2accedf8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:27.433945 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ecc3c84-f063-491f-a438-3ba2accedf8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:27.434726 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ecc3c84-f063-491f-a438-3ba2accedf8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:27.435160 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ecc3c84-f063-491f-a438-3ba2accedf8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:27.436352 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b7ffab5-b1de-419d-8d1a-53782a3ddbd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:27.436839 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b7ffab5-b1de-419d-8d1a-53782a3ddbd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:27.437643 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b7ffab5-b1de-419d-8d1a-53782a3ddbd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:27.438084 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b7ffab5-b1de-419d-8d1a-53782a3ddbd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:27.499698 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1b7ffab5-b1de-419d-8d1a-53782a3ddbd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:27.508105 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1b7ffab5-b1de-419d-8d1a-53782a3ddbd0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.085977 Apr 06 16:55:27.508940 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1034/2077] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:27 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:27.576237 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3ecc3c84-f063-491f-a438-3ba2accedf8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:27.585332 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3ecc3c84-f063-491f-a438-3ba2accedf8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:27.586822 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3ecc3c84-f063-491f-a438-3ba2accedf8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:27.588018 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3ecc3c84-f063-491f-a438-3ba2accedf8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.170993 Apr 06 16:55:27.588671 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1044/2078] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:27 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:27.646184 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-51efdadc-e2f6-4f12-abe5-d84f93d0e278 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:27.646795 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-51efdadc-e2f6-4f12-abe5-d84f93d0e278 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:27.653451 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51efdadc-e2f6-4f12-abe5-d84f93d0e278 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:27.653906 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51efdadc-e2f6-4f12-abe5-d84f93d0e278 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:27.654677 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51efdadc-e2f6-4f12-abe5-d84f93d0e278 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:27.655111 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51efdadc-e2f6-4f12-abe5-d84f93d0e278 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:27.795754 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-51efdadc-e2f6-4f12-abe5-d84f93d0e278 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:27.804397 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-51efdadc-e2f6-4f12-abe5-d84f93d0e278 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.162179 Apr 06 16:55:27.805008 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1035/2079] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:27 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:28.297404 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4d454058-fd84-4985-b18d-d1668ce46991 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:28.298015 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4d454058-fd84-4985-b18d-d1668ce46991 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:28.304886 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d454058-fd84-4985-b18d-d1668ce46991 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:28.305337 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d454058-fd84-4985-b18d-d1668ce46991 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:28.306111 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d454058-fd84-4985-b18d-d1668ce46991 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:28.306542 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d454058-fd84-4985-b18d-d1668ce46991 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:28.444389 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4d454058-fd84-4985-b18d-d1668ce46991 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:28.452443 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4d454058-fd84-4985-b18d-d1668ce46991 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.158938 Apr 06 16:55:28.453028 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1045/2080] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:28 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:28.525433 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7c8a29ea-472e-41fa-9204-54652c834797 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:28.526035 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7c8a29ea-472e-41fa-9204-54652c834797 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:28.533026 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c8a29ea-472e-41fa-9204-54652c834797 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:28.533481 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c8a29ea-472e-41fa-9204-54652c834797 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:28.534253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c8a29ea-472e-41fa-9204-54652c834797 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:28.534688 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c8a29ea-472e-41fa-9204-54652c834797 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:28.595412 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7c8a29ea-472e-41fa-9204-54652c834797 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:28.604334 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7c8a29ea-472e-41fa-9204-54652c834797 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.082893 Apr 06 16:55:28.604943 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1036/2081] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:28 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:28.606951 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c6afe5ad-2680-44a6-be1e-cdca958a79a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:28.607565 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c6afe5ad-2680-44a6-be1e-cdca958a79a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:28.613927 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6afe5ad-2680-44a6-be1e-cdca958a79a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:28.614379 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6afe5ad-2680-44a6-be1e-cdca958a79a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:28.615335 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6afe5ad-2680-44a6-be1e-cdca958a79a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:28.615807 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6afe5ad-2680-44a6-be1e-cdca958a79a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:28.750532 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c6afe5ad-2680-44a6-be1e-cdca958a79a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:28.759575 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c6afe5ad-2680-44a6-be1e-cdca958a79a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:28.761123 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c6afe5ad-2680-44a6-be1e-cdca958a79a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:28.762261 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c6afe5ad-2680-44a6-be1e-cdca958a79a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.159439 Apr 06 16:55:28.762821 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1046/2082] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:28 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:55:28.822540 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9b004a56-6c22-48cf-9c30-69020e639d0e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:28.823142 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9b004a56-6c22-48cf-9c30-69020e639d0e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:28.829653 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b004a56-6c22-48cf-9c30-69020e639d0e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:28.830099 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b004a56-6c22-48cf-9c30-69020e639d0e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:28.830829 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b004a56-6c22-48cf-9c30-69020e639d0e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:28.831281 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b004a56-6c22-48cf-9c30-69020e639d0e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:28.969772 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9b004a56-6c22-48cf-9c30-69020e639d0e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:28.978889 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9b004a56-6c22-48cf-9c30-69020e639d0e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.160305 Apr 06 16:55:28.979459 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1037/2083] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:28 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:29.470779 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d6c57554-4bcf-4478-914c-0d4162874478 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:29.471401 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d6c57554-4bcf-4478-914c-0d4162874478 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:29.478843 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6c57554-4bcf-4478-914c-0d4162874478 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:29.479478 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6c57554-4bcf-4478-914c-0d4162874478 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:29.480294 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6c57554-4bcf-4478-914c-0d4162874478 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:29.480876 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6c57554-4bcf-4478-914c-0d4162874478 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:29.615140 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d6c57554-4bcf-4478-914c-0d4162874478 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:29.621900 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-75f055f7-0873-4856-9053-ebd918bbcd21 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:29.622594 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-75f055f7-0873-4856-9053-ebd918bbcd21 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:29.624511 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d6c57554-4bcf-4478-914c-0d4162874478 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.157837 Apr 06 16:55:29.625165 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1047/2084] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:29 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:29.630163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75f055f7-0873-4856-9053-ebd918bbcd21 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:29.630826 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75f055f7-0873-4856-9053-ebd918bbcd21 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:29.631492 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75f055f7-0873-4856-9053-ebd918bbcd21 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:29.631928 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75f055f7-0873-4856-9053-ebd918bbcd21 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:29.691441 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-75f055f7-0873-4856-9053-ebd918bbcd21 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:29.699895 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-75f055f7-0873-4856-9053-ebd918bbcd21 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.081894 Apr 06 16:55:29.700464 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1038/2085] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:29 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:29.781363 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-10c49b4b-3738-4171-a50c-1e9b33a79e4e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:29.781970 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-10c49b4b-3738-4171-a50c-1e9b33a79e4e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:29.788914 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10c49b4b-3738-4171-a50c-1e9b33a79e4e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:29.789362 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10c49b4b-3738-4171-a50c-1e9b33a79e4e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:29.790128 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10c49b4b-3738-4171-a50c-1e9b33a79e4e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:29.790561 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10c49b4b-3738-4171-a50c-1e9b33a79e4e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:29.928454 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-10c49b4b-3738-4171-a50c-1e9b33a79e4e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:29.937162 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-10c49b4b-3738-4171-a50c-1e9b33a79e4e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:29.938654 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-10c49b4b-3738-4171-a50c-1e9b33a79e4e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:29.939814 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-10c49b4b-3738-4171-a50c-1e9b33a79e4e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.162507 Apr 06 16:55:29.941096 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1048/2086] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:29 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:29.996324 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d8d6614b-fec5-4987-a7b6-047bf033dd7b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:29.996951 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d8d6614b-fec5-4987-a7b6-047bf033dd7b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:30.003405 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8d6614b-fec5-4987-a7b6-047bf033dd7b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:30.003860 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8d6614b-fec5-4987-a7b6-047bf033dd7b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:30.004613 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8d6614b-fec5-4987-a7b6-047bf033dd7b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:30.005162 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8d6614b-fec5-4987-a7b6-047bf033dd7b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:30.144647 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d8d6614b-fec5-4987-a7b6-047bf033dd7b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:30.153124 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d8d6614b-fec5-4987-a7b6-047bf033dd7b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.160798 Apr 06 16:55:30.153703 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1039/2087] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:29 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:30.646160 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7ca3af1f-4ede-4b3d-ae2a-bfa5720f2ad1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:30.646969 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7ca3af1f-4ede-4b3d-ae2a-bfa5720f2ad1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:30.655732 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ca3af1f-4ede-4b3d-ae2a-bfa5720f2ad1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:30.656335 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ca3af1f-4ede-4b3d-ae2a-bfa5720f2ad1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:30.657412 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ca3af1f-4ede-4b3d-ae2a-bfa5720f2ad1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:30.658003 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7ca3af1f-4ede-4b3d-ae2a-bfa5720f2ad1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:30.717809 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ee7715af-6735-4994-a990-3a424ce2edfa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:30.718487 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ee7715af-6735-4994-a990-3a424ce2edfa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:30.726134 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee7715af-6735-4994-a990-3a424ce2edfa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:30.726670 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee7715af-6735-4994-a990-3a424ce2edfa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:30.727508 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee7715af-6735-4994-a990-3a424ce2edfa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:30.727946 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee7715af-6735-4994-a990-3a424ce2edfa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:30.794279 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ee7715af-6735-4994-a990-3a424ce2edfa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:30.802982 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ee7715af-6735-4994-a990-3a424ce2edfa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.088838 Apr 06 16:55:30.803577 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1040/2088] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:30 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:55:30.806057 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7ca3af1f-4ede-4b3d-ae2a-bfa5720f2ad1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:30.814280 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7ca3af1f-4ede-4b3d-ae2a-bfa5720f2ad1 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.174815 Apr 06 16:55:30.814854 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1049/2089] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:30 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:30.960138 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cec11578-960f-44bc-b5e4-ff9173fda57d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:30.960888 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cec11578-960f-44bc-b5e4-ff9173fda57d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:30.967291 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cec11578-960f-44bc-b5e4-ff9173fda57d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:30.967742 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cec11578-960f-44bc-b5e4-ff9173fda57d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:30.968540 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cec11578-960f-44bc-b5e4-ff9173fda57d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:30.969014 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cec11578-960f-44bc-b5e4-ff9173fda57d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:31.127552 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cec11578-960f-44bc-b5e4-ff9173fda57d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:31.136816 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cec11578-960f-44bc-b5e4-ff9173fda57d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:31.138302 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cec11578-960f-44bc-b5e4-ff9173fda57d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:31.139434 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cec11578-960f-44bc-b5e4-ff9173fda57d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.183949 Apr 06 16:55:31.139994 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1041/2090] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:30 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:31.170888 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-568b0c84-772b-4880-bf8e-0e937bde251c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:31.171485 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-568b0c84-772b-4880-bf8e-0e937bde251c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:31.178001 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-568b0c84-772b-4880-bf8e-0e937bde251c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:31.178438 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-568b0c84-772b-4880-bf8e-0e937bde251c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:31.179197 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-568b0c84-772b-4880-bf8e-0e937bde251c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:31.179619 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-568b0c84-772b-4880-bf8e-0e937bde251c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:31.328486 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-568b0c84-772b-4880-bf8e-0e937bde251c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:31.337060 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-568b0c84-772b-4880-bf8e-0e937bde251c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.169886 Apr 06 16:55:31.337647 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1050/2091] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:31 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:31.819765 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-55d7328b-c7b9-4f03-85df-3c3847beccf5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:31.820423 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-55d7328b-c7b9-4f03-85df-3c3847beccf5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:31.827159 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55d7328b-c7b9-4f03-85df-3c3847beccf5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:31.827613 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55d7328b-c7b9-4f03-85df-3c3847beccf5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:31.828384 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55d7328b-c7b9-4f03-85df-3c3847beccf5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:31.828846 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55d7328b-c7b9-4f03-85df-3c3847beccf5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:31.831521 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-97b26a07-ddb4-4933-abeb-0213069f4e63 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:31.832150 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-97b26a07-ddb4-4933-abeb-0213069f4e63 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:31.839279 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97b26a07-ddb4-4933-abeb-0213069f4e63 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:31.839647 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97b26a07-ddb4-4933-abeb-0213069f4e63 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:31.840414 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97b26a07-ddb4-4933-abeb-0213069f4e63 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:31.840882 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97b26a07-ddb4-4933-abeb-0213069f4e63 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:31.890167 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-55d7328b-c7b9-4f03-85df-3c3847beccf5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:31.898485 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-55d7328b-c7b9-4f03-85df-3c3847beccf5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.082798 Apr 06 16:55:31.899097 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1042/2092] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:31 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:31.975605 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-97b26a07-ddb4-4933-abeb-0213069f4e63 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:31.984000 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-97b26a07-ddb4-4933-abeb-0213069f4e63 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.156476 Apr 06 16:55:31.984565 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1051/2093] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:31 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:32.158498 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f3ad1a4a-c3b9-4df0-aee0-172f06b3cd6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:32.159100 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f3ad1a4a-c3b9-4df0-aee0-172f06b3cd6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:32.165631 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3ad1a4a-c3b9-4df0-aee0-172f06b3cd6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:32.166079 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3ad1a4a-c3b9-4df0-aee0-172f06b3cd6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:32.166841 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3ad1a4a-c3b9-4df0-aee0-172f06b3cd6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:32.167312 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3ad1a4a-c3b9-4df0-aee0-172f06b3cd6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:32.304896 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f3ad1a4a-c3b9-4df0-aee0-172f06b3cd6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:32.313996 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f3ad1a4a-c3b9-4df0-aee0-172f06b3cd6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:32.315485 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f3ad1a4a-c3b9-4df0-aee0-172f06b3cd6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:32.316647 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f3ad1a4a-c3b9-4df0-aee0-172f06b3cd6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.162195 Apr 06 16:55:32.317237 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1043/2094] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:32 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:32.356345 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-464abe63-d286-4da0-8368-bcecda73cb99 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:32.356968 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-464abe63-d286-4da0-8368-bcecda73cb99 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:32.364009 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-464abe63-d286-4da0-8368-bcecda73cb99 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:32.364518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-464abe63-d286-4da0-8368-bcecda73cb99 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:32.365699 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-464abe63-d286-4da0-8368-bcecda73cb99 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:32.366141 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-464abe63-d286-4da0-8368-bcecda73cb99 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:32.513285 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-464abe63-d286-4da0-8368-bcecda73cb99 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:32.521327 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-464abe63-d286-4da0-8368-bcecda73cb99 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.170036 Apr 06 16:55:32.522104 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1052/2095] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:32 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:32.915618 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-372ace3e-19fc-4bb9-be30-503e8f38e7c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:32.916211 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-372ace3e-19fc-4bb9-be30-503e8f38e7c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:32.922951 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-372ace3e-19fc-4bb9-be30-503e8f38e7c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:32.923403 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-372ace3e-19fc-4bb9-be30-503e8f38e7c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:32.924149 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-372ace3e-19fc-4bb9-be30-503e8f38e7c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:32.924588 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-372ace3e-19fc-4bb9-be30-503e8f38e7c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:32.998105 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-372ace3e-19fc-4bb9-be30-503e8f38e7c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:33.001597 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-194de85a-01db-4dd7-923a-c4270e3c5c19 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:33.002230 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-194de85a-01db-4dd7-923a-c4270e3c5c19 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:33.006990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-372ace3e-19fc-4bb9-be30-503e8f38e7c6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.095290 Apr 06 16:55:33.007873 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1044/2096] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:32 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:33.018027 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-194de85a-01db-4dd7-923a-c4270e3c5c19 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:33.018472 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-194de85a-01db-4dd7-923a-c4270e3c5c19 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:33.019241 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-194de85a-01db-4dd7-923a-c4270e3c5c19 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:33.019666 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-194de85a-01db-4dd7-923a-c4270e3c5c19 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:33.158405 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-194de85a-01db-4dd7-923a-c4270e3c5c19 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:33.166670 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-194de85a-01db-4dd7-923a-c4270e3c5c19 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.168942 Apr 06 16:55:33.167257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1053/2097] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:32 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:33.335122 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3a2b4c25-fd26-4a54-9a21-5070f46a2497 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:33.335739 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3a2b4c25-fd26-4a54-9a21-5070f46a2497 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:33.342409 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a2b4c25-fd26-4a54-9a21-5070f46a2497 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:33.342849 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a2b4c25-fd26-4a54-9a21-5070f46a2497 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:33.343605 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a2b4c25-fd26-4a54-9a21-5070f46a2497 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:33.344032 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a2b4c25-fd26-4a54-9a21-5070f46a2497 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:33.491021 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3a2b4c25-fd26-4a54-9a21-5070f46a2497 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:33.499479 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3a2b4c25-fd26-4a54-9a21-5070f46a2497 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:33.500998 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3a2b4c25-fd26-4a54-9a21-5070f46a2497 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:33.502158 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3a2b4c25-fd26-4a54-9a21-5070f46a2497 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.171323 Apr 06 16:55:33.502689 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1045/2098] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:33 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:33.546421 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-74465339-5c29-4472-ba53-d27654c9d893 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:33.547261 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-74465339-5c29-4472-ba53-d27654c9d893 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:33.555438 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74465339-5c29-4472-ba53-d27654c9d893 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:33.555879 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74465339-5c29-4472-ba53-d27654c9d893 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:33.556633 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74465339-5c29-4472-ba53-d27654c9d893 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:33.557085 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74465339-5c29-4472-ba53-d27654c9d893 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:33.694278 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-74465339-5c29-4472-ba53-d27654c9d893 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:33.702621 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-74465339-5c29-4472-ba53-d27654c9d893 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.162737 Apr 06 16:55:33.703196 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1054/2099] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:33 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:34.024465 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b31b9d53-ac5e-4ae8-a94c-13165d51c8e2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:34.025109 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b31b9d53-ac5e-4ae8-a94c-13165d51c8e2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:34.031813 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b31b9d53-ac5e-4ae8-a94c-13165d51c8e2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:34.032259 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b31b9d53-ac5e-4ae8-a94c-13165d51c8e2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:34.033065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b31b9d53-ac5e-4ae8-a94c-13165d51c8e2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:34.033501 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b31b9d53-ac5e-4ae8-a94c-13165d51c8e2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:34.104602 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b31b9d53-ac5e-4ae8-a94c-13165d51c8e2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:34.113603 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b31b9d53-ac5e-4ae8-a94c-13165d51c8e2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.093141 Apr 06 16:55:34.114198 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1046/2100] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:34 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:34.183918 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6be6a24d-6be0-4e98-b29a-ab8afe40075f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:34.184716 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6be6a24d-6be0-4e98-b29a-ab8afe40075f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:34.191158 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6be6a24d-6be0-4e98-b29a-ab8afe40075f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:34.191609 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6be6a24d-6be0-4e98-b29a-ab8afe40075f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:34.192371 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6be6a24d-6be0-4e98-b29a-ab8afe40075f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:34.192916 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6be6a24d-6be0-4e98-b29a-ab8afe40075f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:34.336643 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6be6a24d-6be0-4e98-b29a-ab8afe40075f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:34.344630 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6be6a24d-6be0-4e98-b29a-ab8afe40075f tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.164703 Apr 06 16:55:34.345259 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1055/2101] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:34 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:34.527732 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-28960a55-4e66-473d-a016-2ac8e94613ac tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:34.528338 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-28960a55-4e66-473d-a016-2ac8e94613ac tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:34.534946 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28960a55-4e66-473d-a016-2ac8e94613ac tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:34.535325 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28960a55-4e66-473d-a016-2ac8e94613ac tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:34.536096 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28960a55-4e66-473d-a016-2ac8e94613ac tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:34.536876 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28960a55-4e66-473d-a016-2ac8e94613ac tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:34.672974 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-28960a55-4e66-473d-a016-2ac8e94613ac tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:34.681666 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-28960a55-4e66-473d-a016-2ac8e94613ac tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:34.683160 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-28960a55-4e66-473d-a016-2ac8e94613ac tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:34.684325 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-28960a55-4e66-473d-a016-2ac8e94613ac tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.160670 Apr 06 16:55:34.684915 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1047/2102] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:34 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:34.720755 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6e34ada1-187a-4e54-bd13-1e521ed807d4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:34.721391 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6e34ada1-187a-4e54-bd13-1e521ed807d4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:34.728317 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e34ada1-187a-4e54-bd13-1e521ed807d4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:34.728809 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e34ada1-187a-4e54-bd13-1e521ed807d4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:34.729572 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e34ada1-187a-4e54-bd13-1e521ed807d4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:34.730005 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6e34ada1-187a-4e54-bd13-1e521ed807d4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:34.864172 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6e34ada1-187a-4e54-bd13-1e521ed807d4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:34.872490 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6e34ada1-187a-4e54-bd13-1e521ed807d4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.155817 Apr 06 16:55:34.873134 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1056/2103] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:34 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:35.132614 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a678707c-7966-417a-ac6f-5e114b799df1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:35.133767 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a678707c-7966-417a-ac6f-5e114b799df1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:35.141529 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a678707c-7966-417a-ac6f-5e114b799df1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:35.142006 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a678707c-7966-417a-ac6f-5e114b799df1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:35.142761 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a678707c-7966-417a-ac6f-5e114b799df1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:35.143194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a678707c-7966-417a-ac6f-5e114b799df1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:35.211541 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a678707c-7966-417a-ac6f-5e114b799df1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:35.219495 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a678707c-7966-417a-ac6f-5e114b799df1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.091779 Apr 06 16:55:35.220034 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1048/2104] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:35 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:35.363022 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-318095bc-f2c2-4fb4-9650-0f37644386b2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:35.363631 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-318095bc-f2c2-4fb4-9650-0f37644386b2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:35.370644 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-318095bc-f2c2-4fb4-9650-0f37644386b2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:35.371250 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-318095bc-f2c2-4fb4-9650-0f37644386b2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:35.372031 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-318095bc-f2c2-4fb4-9650-0f37644386b2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:35.372440 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-318095bc-f2c2-4fb4-9650-0f37644386b2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:35.512039 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-318095bc-f2c2-4fb4-9650-0f37644386b2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:35.520495 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-318095bc-f2c2-4fb4-9650-0f37644386b2 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.161434 Apr 06 16:55:35.521320 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1057/2105] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:35 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:35.703318 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1aa2d9c7-7457-46fd-a485-83f4d60b3412 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:35.703915 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1aa2d9c7-7457-46fd-a485-83f4d60b3412 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:35.710757 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1aa2d9c7-7457-46fd-a485-83f4d60b3412 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:35.711131 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1aa2d9c7-7457-46fd-a485-83f4d60b3412 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:35.711879 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1aa2d9c7-7457-46fd-a485-83f4d60b3412 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:35.712326 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1aa2d9c7-7457-46fd-a485-83f4d60b3412 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:35.848141 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1aa2d9c7-7457-46fd-a485-83f4d60b3412 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:35.857807 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1aa2d9c7-7457-46fd-a485-83f4d60b3412 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:35.859274 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1aa2d9c7-7457-46fd-a485-83f4d60b3412 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:35.860457 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1aa2d9c7-7457-46fd-a485-83f4d60b3412 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.161104 Apr 06 16:55:35.861199 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1049/2106] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:35 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:35.891198 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4865428d-6cab-4fb1-a8cc-4ee28832373f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:35.891699 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4865428d-6cab-4fb1-a8cc-4ee28832373f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:35.898669 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4865428d-6cab-4fb1-a8cc-4ee28832373f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:35.899112 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4865428d-6cab-4fb1-a8cc-4ee28832373f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:35.899892 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4865428d-6cab-4fb1-a8cc-4ee28832373f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:35.900318 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4865428d-6cab-4fb1-a8cc-4ee28832373f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:36.039810 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4865428d-6cab-4fb1-a8cc-4ee28832373f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:36.048458 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4865428d-6cab-4fb1-a8cc-4ee28832373f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.161708 Apr 06 16:55:36.049075 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1058/2107] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:35 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:36.237586 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-900e3818-4790-4d80-a153-8c088479e5cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:36.238136 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-900e3818-4790-4d80-a153-8c088479e5cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:36.244874 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-900e3818-4790-4d80-a153-8c088479e5cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:36.245322 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-900e3818-4790-4d80-a153-8c088479e5cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:36.246084 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-900e3818-4790-4d80-a153-8c088479e5cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:36.246521 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-900e3818-4790-4d80-a153-8c088479e5cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:36.307784 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-900e3818-4790-4d80-a153-8c088479e5cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:36.317164 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-900e3818-4790-4d80-a153-8c088479e5cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.083568 Apr 06 16:55:36.317736 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1050/2108] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:36 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:36.538831 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2af67b92-bc71-4e21-98e6-db5fa6861de7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:36.539444 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2af67b92-bc71-4e21-98e6-db5fa6861de7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:36.546311 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2af67b92-bc71-4e21-98e6-db5fa6861de7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:36.546759 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2af67b92-bc71-4e21-98e6-db5fa6861de7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:36.547521 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2af67b92-bc71-4e21-98e6-db5fa6861de7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:36.547952 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2af67b92-bc71-4e21-98e6-db5fa6861de7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:36.689715 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2af67b92-bc71-4e21-98e6-db5fa6861de7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:36.698461 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2af67b92-bc71-4e21-98e6-db5fa6861de7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.163689 Apr 06 16:55:36.699053 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1059/2109] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:36 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:36.881943 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5c0c9505-4b76-4743-a183-44149902cf89 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:36.882550 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5c0c9505-4b76-4743-a183-44149902cf89 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:36.891734 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c0c9505-4b76-4743-a183-44149902cf89 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:36.892188 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c0c9505-4b76-4743-a183-44149902cf89 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:36.892987 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c0c9505-4b76-4743-a183-44149902cf89 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:36.893427 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c0c9505-4b76-4743-a183-44149902cf89 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:37.047659 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5c0c9505-4b76-4743-a183-44149902cf89 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:37.056504 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5c0c9505-4b76-4743-a183-44149902cf89 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:37.058043 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5c0c9505-4b76-4743-a183-44149902cf89 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:37.059236 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5c0c9505-4b76-4743-a183-44149902cf89 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.183379 Apr 06 16:55:37.059794 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1051/2110] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:36 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:37.065633 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-70b87404-63d9-4fe5-88eb-7858b54722b7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:37.066269 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-70b87404-63d9-4fe5-88eb-7858b54722b7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:37.072703 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70b87404-63d9-4fe5-88eb-7858b54722b7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:37.073167 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70b87404-63d9-4fe5-88eb-7858b54722b7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:37.073914 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70b87404-63d9-4fe5-88eb-7858b54722b7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:37.074367 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-70b87404-63d9-4fe5-88eb-7858b54722b7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:37.213827 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-70b87404-63d9-4fe5-88eb-7858b54722b7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:37.221932 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-70b87404-63d9-4fe5-88eb-7858b54722b7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.160165 Apr 06 16:55:37.222491 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1060/2111] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:37 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:37.335061 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3fe16156-c941-4259-9454-508e43121970 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:37.335679 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3fe16156-c941-4259-9454-508e43121970 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:37.342463 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fe16156-c941-4259-9454-508e43121970 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:37.342912 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fe16156-c941-4259-9454-508e43121970 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:37.343683 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fe16156-c941-4259-9454-508e43121970 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:37.344114 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fe16156-c941-4259-9454-508e43121970 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:37.407093 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3fe16156-c941-4259-9454-508e43121970 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:37.416230 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3fe16156-c941-4259-9454-508e43121970 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.085122 Apr 06 16:55:37.416822 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1052/2112] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:37 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:37.717680 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e872302a-13df-48c4-ac35-d8aabc7a316e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:37.718307 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e872302a-13df-48c4-ac35-d8aabc7a316e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:37.725692 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e872302a-13df-48c4-ac35-d8aabc7a316e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:37.726142 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e872302a-13df-48c4-ac35-d8aabc7a316e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:37.726920 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e872302a-13df-48c4-ac35-d8aabc7a316e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:37.727361 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e872302a-13df-48c4-ac35-d8aabc7a316e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:37.871386 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e872302a-13df-48c4-ac35-d8aabc7a316e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:37.879879 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e872302a-13df-48c4-ac35-d8aabc7a316e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.166147 Apr 06 16:55:37.880594 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1061/2113] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:37 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:38.078230 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-470b8583-4420-4032-bcd7-12473f6c10a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:38.078865 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-470b8583-4420-4032-bcd7-12473f6c10a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:38.086722 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-470b8583-4420-4032-bcd7-12473f6c10a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:38.087154 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-470b8583-4420-4032-bcd7-12473f6c10a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:38.087945 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-470b8583-4420-4032-bcd7-12473f6c10a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:38.088406 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-470b8583-4420-4032-bcd7-12473f6c10a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:38.221802 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-470b8583-4420-4032-bcd7-12473f6c10a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:38.231093 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-470b8583-4420-4032-bcd7-12473f6c10a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:38.232597 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-470b8583-4420-4032-bcd7-12473f6c10a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:38.233797 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-470b8583-4420-4032-bcd7-12473f6c10a5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.159679 Apr 06 16:55:38.234564 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1053/2114] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:38 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:38.239616 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-27c18c2c-6207-4d2a-8755-aaee2e8a6d9d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:38.240358 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-27c18c2c-6207-4d2a-8755-aaee2e8a6d9d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:38.246891 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27c18c2c-6207-4d2a-8755-aaee2e8a6d9d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:38.247344 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27c18c2c-6207-4d2a-8755-aaee2e8a6d9d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:38.248108 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27c18c2c-6207-4d2a-8755-aaee2e8a6d9d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:38.248556 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27c18c2c-6207-4d2a-8755-aaee2e8a6d9d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:38.393889 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-27c18c2c-6207-4d2a-8755-aaee2e8a6d9d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:38.402291 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-27c18c2c-6207-4d2a-8755-aaee2e8a6d9d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.166565 Apr 06 16:55:38.402863 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1062/2115] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:38 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:38.432840 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-977637f2-4cfd-463e-9f53-37ef754d93da tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:38.433461 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-977637f2-4cfd-463e-9f53-37ef754d93da tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:38.441113 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977637f2-4cfd-463e-9f53-37ef754d93da tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:38.441538 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977637f2-4cfd-463e-9f53-37ef754d93da tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:38.442426 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977637f2-4cfd-463e-9f53-37ef754d93da tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:38.443271 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977637f2-4cfd-463e-9f53-37ef754d93da tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:38.517355 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-977637f2-4cfd-463e-9f53-37ef754d93da tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:38.530229 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-977637f2-4cfd-463e-9f53-37ef754d93da tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.100953 Apr 06 16:55:38.531130 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1054/2116] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:38 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:38.897894 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3b066b53-3cd3-4b6c-b026-56f39659be4d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:38.898498 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3b066b53-3cd3-4b6c-b026-56f39659be4d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:38.905527 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b066b53-3cd3-4b6c-b026-56f39659be4d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:38.905971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b066b53-3cd3-4b6c-b026-56f39659be4d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:38.906740 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b066b53-3cd3-4b6c-b026-56f39659be4d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:38.907171 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b066b53-3cd3-4b6c-b026-56f39659be4d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:39.058297 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3b066b53-3cd3-4b6c-b026-56f39659be4d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:39.066547 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3b066b53-3cd3-4b6c-b026-56f39659be4d tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.173026 Apr 06 16:55:39.070146 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1063/2117] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:38 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:39.252593 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6aaeaed1-e861-4409-baa3-d23e2166dae7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:39.253274 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6aaeaed1-e861-4409-baa3-d23e2166dae7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:39.259903 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6aaeaed1-e861-4409-baa3-d23e2166dae7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:39.260358 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6aaeaed1-e861-4409-baa3-d23e2166dae7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:39.261230 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6aaeaed1-e861-4409-baa3-d23e2166dae7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:39.261592 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6aaeaed1-e861-4409-baa3-d23e2166dae7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:39.399378 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6aaeaed1-e861-4409-baa3-d23e2166dae7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:39.407990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6aaeaed1-e861-4409-baa3-d23e2166dae7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:39.409540 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6aaeaed1-e861-4409-baa3-d23e2166dae7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:39.410699 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6aaeaed1-e861-4409-baa3-d23e2166dae7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.162179 Apr 06 16:55:39.411272 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1055/2118] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:39 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:39.419495 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-17d93b2f-11b2-4368-86c1-423c65d442ba tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:39.420275 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-17d93b2f-11b2-4368-86c1-423c65d442ba tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:39.426371 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17d93b2f-11b2-4368-86c1-423c65d442ba tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:39.426814 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17d93b2f-11b2-4368-86c1-423c65d442ba tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:39.427612 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17d93b2f-11b2-4368-86c1-423c65d442ba tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:39.428043 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-17d93b2f-11b2-4368-86c1-423c65d442ba tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:39.550341 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a655b627-cc3b-4bd9-bde5-d74db31b5a90 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:39.550974 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a655b627-cc3b-4bd9-bde5-d74db31b5a90 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:39.557780 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a655b627-cc3b-4bd9-bde5-d74db31b5a90 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:39.558235 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a655b627-cc3b-4bd9-bde5-d74db31b5a90 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:39.559038 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a655b627-cc3b-4bd9-bde5-d74db31b5a90 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:39.559472 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a655b627-cc3b-4bd9-bde5-d74db31b5a90 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:39.571834 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-17d93b2f-11b2-4368-86c1-423c65d442ba tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:39.580091 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-17d93b2f-11b2-4368-86c1-423c65d442ba tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.164454 Apr 06 16:55:39.580774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1064/2119] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:39 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:39.621966 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a655b627-cc3b-4bd9-bde5-d74db31b5a90 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:39.630399 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a655b627-cc3b-4bd9-bde5-d74db31b5a90 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.083971 Apr 06 16:55:39.630968 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1056/2120] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:39 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:55:40.084196 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dba4247e-7149-4063-8c2a-37c94b377d78 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:40.085008 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dba4247e-7149-4063-8c2a-37c94b377d78 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:40.092126 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dba4247e-7149-4063-8c2a-37c94b377d78 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:40.093068 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dba4247e-7149-4063-8c2a-37c94b377d78 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:40.093828 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dba4247e-7149-4063-8c2a-37c94b377d78 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:40.094263 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dba4247e-7149-4063-8c2a-37c94b377d78 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:40.239000 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-dba4247e-7149-4063-8c2a-37c94b377d78 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:40.252174 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dba4247e-7149-4063-8c2a-37c94b377d78 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.169952 Apr 06 16:55:40.252174 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1065/2121] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:40 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:40.430263 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0f8d436e-ee64-47f5-af7d-1b75d945d3aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:40.430873 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0f8d436e-ee64-47f5-af7d-1b75d945d3aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:40.437458 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f8d436e-ee64-47f5-af7d-1b75d945d3aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:40.437922 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f8d436e-ee64-47f5-af7d-1b75d945d3aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:40.438688 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f8d436e-ee64-47f5-af7d-1b75d945d3aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:40.439124 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f8d436e-ee64-47f5-af7d-1b75d945d3aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:40.586014 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0f8d436e-ee64-47f5-af7d-1b75d945d3aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:40.595992 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0f8d436e-ee64-47f5-af7d-1b75d945d3aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:40.597547 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0f8d436e-ee64-47f5-af7d-1b75d945d3aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:40.598736 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0f8d436e-ee64-47f5-af7d-1b75d945d3aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.172951 Apr 06 16:55:40.598896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1bf2cbf7-659e-4fee-bf3b-5935b3512ae7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:40.599363 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1057/2122] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:40 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:40.599515 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1bf2cbf7-659e-4fee-bf3b-5935b3512ae7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:40.606556 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bf2cbf7-659e-4fee-bf3b-5935b3512ae7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:40.607005 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bf2cbf7-659e-4fee-bf3b-5935b3512ae7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:40.607787 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bf2cbf7-659e-4fee-bf3b-5935b3512ae7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:40.608222 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bf2cbf7-659e-4fee-bf3b-5935b3512ae7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:40.647539 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-05694587-e66d-48eb-8604-94b17fa50391 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:40.648287 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-05694587-e66d-48eb-8604-94b17fa50391 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:40.654781 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05694587-e66d-48eb-8604-94b17fa50391 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:40.655233 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05694587-e66d-48eb-8604-94b17fa50391 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:40.656011 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05694587-e66d-48eb-8604-94b17fa50391 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:40.656449 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05694587-e66d-48eb-8604-94b17fa50391 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:40.719397 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-05694587-e66d-48eb-8604-94b17fa50391 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:40.728145 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-05694587-e66d-48eb-8604-94b17fa50391 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.084502 Apr 06 16:55:40.728748 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1058/2123] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:40 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:55:40.748673 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1bf2cbf7-659e-4fee-bf3b-5935b3512ae7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:40.757158 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1bf2cbf7-659e-4fee-bf3b-5935b3512ae7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.162232 Apr 06 16:55:40.757720 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1066/2124] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:40 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:41.269919 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7562a6d6-fc6b-44de-948d-65f0b931b25e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:41.270555 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7562a6d6-fc6b-44de-948d-65f0b931b25e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:41.277309 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7562a6d6-fc6b-44de-948d-65f0b931b25e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:41.277757 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7562a6d6-fc6b-44de-948d-65f0b931b25e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:41.278526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7562a6d6-fc6b-44de-948d-65f0b931b25e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:41.278959 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7562a6d6-fc6b-44de-948d-65f0b931b25e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:41.416717 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7562a6d6-fc6b-44de-948d-65f0b931b25e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:41.424724 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7562a6d6-fc6b-44de-948d-65f0b931b25e tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.158767 Apr 06 16:55:41.425315 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1059/2125] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:41 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:41.618803 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f3609895-dcb0-4956-8480-f2533acd870f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:41.619410 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f3609895-dcb0-4956-8480-f2533acd870f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:41.626047 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f3609895-dcb0-4956-8480-f2533acd870f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:41.626482 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f3609895-dcb0-4956-8480-f2533acd870f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:41.627251 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f3609895-dcb0-4956-8480-f2533acd870f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:41.627675 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f3609895-dcb0-4956-8480-f2533acd870f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:41.746009 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7784cd93-9bf3-46f1-afec-9884d7ef67d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:41.746704 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7784cd93-9bf3-46f1-afec-9884d7ef67d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:41.752941 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7784cd93-9bf3-46f1-afec-9884d7ef67d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:41.753392 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7784cd93-9bf3-46f1-afec-9884d7ef67d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:41.754160 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7784cd93-9bf3-46f1-afec-9884d7ef67d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:41.754630 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7784cd93-9bf3-46f1-afec-9884d7ef67d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:41.772307 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f3609895-dcb0-4956-8480-f2533acd870f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:41.780794 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f3609895-dcb0-4956-8480-f2533acd870f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:41.782306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f3609895-dcb0-4956-8480-f2533acd870f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:41.783459 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f3609895-dcb0-4956-8480-f2533acd870f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.169228 Apr 06 16:55:41.784011 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1067/2126] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:41 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:41.788546 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-014afeeb-9ba1-4ed7-b89e-75e5b9f4ad79 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:41.789180 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-014afeeb-9ba1-4ed7-b89e-75e5b9f4ad79 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:41.795946 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-014afeeb-9ba1-4ed7-b89e-75e5b9f4ad79 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:41.795946 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-014afeeb-9ba1-4ed7-b89e-75e5b9f4ad79 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:41.796799 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-014afeeb-9ba1-4ed7-b89e-75e5b9f4ad79 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:41.797205 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-014afeeb-9ba1-4ed7-b89e-75e5b9f4ad79 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:41.816197 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7784cd93-9bf3-46f1-afec-9884d7ef67d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:41.824077 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7784cd93-9bf3-46f1-afec-9884d7ef67d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.082029 Apr 06 16:55:41.824660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1060/2127] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:41 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:55:41.933933 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-014afeeb-9ba1-4ed7-b89e-75e5b9f4ad79 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:41.946092 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-014afeeb-9ba1-4ed7-b89e-75e5b9f4ad79 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.160847 Apr 06 16:55:41.946657 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1068/2128] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:41 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:42.442474 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a1eaa7ff-41fd-4216-82b7-5e09210ace95 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:42.443119 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a1eaa7ff-41fd-4216-82b7-5e09210ace95 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:42.450001 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1eaa7ff-41fd-4216-82b7-5e09210ace95 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:42.450451 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1eaa7ff-41fd-4216-82b7-5e09210ace95 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:42.451235 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1eaa7ff-41fd-4216-82b7-5e09210ace95 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:42.451670 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1eaa7ff-41fd-4216-82b7-5e09210ace95 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:42.609574 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a1eaa7ff-41fd-4216-82b7-5e09210ace95 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:42.617684 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a1eaa7ff-41fd-4216-82b7-5e09210ace95 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.179147 Apr 06 16:55:42.618270 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1061/2129] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:42 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:42.802912 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c26ddcfb-4a5e-4070-89e6-ff0350f50a56 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:42.803872 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c26ddcfb-4a5e-4070-89e6-ff0350f50a56 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:42.810795 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c26ddcfb-4a5e-4070-89e6-ff0350f50a56 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:42.811245 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c26ddcfb-4a5e-4070-89e6-ff0350f50a56 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:42.812022 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c26ddcfb-4a5e-4070-89e6-ff0350f50a56 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:42.812460 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c26ddcfb-4a5e-4070-89e6-ff0350f50a56 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:42.843891 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-db928062-26bf-4b95-a21c-7a6b74f61694 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:42.844538 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-db928062-26bf-4b95-a21c-7a6b74f61694 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:42.851913 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db928062-26bf-4b95-a21c-7a6b74f61694 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:42.852350 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db928062-26bf-4b95-a21c-7a6b74f61694 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:42.853191 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db928062-26bf-4b95-a21c-7a6b74f61694 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:42.853634 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db928062-26bf-4b95-a21c-7a6b74f61694 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:42.916033 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-db928062-26bf-4b95-a21c-7a6b74f61694 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:42.924340 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-db928062-26bf-4b95-a21c-7a6b74f61694 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.084917 Apr 06 16:55:42.925120 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1062/2130] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:42 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:42.963640 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a2d95845-6a64-426e-87e1-2f1857c616eb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:42.964286 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a2d95845-6a64-426e-87e1-2f1857c616eb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:42.964762 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c26ddcfb-4a5e-4070-89e6-ff0350f50a56 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:42.970878 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2d95845-6a64-426e-87e1-2f1857c616eb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:42.971332 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2d95845-6a64-426e-87e1-2f1857c616eb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:42.972145 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2d95845-6a64-426e-87e1-2f1857c616eb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:42.972583 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2d95845-6a64-426e-87e1-2f1857c616eb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:42.973486 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c26ddcfb-4a5e-4070-89e6-ff0350f50a56 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:42.975853 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c26ddcfb-4a5e-4070-89e6-ff0350f50a56 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:42.977099 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c26ddcfb-4a5e-4070-89e6-ff0350f50a56 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.178244 Apr 06 16:55:42.977709 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1069/2131] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:42 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:43.129039 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a2d95845-6a64-426e-87e1-2f1857c616eb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:43.138211 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a2d95845-6a64-426e-87e1-2f1857c616eb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.178428 Apr 06 16:55:43.138703 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1063/2132] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:42 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:43.635296 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-014c3e95-68ae-48a0-bfe2-1859d8570589 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:43.635896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-014c3e95-68ae-48a0-bfe2-1859d8570589 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:43.642694 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-014c3e95-68ae-48a0-bfe2-1859d8570589 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:43.643145 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-014c3e95-68ae-48a0-bfe2-1859d8570589 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:43.644310 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-014c3e95-68ae-48a0-bfe2-1859d8570589 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:43.644862 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-014c3e95-68ae-48a0-bfe2-1859d8570589 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:43.793435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-014c3e95-68ae-48a0-bfe2-1859d8570589 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:43.802172 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-014c3e95-68ae-48a0-bfe2-1859d8570589 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.170593 Apr 06 16:55:43.803085 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1070/2133] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:43 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:43.943537 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-75ce7bb8-5ac7-4bdc-a4dc-c22610682088 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:43.944327 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-75ce7bb8-5ac7-4bdc-a4dc-c22610682088 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:43.954783 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75ce7bb8-5ac7-4bdc-a4dc-c22610682088 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:43.955503 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75ce7bb8-5ac7-4bdc-a4dc-c22610682088 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:43.956767 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75ce7bb8-5ac7-4bdc-a4dc-c22610682088 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:43.957525 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75ce7bb8-5ac7-4bdc-a4dc-c22610682088 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:43.997124 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8b54eac4-ddee-4ba0-a2ed-153c8a39298d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:43.997737 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8b54eac4-ddee-4ba0-a2ed-153c8a39298d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:44.004712 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b54eac4-ddee-4ba0-a2ed-153c8a39298d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:44.005176 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b54eac4-ddee-4ba0-a2ed-153c8a39298d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:44.005964 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b54eac4-ddee-4ba0-a2ed-153c8a39298d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:44.006575 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8b54eac4-ddee-4ba0-a2ed-153c8a39298d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:44.022221 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-75ce7bb8-5ac7-4bdc-a4dc-c22610682088 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:44.030620 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-75ce7bb8-5ac7-4bdc-a4dc-c22610682088 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.092161 Apr 06 16:55:44.031203 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1064/2134] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:43 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:44.154530 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8b54eac4-ddee-4ba0-a2ed-153c8a39298d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:44.157015 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e6abccfe-57c8-4984-b65c-d9ffd456bc92 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:44.157633 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e6abccfe-57c8-4984-b65c-d9ffd456bc92 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:44.163762 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8b54eac4-ddee-4ba0-a2ed-153c8a39298d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:44.164579 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6abccfe-57c8-4984-b65c-d9ffd456bc92 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:44.165132 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6abccfe-57c8-4984-b65c-d9ffd456bc92 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:44.165311 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8b54eac4-ddee-4ba0-a2ed-153c8a39298d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:44.165919 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6abccfe-57c8-4984-b65c-d9ffd456bc92 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:44.166348 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6abccfe-57c8-4984-b65c-d9ffd456bc92 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:44.166495 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8b54eac4-ddee-4ba0-a2ed-153c8a39298d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.173420 Apr 06 16:55:44.167054 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1071/2135] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:43 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:44.314984 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e6abccfe-57c8-4984-b65c-d9ffd456bc92 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:44.327834 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e6abccfe-57c8-4984-b65c-d9ffd456bc92 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.174381 Apr 06 16:55:44.328717 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1065/2136] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:44 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:44.821423 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a0ddf354-8b0c-437c-85dc-31d57d7e25cd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:44.822164 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a0ddf354-8b0c-437c-85dc-31d57d7e25cd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:44.828408 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0ddf354-8b0c-437c-85dc-31d57d7e25cd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:44.828905 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0ddf354-8b0c-437c-85dc-31d57d7e25cd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:44.829704 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0ddf354-8b0c-437c-85dc-31d57d7e25cd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:44.830135 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a0ddf354-8b0c-437c-85dc-31d57d7e25cd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:44.979717 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a0ddf354-8b0c-437c-85dc-31d57d7e25cd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:44.988826 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a0ddf354-8b0c-437c-85dc-31d57d7e25cd tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.171290 Apr 06 16:55:44.989419 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1072/2137] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:44 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:45.048055 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c33f3add-e7a2-45fd-9a23-7ebb6fb2fdd6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:45.048635 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c33f3add-e7a2-45fd-9a23-7ebb6fb2fdd6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:45.056415 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c33f3add-e7a2-45fd-9a23-7ebb6fb2fdd6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:45.056720 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c33f3add-e7a2-45fd-9a23-7ebb6fb2fdd6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:45.057483 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c33f3add-e7a2-45fd-9a23-7ebb6fb2fdd6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:45.057882 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c33f3add-e7a2-45fd-9a23-7ebb6fb2fdd6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:45.121883 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c33f3add-e7a2-45fd-9a23-7ebb6fb2fdd6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:45.130309 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c33f3add-e7a2-45fd-9a23-7ebb6fb2fdd6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086277 Apr 06 16:55:45.130930 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1066/2138] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:45 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:45.190175 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5d7bb881-1550-457e-8740-add474150733 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:45.191350 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5d7bb881-1550-457e-8740-add474150733 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:45.202412 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d7bb881-1550-457e-8740-add474150733 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:45.203209 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d7bb881-1550-457e-8740-add474150733 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:45.204603 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d7bb881-1550-457e-8740-add474150733 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:45.205395 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5d7bb881-1550-457e-8740-add474150733 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:45.347238 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b5c66df2-3307-484b-89dd-43598d09fe73 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:45.347936 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b5c66df2-3307-484b-89dd-43598d09fe73 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:45.355781 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5c66df2-3307-484b-89dd-43598d09fe73 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:45.356227 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5c66df2-3307-484b-89dd-43598d09fe73 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:45.357217 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5c66df2-3307-484b-89dd-43598d09fe73 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:45.357647 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5c66df2-3307-484b-89dd-43598d09fe73 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:45.365272 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5d7bb881-1550-457e-8740-add474150733 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:45.375316 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5d7bb881-1550-457e-8740-add474150733 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:45.377267 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5d7bb881-1550-457e-8740-add474150733 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:45.378426 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5d7bb881-1550-457e-8740-add474150733 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.195745 Apr 06 16:55:45.379282 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1073/2139] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:45 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:45.510252 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b5c66df2-3307-484b-89dd-43598d09fe73 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:45.518465 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b5c66df2-3307-484b-89dd-43598d09fe73 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.175685 Apr 06 16:55:45.519042 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1067/2140] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:45 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:55:46.008295 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7b15a9d4-3625-47be-a945-68764b9f14e5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:46.009053 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7b15a9d4-3625-47be-a945-68764b9f14e5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:46.015747 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b15a9d4-3625-47be-a945-68764b9f14e5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:46.016196 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b15a9d4-3625-47be-a945-68764b9f14e5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:46.017039 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b15a9d4-3625-47be-a945-68764b9f14e5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:46.017480 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b15a9d4-3625-47be-a945-68764b9f14e5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:46.149818 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-34fda7fb-76af-4ef0-8f23-4c789b9954d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:46.150885 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-34fda7fb-76af-4ef0-8f23-4c789b9954d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:46.160493 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34fda7fb-76af-4ef0-8f23-4c789b9954d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:46.161147 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34fda7fb-76af-4ef0-8f23-4c789b9954d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:46.162234 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34fda7fb-76af-4ef0-8f23-4c789b9954d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:46.162981 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34fda7fb-76af-4ef0-8f23-4c789b9954d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:46.186230 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7b15a9d4-3625-47be-a945-68764b9f14e5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:46.198967 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7b15a9d4-3625-47be-a945-68764b9f14e5 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.195346 Apr 06 16:55:46.199712 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1074/2141] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:46 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:46.237851 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-34fda7fb-76af-4ef0-8f23-4c789b9954d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:46.246280 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-34fda7fb-76af-4ef0-8f23-4c789b9954d7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.102449 Apr 06 16:55:46.246845 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1068/2142] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:46 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:55:46.397858 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-650cba83-cc22-4d8c-b1cd-64ea62b350aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:46.398469 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-650cba83-cc22-4d8c-b1cd-64ea62b350aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:46.405408 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-650cba83-cc22-4d8c-b1cd-64ea62b350aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:46.405858 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-650cba83-cc22-4d8c-b1cd-64ea62b350aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:46.406628 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-650cba83-cc22-4d8c-b1cd-64ea62b350aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:46.407077 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-650cba83-cc22-4d8c-b1cd-64ea62b350aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:46.538443 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-be255f0e-2b2b-413c-838f-454e82b4d747 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:46.538443 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-be255f0e-2b2b-413c-838f-454e82b4d747 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:46.542939 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be255f0e-2b2b-413c-838f-454e82b4d747 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:46.543388 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be255f0e-2b2b-413c-838f-454e82b4d747 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:46.544156 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be255f0e-2b2b-413c-838f-454e82b4d747 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:46.544587 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be255f0e-2b2b-413c-838f-454e82b4d747 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:46.555604 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-650cba83-cc22-4d8c-b1cd-64ea62b350aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:46.565064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-650cba83-cc22-4d8c-b1cd-64ea62b350aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:46.566542 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-650cba83-cc22-4d8c-b1cd-64ea62b350aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:46.567713 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-650cba83-cc22-4d8c-b1cd-64ea62b350aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.174139 Apr 06 16:55:46.568273 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1075/2143] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:46 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:46.690034 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-be255f0e-2b2b-413c-838f-454e82b4d747 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:46.699171 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-be255f0e-2b2b-413c-838f-454e82b4d747 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.167442 Apr 06 16:55:46.699771 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1069/2144] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:46 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:47.218306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d63f452c-3102-4522-9c63-ac96c633a668 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:47.218950 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d63f452c-3102-4522-9c63-ac96c633a668 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: d5d36d74-5240-44c1-8425-e1dedf7c6718] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:47.226418 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d63f452c-3102-4522-9c63-ac96c633a668 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:47.226845 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d63f452c-3102-4522-9c63-ac96c633a668 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:47.227641 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d63f452c-3102-4522-9c63-ac96c633a668 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:47.228077 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d63f452c-3102-4522-9c63-ac96c633a668 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:47.267546 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5b95ed75-d543-4b06-b434-5c2f36614504 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:47.268618 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5b95ed75-d543-4b06-b434-5c2f36614504 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:47.278235 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b95ed75-d543-4b06-b434-5c2f36614504 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:47.278686 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b95ed75-d543-4b06-b434-5c2f36614504 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:47.279468 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b95ed75-d543-4b06-b434-5c2f36614504 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:47.279904 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b95ed75-d543-4b06-b434-5c2f36614504 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:47.342350 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5b95ed75-d543-4b06-b434-5c2f36614504 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:47.351502 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5b95ed75-d543-4b06-b434-5c2f36614504 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.091180 Apr 06 16:55:47.352363 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1070/2145] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:47 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:55:47.388589 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d63f452c-3102-4522-9c63-ac96c633a668 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:47.397244 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d63f452c-3102-4522-9c63-ac96c633a668 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718" status: 200 len: 1730 microversion: 2.1 time: 0.182810 Apr 06 16:55:47.397801 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1076/2146] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:47 2022] GET /compute/v2.1/servers/d5d36d74-5240-44c1-8425-e1dedf7c6718 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:47.413906 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3f79e472-4a63-4179-a3c4-927f7052f237 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '.version_select at 0x7fa9ca2da160>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:47.436377 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3f79e472-4a63-4179-a3c4-927f7052f237 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1137461320" status: 202 len: 0 microversion: 2.1 time: 0.026836 Apr 06 16:55:47.436992 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1071/2147] 10.222.0.64 () {58 vars in 1220 bytes} [Wed Apr 6 16:55:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1137461320 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 06 16:55:47.587149 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cc82ef95-5563-48e0-a41b-83cf3a066248 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:47.587754 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cc82ef95-5563-48e0-a41b-83cf3a066248 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:47.594175 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc82ef95-5563-48e0-a41b-83cf3a066248 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:47.594575 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc82ef95-5563-48e0-a41b-83cf3a066248 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:47.595343 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc82ef95-5563-48e0-a41b-83cf3a066248 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:47.595770 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc82ef95-5563-48e0-a41b-83cf3a066248 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:47.717193 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7565b0f9-c941-43f1-9630-48e68f5280fa tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:47.717816 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7565b0f9-c941-43f1-9630-48e68f5280fa tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:47.724230 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7565b0f9-c941-43f1-9630-48e68f5280fa tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:47.724731 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7565b0f9-c941-43f1-9630-48e68f5280fa tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:47.726074 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7565b0f9-c941-43f1-9630-48e68f5280fa tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:47.726518 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7565b0f9-c941-43f1-9630-48e68f5280fa tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:47.754028 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-cc82ef95-5563-48e0-a41b-83cf3a066248 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:47.768537 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-cc82ef95-5563-48e0-a41b-83cf3a066248 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:47.771292 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-cc82ef95-5563-48e0-a41b-83cf3a066248 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:47.773524 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cc82ef95-5563-48e0-a41b-83cf3a066248 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.190552 Apr 06 16:55:47.774487 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1077/2148] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:47 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:47.987691 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7565b0f9-c941-43f1-9630-48e68f5280fa tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:47.996897 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7565b0f9-c941-43f1-9630-48e68f5280fa tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.283589 Apr 06 16:55:47.997438 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1072/2149] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:47 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:48.369824 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3c8d6ced-2ed6-43d6-874f-b2536e9e185d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:48.370520 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3c8d6ced-2ed6-43d6-874f-b2536e9e185d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:48.377772 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c8d6ced-2ed6-43d6-874f-b2536e9e185d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:48.378216 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c8d6ced-2ed6-43d6-874f-b2536e9e185d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:48.379032 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c8d6ced-2ed6-43d6-874f-b2536e9e185d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:48.379469 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3c8d6ced-2ed6-43d6-874f-b2536e9e185d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:48.450215 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3c8d6ced-2ed6-43d6-874f-b2536e9e185d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:48.461428 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3c8d6ced-2ed6-43d6-874f-b2536e9e185d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.095679 Apr 06 16:55:48.462040 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1078/2150] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:48 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:48.799993 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d2545a91-e5a8-4381-ad95-4f92070e39d1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:48.800432 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d2545a91-e5a8-4381-ad95-4f92070e39d1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:48.807627 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2545a91-e5a8-4381-ad95-4f92070e39d1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:48.808658 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2545a91-e5a8-4381-ad95-4f92070e39d1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:48.809820 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2545a91-e5a8-4381-ad95-4f92070e39d1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:48.810431 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2545a91-e5a8-4381-ad95-4f92070e39d1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:48.838973 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-e7725024-3d4e-4aa6-8455-d0a2940b15e1 req-9308f6b2-7b30-47aa-a9b6-df2414eab995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d36d74-5240-44c1-8425-e1dedf7c6718", "tag": "c7da763b-aba6-4b1e-ad62-c32222723c20"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:55:48.847611 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e7725024-3d4e-4aa6-8455-d0a2940b15e1 req-9308f6b2-7b30-47aa-a9b6-df2414eab995 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:48.848047 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-e7725024-3d4e-4aa6-8455-d0a2940b15e1 req-9308f6b2-7b30-47aa-a9b6-df2414eab995 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:48.860611 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-e7725024-3d4e-4aa6-8455-d0a2940b15e1 req-9308f6b2-7b30-47aa-a9b6-df2414eab995 service nova] Creating event network-changed:c7da763b-aba6-4b1e-ad62-c32222723c20 for instance d5d36d74-5240-44c1-8425-e1dedf7c6718 on hv-cinder-83684 Apr 06 16:55:48.866118 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-e7725024-3d4e-4aa6-8455-d0a2940b15e1 req-9308f6b2-7b30-47aa-a9b6-df2414eab995 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030799 Apr 06 16:55:48.867042 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1079/2151] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:55:48.999023 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d2545a91-e5a8-4381-ad95-4f92070e39d1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:49.011328 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d2545a91-e5a8-4381-ad95-4f92070e39d1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:49.013481 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d2545a91-e5a8-4381-ad95-4f92070e39d1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:49.014897 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d2545a91-e5a8-4381-ad95-4f92070e39d1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.219372 Apr 06 16:55:49.015572 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fd15a7e3-4dcd-4f38-9349-eedffd8cd47d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:49.016136 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1073/2152] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:48 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:49.016633 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fd15a7e3-4dcd-4f38-9349-eedffd8cd47d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:49.024778 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd15a7e3-4dcd-4f38-9349-eedffd8cd47d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:49.025529 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd15a7e3-4dcd-4f38-9349-eedffd8cd47d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:49.026501 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd15a7e3-4dcd-4f38-9349-eedffd8cd47d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:49.027098 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd15a7e3-4dcd-4f38-9349-eedffd8cd47d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:49.191273 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fd15a7e3-4dcd-4f38-9349-eedffd8cd47d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:49.200549 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fd15a7e3-4dcd-4f38-9349-eedffd8cd47d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.189714 Apr 06 16:55:49.201397 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1080/2153] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:49 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:49.481156 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dfb0f4aa-dd5f-40a8-b9db-24e51e8168bf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:49.483622 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dfb0f4aa-dd5f-40a8-b9db-24e51e8168bf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:49.492523 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfb0f4aa-dd5f-40a8-b9db-24e51e8168bf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:49.492523 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfb0f4aa-dd5f-40a8-b9db-24e51e8168bf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:49.493551 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfb0f4aa-dd5f-40a8-b9db-24e51e8168bf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:49.493984 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfb0f4aa-dd5f-40a8-b9db-24e51e8168bf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:49.559004 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-dfb0f4aa-dd5f-40a8-b9db-24e51e8168bf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:49.568377 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dfb0f4aa-dd5f-40a8-b9db-24e51e8168bf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.093197 Apr 06 16:55:49.569185 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1074/2154] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:49 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:50.038892 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-95a33fdd-465f-4f41-b877-d3f099db4d40 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:50.039673 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-95a33fdd-465f-4f41-b877-d3f099db4d40 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:50.046051 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95a33fdd-465f-4f41-b877-d3f099db4d40 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:50.046495 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95a33fdd-465f-4f41-b877-d3f099db4d40 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:50.047268 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95a33fdd-465f-4f41-b877-d3f099db4d40 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:50.047696 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95a33fdd-465f-4f41-b877-d3f099db4d40 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:50.189804 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-95a33fdd-465f-4f41-b877-d3f099db4d40 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:50.198869 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-95a33fdd-465f-4f41-b877-d3f099db4d40 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:50.200356 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-95a33fdd-465f-4f41-b877-d3f099db4d40 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:50.201553 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-95a33fdd-465f-4f41-b877-d3f099db4d40 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.168267 Apr 06 16:55:50.202110 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1081/2155] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:50 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:50.218217 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b4a4c28f-f838-43fa-a747-5f7b3395b604 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:50.218987 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b4a4c28f-f838-43fa-a747-5f7b3395b604 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:50.226569 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4a4c28f-f838-43fa-a747-5f7b3395b604 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:50.227018 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4a4c28f-f838-43fa-a747-5f7b3395b604 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:50.227799 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4a4c28f-f838-43fa-a747-5f7b3395b604 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:50.228231 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4a4c28f-f838-43fa-a747-5f7b3395b604 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:50.380756 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b4a4c28f-f838-43fa-a747-5f7b3395b604 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:50.389999 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b4a4c28f-f838-43fa-a747-5f7b3395b604 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.175733 Apr 06 16:55:50.390611 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1075/2156] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:50 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:50.588329 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-69c3d4a3-fc78-4023-b1af-84cf58010600 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:50.588948 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-69c3d4a3-fc78-4023-b1af-84cf58010600 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:50.596377 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69c3d4a3-fc78-4023-b1af-84cf58010600 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:50.596858 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69c3d4a3-fc78-4023-b1af-84cf58010600 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:50.597642 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69c3d4a3-fc78-4023-b1af-84cf58010600 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:50.598072 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69c3d4a3-fc78-4023-b1af-84cf58010600 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:50.662719 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-69c3d4a3-fc78-4023-b1af-84cf58010600 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:50.671339 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-69c3d4a3-fc78-4023-b1af-84cf58010600 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.087827 Apr 06 16:55:50.671942 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1082/2157] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:50 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:51.221547 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-559a1ad0-170c-43e2-ada3-44047df55945 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:51.222156 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-559a1ad0-170c-43e2-ada3-44047df55945 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:51.230615 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-559a1ad0-170c-43e2-ada3-44047df55945 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:51.231124 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-559a1ad0-170c-43e2-ada3-44047df55945 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:51.231859 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-559a1ad0-170c-43e2-ada3-44047df55945 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:51.232308 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-559a1ad0-170c-43e2-ada3-44047df55945 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:51.378442 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-559a1ad0-170c-43e2-ada3-44047df55945 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:51.392427 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-559a1ad0-170c-43e2-ada3-44047df55945 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:51.394673 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-559a1ad0-170c-43e2-ada3-44047df55945 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:51.396466 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-559a1ad0-170c-43e2-ada3-44047df55945 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.178612 Apr 06 16:55:51.397340 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1076/2158] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:51 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:51.407397 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-920030c8-f176-41e4-b556-87c9cb68b8b3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:51.408005 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-920030c8-f176-41e4-b556-87c9cb68b8b3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:51.414928 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-920030c8-f176-41e4-b556-87c9cb68b8b3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:51.415344 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-920030c8-f176-41e4-b556-87c9cb68b8b3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:51.416140 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-920030c8-f176-41e4-b556-87c9cb68b8b3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:51.416566 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-920030c8-f176-41e4-b556-87c9cb68b8b3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:51.572320 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-920030c8-f176-41e4-b556-87c9cb68b8b3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:51.580957 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-920030c8-f176-41e4-b556-87c9cb68b8b3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.177332 Apr 06 16:55:51.581542 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1083/2159] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:51 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:51.689264 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-94b41f24-2550-4508-8bf7-57bc1485984d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:51.689879 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-94b41f24-2550-4508-8bf7-57bc1485984d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:51.697904 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94b41f24-2550-4508-8bf7-57bc1485984d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:51.698549 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94b41f24-2550-4508-8bf7-57bc1485984d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:51.699516 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94b41f24-2550-4508-8bf7-57bc1485984d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:51.699946 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94b41f24-2550-4508-8bf7-57bc1485984d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:51.766152 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-94b41f24-2550-4508-8bf7-57bc1485984d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:51.778098 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-94b41f24-2550-4508-8bf7-57bc1485984d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.092381 Apr 06 16:55:51.779102 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1077/2160] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:51 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:52.416121 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9473ba01-6fbe-42aa-844d-cb28023ca85d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:52.416806 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9473ba01-6fbe-42aa-844d-cb28023ca85d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:52.423633 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9473ba01-6fbe-42aa-844d-cb28023ca85d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:52.424075 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9473ba01-6fbe-42aa-844d-cb28023ca85d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:52.424847 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9473ba01-6fbe-42aa-844d-cb28023ca85d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:52.425301 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9473ba01-6fbe-42aa-844d-cb28023ca85d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:52.572345 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9473ba01-6fbe-42aa-844d-cb28023ca85d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:52.581449 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9473ba01-6fbe-42aa-844d-cb28023ca85d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:52.582881 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9473ba01-6fbe-42aa-844d-cb28023ca85d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:52.584003 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9473ba01-6fbe-42aa-844d-cb28023ca85d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.172091 Apr 06 16:55:52.584556 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1084/2161] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:52 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:52.598902 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7c95c565-1bac-41bb-95af-d67f1a78a670 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:52.599534 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7c95c565-1bac-41bb-95af-d67f1a78a670 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:52.606963 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c95c565-1bac-41bb-95af-d67f1a78a670 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:52.607411 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c95c565-1bac-41bb-95af-d67f1a78a670 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:52.608185 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c95c565-1bac-41bb-95af-d67f1a78a670 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:52.608632 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c95c565-1bac-41bb-95af-d67f1a78a670 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:52.750643 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7c95c565-1bac-41bb-95af-d67f1a78a670 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:52.759657 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7c95c565-1bac-41bb-95af-d67f1a78a670 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.164715 Apr 06 16:55:52.760241 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1078/2162] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:52 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:52.796464 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-629eb391-c654-429f-b081-5daef0befefc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:52.797124 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-629eb391-c654-429f-b081-5daef0befefc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:52.803681 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-629eb391-c654-429f-b081-5daef0befefc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:52.804111 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-629eb391-c654-429f-b081-5daef0befefc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:52.805585 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-629eb391-c654-429f-b081-5daef0befefc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:52.806025 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-629eb391-c654-429f-b081-5daef0befefc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:52.870052 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-629eb391-c654-429f-b081-5daef0befefc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:52.878540 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-629eb391-c654-429f-b081-5daef0befefc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.085933 Apr 06 16:55:52.879128 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1085/2163] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:52 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:53.604046 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9bf5688f-474d-45ac-9461-b70efaf570d5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:53.604640 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9bf5688f-474d-45ac-9461-b70efaf570d5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:53.611424 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bf5688f-474d-45ac-9461-b70efaf570d5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:53.611874 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bf5688f-474d-45ac-9461-b70efaf570d5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:53.612623 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bf5688f-474d-45ac-9461-b70efaf570d5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:53.613127 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bf5688f-474d-45ac-9461-b70efaf570d5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:53.760370 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9bf5688f-474d-45ac-9461-b70efaf570d5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:53.769749 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9bf5688f-474d-45ac-9461-b70efaf570d5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:53.771791 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9bf5688f-474d-45ac-9461-b70efaf570d5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:53.773010 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9bf5688f-474d-45ac-9461-b70efaf570d5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.173733 Apr 06 16:55:53.773850 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1079/2164] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:53 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:53.778190 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f0902f53-9118-482f-8480-a1c66e4f4f82 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:53.778833 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f0902f53-9118-482f-8480-a1c66e4f4f82 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:53.785773 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0902f53-9118-482f-8480-a1c66e4f4f82 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:53.786228 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0902f53-9118-482f-8480-a1c66e4f4f82 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:53.786993 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0902f53-9118-482f-8480-a1c66e4f4f82 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:53.787425 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0902f53-9118-482f-8480-a1c66e4f4f82 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:53.896120 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-33f6d05c-5c1c-47fb-bbb5-0cdda9740a63 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:53.896822 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-33f6d05c-5c1c-47fb-bbb5-0cdda9740a63 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:53.905410 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33f6d05c-5c1c-47fb-bbb5-0cdda9740a63 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:53.905852 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33f6d05c-5c1c-47fb-bbb5-0cdda9740a63 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:53.906633 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33f6d05c-5c1c-47fb-bbb5-0cdda9740a63 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:53.907062 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33f6d05c-5c1c-47fb-bbb5-0cdda9740a63 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:53.953392 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f0902f53-9118-482f-8480-a1c66e4f4f82 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:53.962120 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f0902f53-9118-482f-8480-a1c66e4f4f82 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.188281 Apr 06 16:55:53.962958 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1086/2165] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:53 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:55:53.975937 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-33f6d05c-5c1c-47fb-bbb5-0cdda9740a63 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:53.984569 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-33f6d05c-5c1c-47fb-bbb5-0cdda9740a63 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.093014 Apr 06 16:55:53.985251 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1080/2166] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:53 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:55:54.798184 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-daec69de-4d78-49af-bea5-899f0a77b43b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:54.798849 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-daec69de-4d78-49af-bea5-899f0a77b43b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:54.805538 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daec69de-4d78-49af-bea5-899f0a77b43b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:54.805990 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daec69de-4d78-49af-bea5-899f0a77b43b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:54.806759 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daec69de-4d78-49af-bea5-899f0a77b43b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:54.807203 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-daec69de-4d78-49af-bea5-899f0a77b43b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:54.963572 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-daec69de-4d78-49af-bea5-899f0a77b43b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:54.972961 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-daec69de-4d78-49af-bea5-899f0a77b43b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:54.974460 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-daec69de-4d78-49af-bea5-899f0a77b43b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:54.976202 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-daec69de-4d78-49af-bea5-899f0a77b43b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.181760 Apr 06 16:55:54.976804 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1087/2167] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:54 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:54.983164 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7c4b0ea4-d1df-4d7f-a64e-8fd4fa53439f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:54.983745 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7c4b0ea4-d1df-4d7f-a64e-8fd4fa53439f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:54.990463 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c4b0ea4-d1df-4d7f-a64e-8fd4fa53439f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:54.990924 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c4b0ea4-d1df-4d7f-a64e-8fd4fa53439f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:54.991684 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c4b0ea4-d1df-4d7f-a64e-8fd4fa53439f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:54.992111 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c4b0ea4-d1df-4d7f-a64e-8fd4fa53439f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:55.004501 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8cb27710-c87a-4d3d-81d5-b16e7c9f3812 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:55.005653 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8cb27710-c87a-4d3d-81d5-b16e7c9f3812 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:55.015506 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8cb27710-c87a-4d3d-81d5-b16e7c9f3812 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:55.016410 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8cb27710-c87a-4d3d-81d5-b16e7c9f3812 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:55.017696 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8cb27710-c87a-4d3d-81d5-b16e7c9f3812 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:55.018398 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8cb27710-c87a-4d3d-81d5-b16e7c9f3812 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:55.092617 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8cb27710-c87a-4d3d-81d5-b16e7c9f3812 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:55.101122 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8cb27710-c87a-4d3d-81d5-b16e7c9f3812 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.103000 Apr 06 16:55:55.101838 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1088/2168] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:54 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:55:55.162449 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7c4b0ea4-d1df-4d7f-a64e-8fd4fa53439f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:55.171621 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7c4b0ea4-d1df-4d7f-a64e-8fd4fa53439f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.192477 Apr 06 16:55:55.172282 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1081/2169] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:54 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:55:55.995623 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-25db4fe0-7e20-42cb-91c9-5ec34d513e35 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:55.996272 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-25db4fe0-7e20-42cb-91c9-5ec34d513e35 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:56.002928 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25db4fe0-7e20-42cb-91c9-5ec34d513e35 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:56.003373 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25db4fe0-7e20-42cb-91c9-5ec34d513e35 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:56.004134 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25db4fe0-7e20-42cb-91c9-5ec34d513e35 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:56.004567 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25db4fe0-7e20-42cb-91c9-5ec34d513e35 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:56.123121 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9c4d514b-266d-4371-8853-b3260fdea1a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:56.124355 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9c4d514b-266d-4371-8853-b3260fdea1a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:56.133624 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c4d514b-266d-4371-8853-b3260fdea1a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:56.134297 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c4d514b-266d-4371-8853-b3260fdea1a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:56.135574 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c4d514b-266d-4371-8853-b3260fdea1a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:56.136331 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c4d514b-266d-4371-8853-b3260fdea1a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:56.181841 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-25db4fe0-7e20-42cb-91c9-5ec34d513e35 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:56.193436 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-25db4fe0-7e20-42cb-91c9-5ec34d513e35 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:56.194945 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-25db4fe0-7e20-42cb-91c9-5ec34d513e35 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:56.196203 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-25db4fe0-7e20-42cb-91c9-5ec34d513e35 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.204645 Apr 06 16:55:56.196800 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1089/2170] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:55 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:56.201442 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0bc9baa2-6a31-4eb0-ad2c-5bf0b4dd6900 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:56.201909 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0bc9baa2-6a31-4eb0-ad2c-5bf0b4dd6900 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:56.207183 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9c4d514b-266d-4371-8853-b3260fdea1a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:56.208175 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bc9baa2-6a31-4eb0-ad2c-5bf0b4dd6900 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:56.208629 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bc9baa2-6a31-4eb0-ad2c-5bf0b4dd6900 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:56.209542 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bc9baa2-6a31-4eb0-ad2c-5bf0b4dd6900 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:56.209976 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bc9baa2-6a31-4eb0-ad2c-5bf0b4dd6900 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:56.216203 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9c4d514b-266d-4371-8853-b3260fdea1a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.099851 Apr 06 16:55:56.216790 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1082/2171] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:56 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:56.352472 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0bc9baa2-6a31-4eb0-ad2c-5bf0b4dd6900 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:56.360928 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0bc9baa2-6a31-4eb0-ad2c-5bf0b4dd6900 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.163044 Apr 06 16:55:56.361515 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1090/2172] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:56 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:57.215613 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4413c5f9-62dc-4621-87f1-aae05ecccc05 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:57.216272 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4413c5f9-62dc-4621-87f1-aae05ecccc05 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:57.224848 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4413c5f9-62dc-4621-87f1-aae05ecccc05 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:57.225302 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4413c5f9-62dc-4621-87f1-aae05ecccc05 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:57.226723 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4413c5f9-62dc-4621-87f1-aae05ecccc05 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:57.226983 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4413c5f9-62dc-4621-87f1-aae05ecccc05 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:57.235553 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-67a939b6-e26f-4d71-98dd-0f2a72617ec8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:57.236267 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-67a939b6-e26f-4d71-98dd-0f2a72617ec8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:57.243131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-67a939b6-e26f-4d71-98dd-0f2a72617ec8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:57.243579 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-67a939b6-e26f-4d71-98dd-0f2a72617ec8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:57.244368 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-67a939b6-e26f-4d71-98dd-0f2a72617ec8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:57.244807 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-67a939b6-e26f-4d71-98dd-0f2a72617ec8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:57.314630 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-67a939b6-e26f-4d71-98dd-0f2a72617ec8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:57.327921 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-67a939b6-e26f-4d71-98dd-0f2a72617ec8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.096483 Apr 06 16:55:57.329518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1091/2173] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:57 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:57.368704 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4413c5f9-62dc-4621-87f1-aae05ecccc05 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:57.378244 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4413c5f9-62dc-4621-87f1-aae05ecccc05 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:57.379136 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0f0d6344-ba53-41ab-bdaf-e9b3cd5faf13 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:57.379743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4413c5f9-62dc-4621-87f1-aae05ecccc05 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:57.379871 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0f0d6344-ba53-41ab-bdaf-e9b3cd5faf13 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:57.380961 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4413c5f9-62dc-4621-87f1-aae05ecccc05 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.169524 Apr 06 16:55:57.381572 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1083/2174] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:57 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:57.387602 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f0d6344-ba53-41ab-bdaf-e9b3cd5faf13 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:57.388138 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f0d6344-ba53-41ab-bdaf-e9b3cd5faf13 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:57.388962 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f0d6344-ba53-41ab-bdaf-e9b3cd5faf13 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:57.389410 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f0d6344-ba53-41ab-bdaf-e9b3cd5faf13 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:57.533554 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0f0d6344-ba53-41ab-bdaf-e9b3cd5faf13 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:57.542946 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0f0d6344-ba53-41ab-bdaf-e9b3cd5faf13 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.167965 Apr 06 16:55:57.543574 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1092/2175] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:57 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:58.346051 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ad3a9ba4-f16a-41b1-bae9-e4e9b0673fe4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:58.346687 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ad3a9ba4-f16a-41b1-bae9-e4e9b0673fe4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:58.354317 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad3a9ba4-f16a-41b1-bae9-e4e9b0673fe4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:58.354767 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad3a9ba4-f16a-41b1-bae9-e4e9b0673fe4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:58.355520 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad3a9ba4-f16a-41b1-bae9-e4e9b0673fe4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:58.355955 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad3a9ba4-f16a-41b1-bae9-e4e9b0673fe4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:58.399987 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-39a804fb-2754-4261-9c89-55983dfbd7dd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:58.400710 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-39a804fb-2754-4261-9c89-55983dfbd7dd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:58.407454 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39a804fb-2754-4261-9c89-55983dfbd7dd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:58.408000 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39a804fb-2754-4261-9c89-55983dfbd7dd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:58.408827 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39a804fb-2754-4261-9c89-55983dfbd7dd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:58.409261 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39a804fb-2754-4261-9c89-55983dfbd7dd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:58.423440 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ad3a9ba4-f16a-41b1-bae9-e4e9b0673fe4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:58.432027 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ad3a9ba4-f16a-41b1-bae9-e4e9b0673fe4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.089815 Apr 06 16:55:58.432608 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1084/2176] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:58 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:58.560951 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-39a804fb-2754-4261-9c89-55983dfbd7dd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:58.561346 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0ecac82f-b4db-487e-a950-52ad417c8933 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:58.561960 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0ecac82f-b4db-487e-a950-52ad417c8933 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:58.568254 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ecac82f-b4db-487e-a950-52ad417c8933 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:58.568678 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ecac82f-b4db-487e-a950-52ad417c8933 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:58.569533 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-39a804fb-2754-4261-9c89-55983dfbd7dd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:58.569712 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ecac82f-b4db-487e-a950-52ad417c8933 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:58.569987 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ecac82f-b4db-487e-a950-52ad417c8933 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:58.571860 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-39a804fb-2754-4261-9c89-55983dfbd7dd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:58.573092 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-39a804fb-2754-4261-9c89-55983dfbd7dd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.177476 Apr 06 16:55:58.573814 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1093/2177] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:58 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:58.736905 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0ecac82f-b4db-487e-a950-52ad417c8933 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:58.745392 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0ecac82f-b4db-487e-a950-52ad417c8933 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.188003 Apr 06 16:55:58.745972 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1085/2178] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:58 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:59.449993 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-826b5f16-fcb9-486f-a9e4-96ef7d7ac7c8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:59.450636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-826b5f16-fcb9-486f-a9e4-96ef7d7ac7c8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:59.459397 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-826b5f16-fcb9-486f-a9e4-96ef7d7ac7c8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:59.459397 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-826b5f16-fcb9-486f-a9e4-96ef7d7ac7c8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:59.459855 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-826b5f16-fcb9-486f-a9e4-96ef7d7ac7c8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:59.460495 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-826b5f16-fcb9-486f-a9e4-96ef7d7ac7c8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:59.535788 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-826b5f16-fcb9-486f-a9e4-96ef7d7ac7c8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:59.556658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-826b5f16-fcb9-486f-a9e4-96ef7d7ac7c8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.110907 Apr 06 16:55:59.557319 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1094/2179] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:59 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:55:59.592197 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6702b7f8-4d9a-4fbd-b3c3-9573e68f148d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:59.592912 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6702b7f8-4d9a-4fbd-b3c3-9573e68f148d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:59.601265 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6702b7f8-4d9a-4fbd-b3c3-9573e68f148d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:59.601821 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6702b7f8-4d9a-4fbd-b3c3-9573e68f148d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:59.602579 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6702b7f8-4d9a-4fbd-b3c3-9573e68f148d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:59.603026 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6702b7f8-4d9a-4fbd-b3c3-9573e68f148d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:59.751442 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6702b7f8-4d9a-4fbd-b3c3-9573e68f148d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:59.761360 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6702b7f8-4d9a-4fbd-b3c3-9573e68f148d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:59.762878 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6702b7f8-4d9a-4fbd-b3c3-9573e68f148d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:59.763057 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f42ea099-49b5-49f0-a5e6-c5420e6b0549 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:55:59.763600 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f42ea099-49b5-49f0-a5e6-c5420e6b0549 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:55:59.764095 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6702b7f8-4d9a-4fbd-b3c3-9573e68f148d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.176014 Apr 06 16:55:59.764650 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1086/2180] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:55:59 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:55:59.769989 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f42ea099-49b5-49f0-a5e6-c5420e6b0549 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:59.770427 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f42ea099-49b5-49f0-a5e6-c5420e6b0549 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:59.771203 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f42ea099-49b5-49f0-a5e6-c5420e6b0549 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:55:59.771692 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f42ea099-49b5-49f0-a5e6-c5420e6b0549 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:55:59.920243 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f42ea099-49b5-49f0-a5e6-c5420e6b0549 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:55:59.928907 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f42ea099-49b5-49f0-a5e6-c5420e6b0549 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.169798 Apr 06 16:55:59.929660 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1095/2181] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:55:59 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:00.575746 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-daf7e69e-0ce6-4de0-b679-e07696e54d80 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:00.576362 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-daf7e69e-0ce6-4de0-b679-e07696e54d80 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:00.583133 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-daf7e69e-0ce6-4de0-b679-e07696e54d80 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:00.583499 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-daf7e69e-0ce6-4de0-b679-e07696e54d80 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:00.584282 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-daf7e69e-0ce6-4de0-b679-e07696e54d80 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:00.584726 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-daf7e69e-0ce6-4de0-b679-e07696e54d80 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:00.666222 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-daf7e69e-0ce6-4de0-b679-e07696e54d80 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:00.674446 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-daf7e69e-0ce6-4de0-b679-e07696e54d80 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.102704 Apr 06 16:56:00.674993 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1087/2182] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:00 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:00.783602 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-690acb2d-b7d9-4f5f-9ec8-8ba85495037c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:00.784219 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-690acb2d-b7d9-4f5f-9ec8-8ba85495037c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:00.792161 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-690acb2d-b7d9-4f5f-9ec8-8ba85495037c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:00.792612 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-690acb2d-b7d9-4f5f-9ec8-8ba85495037c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:00.793396 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-690acb2d-b7d9-4f5f-9ec8-8ba85495037c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:00.793858 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-690acb2d-b7d9-4f5f-9ec8-8ba85495037c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:00.939470 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-690acb2d-b7d9-4f5f-9ec8-8ba85495037c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:00.952916 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2af6d998-3f2c-4211-b83e-6ccd68af56e2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:00.953777 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-690acb2d-b7d9-4f5f-9ec8-8ba85495037c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:00.953967 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2af6d998-3f2c-4211-b83e-6ccd68af56e2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:00.955273 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-690acb2d-b7d9-4f5f-9ec8-8ba85495037c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:00.956457 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-690acb2d-b7d9-4f5f-9ec8-8ba85495037c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.176826 Apr 06 16:56:00.957065 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1096/2183] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:00 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:00.964672 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2af6d998-3f2c-4211-b83e-6ccd68af56e2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:00.965141 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2af6d998-3f2c-4211-b83e-6ccd68af56e2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:00.965948 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2af6d998-3f2c-4211-b83e-6ccd68af56e2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:00.966382 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2af6d998-3f2c-4211-b83e-6ccd68af56e2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:01.120398 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2af6d998-3f2c-4211-b83e-6ccd68af56e2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:01.127438 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2af6d998-3f2c-4211-b83e-6ccd68af56e2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.179721 Apr 06 16:56:01.128172 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1088/2184] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:00 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:01.697123 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4da7a4b1-d1cd-40a6-8c1b-2aac819f0f05 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:01.697732 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4da7a4b1-d1cd-40a6-8c1b-2aac819f0f05 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:01.706335 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4da7a4b1-d1cd-40a6-8c1b-2aac819f0f05 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:01.707379 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4da7a4b1-d1cd-40a6-8c1b-2aac819f0f05 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:01.708648 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4da7a4b1-d1cd-40a6-8c1b-2aac819f0f05 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:01.709559 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4da7a4b1-d1cd-40a6-8c1b-2aac819f0f05 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:01.780775 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4da7a4b1-d1cd-40a6-8c1b-2aac819f0f05 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:01.790134 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4da7a4b1-d1cd-40a6-8c1b-2aac819f0f05 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.098410 Apr 06 16:56:01.790809 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1097/2185] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:01 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:01.975247 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f04203dd-c5c2-43a3-9fae-8fcc3c180090 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:01.976255 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f04203dd-c5c2-43a3-9fae-8fcc3c180090 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:01.983218 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f04203dd-c5c2-43a3-9fae-8fcc3c180090 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:01.983692 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f04203dd-c5c2-43a3-9fae-8fcc3c180090 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:01.984429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f04203dd-c5c2-43a3-9fae-8fcc3c180090 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:01.984893 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f04203dd-c5c2-43a3-9fae-8fcc3c180090 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:02.126916 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f04203dd-c5c2-43a3-9fae-8fcc3c180090 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:02.141412 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f04203dd-c5c2-43a3-9fae-8fcc3c180090 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:02.142977 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f04203dd-c5c2-43a3-9fae-8fcc3c180090 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:02.144173 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f04203dd-c5c2-43a3-9fae-8fcc3c180090 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.173000 Apr 06 16:56:02.145071 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1089/2186] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:01 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:02.148060 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b185fc8e-431d-4b7c-a8f1-1b928d49fb1b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:02.148660 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b185fc8e-431d-4b7c-a8f1-1b928d49fb1b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:02.156114 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b185fc8e-431d-4b7c-a8f1-1b928d49fb1b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:02.156558 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b185fc8e-431d-4b7c-a8f1-1b928d49fb1b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:02.157369 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b185fc8e-431d-4b7c-a8f1-1b928d49fb1b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:02.157783 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b185fc8e-431d-4b7c-a8f1-1b928d49fb1b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:02.305051 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b185fc8e-431d-4b7c-a8f1-1b928d49fb1b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:02.313624 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b185fc8e-431d-4b7c-a8f1-1b928d49fb1b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.169516 Apr 06 16:56:02.314211 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1098/2187] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:02 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:02.807716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e2452067-3fad-4f22-8f06-ac0060d9e88c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:02.808367 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e2452067-3fad-4f22-8f06-ac0060d9e88c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:02.815429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2452067-3fad-4f22-8f06-ac0060d9e88c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:02.815989 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2452067-3fad-4f22-8f06-ac0060d9e88c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:02.816857 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2452067-3fad-4f22-8f06-ac0060d9e88c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:02.817349 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2452067-3fad-4f22-8f06-ac0060d9e88c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:02.886091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e2452067-3fad-4f22-8f06-ac0060d9e88c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:02.895591 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e2452067-3fad-4f22-8f06-ac0060d9e88c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.091895 Apr 06 16:56:02.896310 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1090/2188] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:02 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:03.166899 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aeb4351d-df7c-4d1b-82b7-0800046a3550 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:03.168010 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aeb4351d-df7c-4d1b-82b7-0800046a3550 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:03.178802 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aeb4351d-df7c-4d1b-82b7-0800046a3550 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:03.179588 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aeb4351d-df7c-4d1b-82b7-0800046a3550 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:03.180983 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aeb4351d-df7c-4d1b-82b7-0800046a3550 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:03.181757 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aeb4351d-df7c-4d1b-82b7-0800046a3550 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:03.334013 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8ebe3730-7c6f-44c5-b2f3-74fc6351f61b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:03.334668 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8ebe3730-7c6f-44c5-b2f3-74fc6351f61b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:03.343548 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ebe3730-7c6f-44c5-b2f3-74fc6351f61b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:03.344149 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ebe3730-7c6f-44c5-b2f3-74fc6351f61b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:03.345364 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ebe3730-7c6f-44c5-b2f3-74fc6351f61b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:03.345977 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ebe3730-7c6f-44c5-b2f3-74fc6351f61b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:03.360434 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-aeb4351d-df7c-4d1b-82b7-0800046a3550 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:03.370497 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-aeb4351d-df7c-4d1b-82b7-0800046a3550 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:03.372009 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-aeb4351d-df7c-4d1b-82b7-0800046a3550 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:03.373216 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aeb4351d-df7c-4d1b-82b7-0800046a3550 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.213913 Apr 06 16:56:03.373752 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1099/2189] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:03 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:03.486131 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8ebe3730-7c6f-44c5-b2f3-74fc6351f61b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:03.494744 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8ebe3730-7c6f-44c5-b2f3-74fc6351f61b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.164790 Apr 06 16:56:03.495316 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1091/2190] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:03 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:03.913804 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-efe82c79-79b4-4c2e-8df2-48910b5cd139 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:03.914422 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-efe82c79-79b4-4c2e-8df2-48910b5cd139 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:03.920865 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efe82c79-79b4-4c2e-8df2-48910b5cd139 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:03.921297 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efe82c79-79b4-4c2e-8df2-48910b5cd139 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:03.922052 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efe82c79-79b4-4c2e-8df2-48910b5cd139 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:03.922477 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-efe82c79-79b4-4c2e-8df2-48910b5cd139 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:03.990716 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-efe82c79-79b4-4c2e-8df2-48910b5cd139 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:04.002383 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-efe82c79-79b4-4c2e-8df2-48910b5cd139 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.092586 Apr 06 16:56:04.003104 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1100/2191] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:03 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:04.391575 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ffad8d5a-5d19-4138-bc06-94e2e1419fde tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:04.392255 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ffad8d5a-5d19-4138-bc06-94e2e1419fde tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:04.399394 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffad8d5a-5d19-4138-bc06-94e2e1419fde tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:04.400031 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffad8d5a-5d19-4138-bc06-94e2e1419fde tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:04.401807 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffad8d5a-5d19-4138-bc06-94e2e1419fde tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:04.402245 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffad8d5a-5d19-4138-bc06-94e2e1419fde tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:04.512657 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6a3b5c91-b5d9-4313-8b0e-0362c699962d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:04.513344 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6a3b5c91-b5d9-4313-8b0e-0362c699962d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:04.522348 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6a3b5c91-b5d9-4313-8b0e-0362c699962d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:04.522877 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6a3b5c91-b5d9-4313-8b0e-0362c699962d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:04.523832 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6a3b5c91-b5d9-4313-8b0e-0362c699962d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:04.524376 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6a3b5c91-b5d9-4313-8b0e-0362c699962d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:04.575974 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ffad8d5a-5d19-4138-bc06-94e2e1419fde tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:04.585401 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ffad8d5a-5d19-4138-bc06-94e2e1419fde tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:04.587062 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ffad8d5a-5d19-4138-bc06-94e2e1419fde tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:04.588291 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ffad8d5a-5d19-4138-bc06-94e2e1419fde tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.200969 Apr 06 16:56:04.588911 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1092/2192] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:04 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:04.669694 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6a3b5c91-b5d9-4313-8b0e-0362c699962d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:04.677961 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6a3b5c91-b5d9-4313-8b0e-0362c699962d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.170211 Apr 06 16:56:04.678571 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1101/2193] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:04 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:56:05.021378 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e271a780-3eba-457d-a13c-a01dd67510e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:05.021996 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e271a780-3eba-457d-a13c-a01dd67510e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:05.028836 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e271a780-3eba-457d-a13c-a01dd67510e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:05.029340 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e271a780-3eba-457d-a13c-a01dd67510e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:05.030292 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e271a780-3eba-457d-a13c-a01dd67510e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:05.030738 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e271a780-3eba-457d-a13c-a01dd67510e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:05.099527 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e271a780-3eba-457d-a13c-a01dd67510e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:05.110965 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e271a780-3eba-457d-a13c-a01dd67510e8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.093653 Apr 06 16:56:05.111558 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1093/2194] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:05 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:56:05.608411 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-04d261e6-ce44-4436-9d63-dffec1ebc9b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:05.608893 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-04d261e6-ce44-4436-9d63-dffec1ebc9b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:05.615462 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04d261e6-ce44-4436-9d63-dffec1ebc9b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:05.616082 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04d261e6-ce44-4436-9d63-dffec1ebc9b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:05.617041 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04d261e6-ce44-4436-9d63-dffec1ebc9b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:05.617521 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04d261e6-ce44-4436-9d63-dffec1ebc9b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:05.696444 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-765c125b-4d4c-4ac4-b392-be9eb82cbe57 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:05.697213 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-765c125b-4d4c-4ac4-b392-be9eb82cbe57 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:05.703547 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-765c125b-4d4c-4ac4-b392-be9eb82cbe57 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:05.704198 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-765c125b-4d4c-4ac4-b392-be9eb82cbe57 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:05.705098 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-765c125b-4d4c-4ac4-b392-be9eb82cbe57 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:05.705688 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-765c125b-4d4c-4ac4-b392-be9eb82cbe57 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:05.774830 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-04d261e6-ce44-4436-9d63-dffec1ebc9b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:05.785140 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-04d261e6-ce44-4436-9d63-dffec1ebc9b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:05.786839 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-04d261e6-ce44-4436-9d63-dffec1ebc9b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:05.788092 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-04d261e6-ce44-4436-9d63-dffec1ebc9b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.184117 Apr 06 16:56:05.788658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1102/2195] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:05 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:05.795112 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ee9a6e4d-f872-4f50-a1b9-545554ce80ab tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:05.795982 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ee9a6e4d-f872-4f50-a1b9-545554ce80ab tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:05.808946 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee9a6e4d-f872-4f50-a1b9-545554ce80ab tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:05.809660 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee9a6e4d-f872-4f50-a1b9-545554ce80ab tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:05.810539 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee9a6e4d-f872-4f50-a1b9-545554ce80ab tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:05.811021 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee9a6e4d-f872-4f50-a1b9-545554ce80ab tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:05.846479 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ee9a6e4d-f872-4f50-a1b9-545554ce80ab tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 06 16:56:05.880337 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-765c125b-4d4c-4ac4-b392-be9eb82cbe57 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:05.889204 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-765c125b-4d4c-4ac4-b392-be9eb82cbe57 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.196992 Apr 06 16:56:05.889796 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1094/2196] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:05 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:05.956632 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ee9a6e4d-f872-4f50-a1b9-545554ce80ab tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 204 len: 0 microversion: 2.1 time: 0.165833 Apr 06 16:56:05.957204 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1103/2197] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 16:56:05 2022] DELETE /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 06 16:56:05.966948 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6206e6f2-1742-4e4d-a313-7cd435bc7a7f tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:05.967556 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6206e6f2-1742-4e4d-a313-7cd435bc7a7f tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:05.973534 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6206e6f2-1742-4e4d-a313-7cd435bc7a7f tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:05.973971 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6206e6f2-1742-4e4d-a313-7cd435bc7a7f tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:05.974765 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6206e6f2-1742-4e4d-a313-7cd435bc7a7f tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:05.975190 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6206e6f2-1742-4e4d-a313-7cd435bc7a7f tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:06.126461 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6206e6f2-1742-4e4d-a313-7cd435bc7a7f tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:06.128291 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5130e82c-81db-4da0-ac8c-cda1ed8fca60 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:06.129185 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5130e82c-81db-4da0-ac8c-cda1ed8fca60 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:06.135787 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5130e82c-81db-4da0-ac8c-cda1ed8fca60 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:06.136271 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5130e82c-81db-4da0-ac8c-cda1ed8fca60 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:06.137090 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5130e82c-81db-4da0-ac8c-cda1ed8fca60 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:06.137494 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6206e6f2-1742-4e4d-a313-7cd435bc7a7f tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1555 microversion: 2.1 time: 0.173905 Apr 06 16:56:06.137622 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5130e82c-81db-4da0-ac8c-cda1ed8fca60 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:06.146684 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1095/2198] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:05 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:06.205019 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5130e82c-81db-4da0-ac8c-cda1ed8fca60 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:06.213788 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5130e82c-81db-4da0-ac8c-cda1ed8fca60 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.089815 Apr 06 16:56:06.214386 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1104/2199] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:06 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:06.815482 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3ac9f344-9ef7-46f2-9be9-beecdee22e42 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:06.816110 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3ac9f344-9ef7-46f2-9be9-beecdee22e42 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:06.824065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ac9f344-9ef7-46f2-9be9-beecdee22e42 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:06.824565 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ac9f344-9ef7-46f2-9be9-beecdee22e42 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:06.825451 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ac9f344-9ef7-46f2-9be9-beecdee22e42 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:06.825960 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ac9f344-9ef7-46f2-9be9-beecdee22e42 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:06.913075 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9cba5de4-5c70-4268-b879-7e6a13112556 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:06.913924 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9cba5de4-5c70-4268-b879-7e6a13112556 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:06.920812 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cba5de4-5c70-4268-b879-7e6a13112556 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:06.921264 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cba5de4-5c70-4268-b879-7e6a13112556 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:06.922047 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cba5de4-5c70-4268-b879-7e6a13112556 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:06.922485 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9cba5de4-5c70-4268-b879-7e6a13112556 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:07.087821 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3ac9f344-9ef7-46f2-9be9-beecdee22e42 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:07.088890 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9cba5de4-5c70-4268-b879-7e6a13112556 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:07.098264 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3ac9f344-9ef7-46f2-9be9-beecdee22e42 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:07.099076 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9cba5de4-5c70-4268-b879-7e6a13112556 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.189595 Apr 06 16:56:07.099966 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1105/2200] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:06 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:56:07.100105 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3ac9f344-9ef7-46f2-9be9-beecdee22e42 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:07.101471 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3ac9f344-9ef7-46f2-9be9-beecdee22e42 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.290645 Apr 06 16:56:07.102147 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1096/2201] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:06 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:07.107159 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-850608c4-81cd-4392-93bf-1071acbaa028 req-b629ff3c-8a79-44b8-af9c-0db552483cfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0cb1d38-bd60-4b01-9c35-d2a181ced275", "name": "network-vif-deleted", "tag": "c3626722-fde1-4b09-b90d-77925245b539"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 16:56:07.115881 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-850608c4-81cd-4392-93bf-1071acbaa028 req-b629ff3c-8a79-44b8-af9c-0db552483cfa service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:07.116444 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-850608c4-81cd-4392-93bf-1071acbaa028 req-b629ff3c-8a79-44b8-af9c-0db552483cfa service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:07.128997 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-850608c4-81cd-4392-93bf-1071acbaa028 req-b629ff3c-8a79-44b8-af9c-0db552483cfa service nova] Creating event network-vif-deleted:c3626722-fde1-4b09-b90d-77925245b539 for instance b0cb1d38-bd60-4b01-9c35-d2a181ced275 on hv-cinder-83684 Apr 06 16:56:07.134359 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-850608c4-81cd-4392-93bf-1071acbaa028 req-b629ff3c-8a79-44b8-af9c-0db552483cfa service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033234 Apr 06 16:56:07.134975 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1106/2202] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 16:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 16:56:07.162468 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d665989b-46c4-4201-85e1-55bd98bc2cc3 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:07.163079 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d665989b-46c4-4201-85e1-55bd98bc2cc3 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:07.170540 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d665989b-46c4-4201-85e1-55bd98bc2cc3 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:07.171302 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d665989b-46c4-4201-85e1-55bd98bc2cc3 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:07.172274 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d665989b-46c4-4201-85e1-55bd98bc2cc3 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:07.172736 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d665989b-46c4-4201-85e1-55bd98bc2cc3 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:07.234744 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-13585a1f-ca91-47c5-a689-8b7d456badfb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:07.235466 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-13585a1f-ca91-47c5-a689-8b7d456badfb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:07.242378 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13585a1f-ca91-47c5-a689-8b7d456badfb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:07.242943 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13585a1f-ca91-47c5-a689-8b7d456badfb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:07.243729 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13585a1f-ca91-47c5-a689-8b7d456badfb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:07.244196 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-13585a1f-ca91-47c5-a689-8b7d456badfb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:07.244954 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d665989b-46c4-4201-85e1-55bd98bc2cc3 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a97efc44004b35a934adac1dded824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e12968decb4d9794bb483bf8fdeb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:07.254874 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d665989b-46c4-4201-85e1-55bd98bc2cc3 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 200 len: 1344 microversion: 2.1 time: 0.096256 Apr 06 16:56:07.255647 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1097/2203] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:07 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 1344 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:07.309309 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-13585a1f-ca91-47c5-a689-8b7d456badfb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:07.322545 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-13585a1f-ca91-47c5-a689-8b7d456badfb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.093768 Apr 06 16:56:07.324445 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1107/2204] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:07 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:08.119980 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-90cfebeb-4c59-4c59-a74b-f8fc79916b57 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:08.120665 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f90d8915-a3df-4cb1-a17f-806caeefb48f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:08.121140 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-90cfebeb-4c59-4c59-a74b-f8fc79916b57 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:08.121272 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f90d8915-a3df-4cb1-a17f-806caeefb48f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:08.129018 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90cfebeb-4c59-4c59-a74b-f8fc79916b57 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:08.129316 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f90d8915-a3df-4cb1-a17f-806caeefb48f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:08.129437 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90cfebeb-4c59-4c59-a74b-f8fc79916b57 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:08.130055 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f90d8915-a3df-4cb1-a17f-806caeefb48f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:08.130471 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90cfebeb-4c59-4c59-a74b-f8fc79916b57 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:08.130856 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f90d8915-a3df-4cb1-a17f-806caeefb48f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:08.131123 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90cfebeb-4c59-4c59-a74b-f8fc79916b57 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:08.131302 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f90d8915-a3df-4cb1-a17f-806caeefb48f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:08.284533 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f90d8915-a3df-4cb1-a17f-806caeefb48f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:08.294359 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f90d8915-a3df-4cb1-a17f-806caeefb48f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:08.295990 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f90d8915-a3df-4cb1-a17f-806caeefb48f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:08.297274 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f90d8915-a3df-4cb1-a17f-806caeefb48f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.181831 Apr 06 16:56:08.297836 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1108/2205] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:08 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:08.301600 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-90cfebeb-4c59-4c59-a74b-f8fc79916b57 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:08.302344 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-042e90b5-0041-496b-b26f-24c36636999b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:08.303140 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-042e90b5-0041-496b-b26f-24c36636999b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] [instance: b0cb1d38-bd60-4b01-9c35-d2a181ced275] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:08.309635 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-042e90b5-0041-496b-b26f-24c36636999b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:08.310082 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-042e90b5-0041-496b-b26f-24c36636999b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:08.310870 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-042e90b5-0041-496b-b26f-24c36636999b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:08.311292 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-042e90b5-0041-496b-b26f-24c36636999b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:08.315099 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-90cfebeb-4c59-4c59-a74b-f8fc79916b57 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.200969 Apr 06 16:56:08.315931 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1098/2206] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:08 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:08.325678 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-042e90b5-0041-496b-b26f-24c36636999b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] HTTP exception thrown: Instance b0cb1d38-bd60-4b01-9c35-d2a181ced275 could not be found. Apr 06 16:56:08.326376 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-042e90b5-0041-496b-b26f-24c36636999b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Returning 404 to user: Instance b0cb1d38-bd60-4b01-9c35-d2a181ced275 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 16:56:08.327296 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-042e90b5-0041-496b-b26f-24c36636999b tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275" status: 404 len: 111 microversion: 2.1 time: 0.028441 Apr 06 16:56:08.327922 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1109/2207] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:08 2022] GET /compute/v2.1/servers/b0cb1d38-bd60-4b01-9c35-d2a181ced275 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 16:56:08.336424 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2ac54e9d-208a-450c-991e-74ff61367446 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] Calling method '.version_select at 0x7fa9c9fb9550>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:08.340835 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4ca0a4af-a46f-41d0-a329-f05ad434ab11 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:08.341450 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4ca0a4af-a46f-41d0-a329-f05ad434ab11 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:08.347687 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ca0a4af-a46f-41d0-a329-f05ad434ab11 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:08.348137 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ca0a4af-a46f-41d0-a329-f05ad434ab11 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:08.349011 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ca0a4af-a46f-41d0-a329-f05ad434ab11 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:08.349453 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ca0a4af-a46f-41d0-a329-f05ad434ab11 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:08.356622 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2ac54e9d-208a-450c-991e-74ff61367446 tempest-TestMinimumBasicScenario-842437188 tempest-TestMinimumBasicScenario-842437188-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1725512260" status: 202 len: 0 microversion: 2.1 time: 0.024112 Apr 06 16:56:08.357239 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1099/2208] 10.222.0.64 () {58 vars in 1271 bytes} [Wed Apr 6 16:56:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1725512260 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 06 16:56:08.416212 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4ca0a4af-a46f-41d0-a329-f05ad434ab11 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:08.424122 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4ca0a4af-a46f-41d0-a329-f05ad434ab11 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.087944 Apr 06 16:56:08.424751 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1110/2209] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:08 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:09.315787 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-861929fa-06df-48cf-a63a-635710854d4f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:09.316585 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-861929fa-06df-48cf-a63a-635710854d4f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:09.324235 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-861929fa-06df-48cf-a63a-635710854d4f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:09.324803 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-861929fa-06df-48cf-a63a-635710854d4f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:09.325623 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-861929fa-06df-48cf-a63a-635710854d4f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:09.326053 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-861929fa-06df-48cf-a63a-635710854d4f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:09.339679 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-42faba9e-5946-49eb-a285-a9dd0da40c9e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:09.341199 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-42faba9e-5946-49eb-a285-a9dd0da40c9e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:09.351639 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42faba9e-5946-49eb-a285-a9dd0da40c9e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:09.352742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42faba9e-5946-49eb-a285-a9dd0da40c9e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:09.354305 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42faba9e-5946-49eb-a285-a9dd0da40c9e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:09.355028 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42faba9e-5946-49eb-a285-a9dd0da40c9e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:09.498620 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-861929fa-06df-48cf-a63a-635710854d4f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:09.508369 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-861929fa-06df-48cf-a63a-635710854d4f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:09.510006 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-861929fa-06df-48cf-a63a-635710854d4f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:09.511202 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-861929fa-06df-48cf-a63a-635710854d4f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.199618 Apr 06 16:56:09.517973 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1100/2210] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:09 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:09.523347 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f348f43f-7088-4fa4-9b32-9448ff657a20 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:09.524506 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f348f43f-7088-4fa4-9b32-9448ff657a20 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:09.530798 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f348f43f-7088-4fa4-9b32-9448ff657a20 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:09.531170 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f348f43f-7088-4fa4-9b32-9448ff657a20 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:09.531958 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f348f43f-7088-4fa4-9b32-9448ff657a20 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:09.532400 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f348f43f-7088-4fa4-9b32-9448ff657a20 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:09.584749 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-42faba9e-5946-49eb-a285-a9dd0da40c9e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:09.594098 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-42faba9e-5946-49eb-a285-a9dd0da40c9e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.260929 Apr 06 16:56:09.603457 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f348f43f-7088-4fa4-9b32-9448ff657a20 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:09.604307 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1111/2211] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:09 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:09.611639 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f348f43f-7088-4fa4-9b32-9448ff657a20 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.092044 Apr 06 16:56:09.612240 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1101/2212] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:09 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:10.530434 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b2293e0c-b76b-462c-a597-02d8c2c68472 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:10.531039 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b2293e0c-b76b-462c-a597-02d8c2c68472 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:10.537858 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2293e0c-b76b-462c-a597-02d8c2c68472 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:10.538304 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2293e0c-b76b-462c-a597-02d8c2c68472 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:10.539073 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2293e0c-b76b-462c-a597-02d8c2c68472 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:10.539554 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2293e0c-b76b-462c-a597-02d8c2c68472 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:10.612397 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5289c9ad-6ef3-408c-8526-4cf326a6ac3a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:10.613149 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5289c9ad-6ef3-408c-8526-4cf326a6ac3a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:10.621223 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5289c9ad-6ef3-408c-8526-4cf326a6ac3a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:10.621769 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5289c9ad-6ef3-408c-8526-4cf326a6ac3a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:10.622662 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5289c9ad-6ef3-408c-8526-4cf326a6ac3a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:10.623183 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5289c9ad-6ef3-408c-8526-4cf326a6ac3a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:10.785016 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5289c9ad-6ef3-408c-8526-4cf326a6ac3a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:10.795186 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5289c9ad-6ef3-408c-8526-4cf326a6ac3a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.186917 Apr 06 16:56:10.795983 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1102/2213] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:10 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:10.808174 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-088458b0-92d4-48c1-a13b-098e55743819 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:10.808818 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-088458b0-92d4-48c1-a13b-098e55743819 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:10.815551 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-088458b0-92d4-48c1-a13b-098e55743819 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:10.816027 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-088458b0-92d4-48c1-a13b-098e55743819 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:10.817395 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-088458b0-92d4-48c1-a13b-098e55743819 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:10.818611 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-088458b0-92d4-48c1-a13b-098e55743819 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:10.895423 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-088458b0-92d4-48c1-a13b-098e55743819 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:10.907613 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-088458b0-92d4-48c1-a13b-098e55743819 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.103408 Apr 06 16:56:10.910701 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1103/2214] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:10 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:10.973310 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b2293e0c-b76b-462c-a597-02d8c2c68472 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:10.984847 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b2293e0c-b76b-462c-a597-02d8c2c68472 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:10.986617 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b2293e0c-b76b-462c-a597-02d8c2c68472 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:10.987863 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b2293e0c-b76b-462c-a597-02d8c2c68472 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.461571 Apr 06 16:56:10.988793 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1112/2215] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:10 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:11.814068 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-809ba1ba-6073-442b-a9f2-6d173a32da17 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:11.815054 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-809ba1ba-6073-442b-a9f2-6d173a32da17 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:11.824473 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-809ba1ba-6073-442b-a9f2-6d173a32da17 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:11.825107 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-809ba1ba-6073-442b-a9f2-6d173a32da17 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:11.826149 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-809ba1ba-6073-442b-a9f2-6d173a32da17 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:11.826939 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-809ba1ba-6073-442b-a9f2-6d173a32da17 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:11.931908 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dd3e7438-604c-4a05-a4e2-7431ac2544b7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:11.933307 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dd3e7438-604c-4a05-a4e2-7431ac2544b7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:11.946857 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd3e7438-604c-4a05-a4e2-7431ac2544b7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:11.947639 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd3e7438-604c-4a05-a4e2-7431ac2544b7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:11.948588 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd3e7438-604c-4a05-a4e2-7431ac2544b7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:11.949202 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd3e7438-604c-4a05-a4e2-7431ac2544b7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:12.008728 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-809ba1ba-6073-442b-a9f2-6d173a32da17 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:12.019283 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-809ba1ba-6073-442b-a9f2-6d173a32da17 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.209529 Apr 06 16:56:12.020977 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1104/2216] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:11 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:12.029983 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d15a08e8-5f30-4abd-b7c8-501afe4289de tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:12.031502 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d15a08e8-5f30-4abd-b7c8-501afe4289de tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:12.039786 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d15a08e8-5f30-4abd-b7c8-501afe4289de tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:12.041161 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d15a08e8-5f30-4abd-b7c8-501afe4289de tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:12.042487 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d15a08e8-5f30-4abd-b7c8-501afe4289de tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:12.043293 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d15a08e8-5f30-4abd-b7c8-501afe4289de tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:12.060466 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-dd3e7438-604c-4a05-a4e2-7431ac2544b7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:12.074284 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dd3e7438-604c-4a05-a4e2-7431ac2544b7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.146273 Apr 06 16:56:12.074872 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1113/2217] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:11 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:12.236562 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d15a08e8-5f30-4abd-b7c8-501afe4289de tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:12.246020 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d15a08e8-5f30-4abd-b7c8-501afe4289de tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:12.247629 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d15a08e8-5f30-4abd-b7c8-501afe4289de tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:12.248977 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d15a08e8-5f30-4abd-b7c8-501afe4289de tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.225889 Apr 06 16:56:12.249576 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1105/2218] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:12 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:13.038691 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b1adc53e-3cf4-4bdf-b0da-b60c8879687a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:13.040115 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b1adc53e-3cf4-4bdf-b0da-b60c8879687a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:13.047232 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1adc53e-3cf4-4bdf-b0da-b60c8879687a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:13.047791 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1adc53e-3cf4-4bdf-b0da-b60c8879687a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:13.048653 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1adc53e-3cf4-4bdf-b0da-b60c8879687a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:13.049178 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b1adc53e-3cf4-4bdf-b0da-b60c8879687a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:13.100092 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2b4127d8-8237-4bde-a3ea-08ff7929f5be tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:13.100736 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2b4127d8-8237-4bde-a3ea-08ff7929f5be tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:13.108828 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b4127d8-8237-4bde-a3ea-08ff7929f5be tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:13.109297 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b4127d8-8237-4bde-a3ea-08ff7929f5be tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:13.110169 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b4127d8-8237-4bde-a3ea-08ff7929f5be tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:13.110673 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b4127d8-8237-4bde-a3ea-08ff7929f5be tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:13.217156 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2b4127d8-8237-4bde-a3ea-08ff7929f5be tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:13.230722 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2b4127d8-8237-4bde-a3ea-08ff7929f5be tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.134099 Apr 06 16:56:13.241881 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1106/2219] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:13 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:56:13.249592 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b1adc53e-3cf4-4bdf-b0da-b60c8879687a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:13.262556 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b1adc53e-3cf4-4bdf-b0da-b60c8879687a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.227765 Apr 06 16:56:13.263950 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1114/2220] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:13 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:13.267724 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cefc52fc-dcb8-4410-af69-0ef21dc88ae3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:13.268596 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cefc52fc-dcb8-4410-af69-0ef21dc88ae3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:13.275996 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cefc52fc-dcb8-4410-af69-0ef21dc88ae3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:13.276446 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cefc52fc-dcb8-4410-af69-0ef21dc88ae3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:13.277282 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cefc52fc-dcb8-4410-af69-0ef21dc88ae3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:13.277720 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cefc52fc-dcb8-4410-af69-0ef21dc88ae3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:13.563023 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cefc52fc-dcb8-4410-af69-0ef21dc88ae3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:13.578502 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cefc52fc-dcb8-4410-af69-0ef21dc88ae3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:13.580018 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cefc52fc-dcb8-4410-af69-0ef21dc88ae3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:13.581414 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cefc52fc-dcb8-4410-af69-0ef21dc88ae3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.317773 Apr 06 16:56:13.582159 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1107/2221] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:13 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:14.247832 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b96b2c04-0c69-4eff-bd4e-1aa30e1d7982 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:14.248431 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b96b2c04-0c69-4eff-bd4e-1aa30e1d7982 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:14.255578 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b96b2c04-0c69-4eff-bd4e-1aa30e1d7982 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:14.256045 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b96b2c04-0c69-4eff-bd4e-1aa30e1d7982 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:14.256873 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b96b2c04-0c69-4eff-bd4e-1aa30e1d7982 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:14.257306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b96b2c04-0c69-4eff-bd4e-1aa30e1d7982 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:14.280123 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1895f2ef-e5bf-4dea-a56a-bda0511820df tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:14.281188 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1895f2ef-e5bf-4dea-a56a-bda0511820df tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:14.288357 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1895f2ef-e5bf-4dea-a56a-bda0511820df tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:14.288916 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1895f2ef-e5bf-4dea-a56a-bda0511820df tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:14.289868 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1895f2ef-e5bf-4dea-a56a-bda0511820df tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:14.290406 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1895f2ef-e5bf-4dea-a56a-bda0511820df tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:14.442542 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1895f2ef-e5bf-4dea-a56a-bda0511820df tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:14.452425 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1895f2ef-e5bf-4dea-a56a-bda0511820df tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.176346 Apr 06 16:56:14.453105 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1108/2222] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:14 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:56:14.501514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b96b2c04-0c69-4eff-bd4e-1aa30e1d7982 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:14.510192 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b96b2c04-0c69-4eff-bd4e-1aa30e1d7982 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.266399 Apr 06 16:56:14.510793 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1115/2223] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:14 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:14.606221 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-22e759bf-c6c6-4c2f-ae3c-86eb39a44964 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:14.606975 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-22e759bf-c6c6-4c2f-ae3c-86eb39a44964 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:14.615328 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22e759bf-c6c6-4c2f-ae3c-86eb39a44964 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:14.616068 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22e759bf-c6c6-4c2f-ae3c-86eb39a44964 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:14.617418 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22e759bf-c6c6-4c2f-ae3c-86eb39a44964 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:14.618155 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22e759bf-c6c6-4c2f-ae3c-86eb39a44964 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:14.775621 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-22e759bf-c6c6-4c2f-ae3c-86eb39a44964 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:14.785476 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-22e759bf-c6c6-4c2f-ae3c-86eb39a44964 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:14.786933 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-22e759bf-c6c6-4c2f-ae3c-86eb39a44964 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:14.788123 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-22e759bf-c6c6-4c2f-ae3c-86eb39a44964 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.186148 Apr 06 16:56:14.788706 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1109/2224] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:14 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:15.470176 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-39bb9436-fa8e-45b6-b9c1-64006d956966 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:15.470832 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-39bb9436-fa8e-45b6-b9c1-64006d956966 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:15.478904 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39bb9436-fa8e-45b6-b9c1-64006d956966 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:15.479346 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39bb9436-fa8e-45b6-b9c1-64006d956966 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:15.480282 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39bb9436-fa8e-45b6-b9c1-64006d956966 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:15.480573 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39bb9436-fa8e-45b6-b9c1-64006d956966 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:15.533222 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b1fe1ba7-218a-4846-88cd-352729d5160c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:15.533946 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b1fe1ba7-218a-4846-88cd-352729d5160c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:15.541298 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1fe1ba7-218a-4846-88cd-352729d5160c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:15.542059 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1fe1ba7-218a-4846-88cd-352729d5160c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:15.543146 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1fe1ba7-218a-4846-88cd-352729d5160c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:15.543730 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1fe1ba7-218a-4846-88cd-352729d5160c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:15.622072 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b1fe1ba7-218a-4846-88cd-352729d5160c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:15.634604 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b1fe1ba7-218a-4846-88cd-352729d5160c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.109160 Apr 06 16:56:15.644716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1110/2225] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:15 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:56:15.666194 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-39bb9436-fa8e-45b6-b9c1-64006d956966 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:15.684282 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-39bb9436-fa8e-45b6-b9c1-64006d956966 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.217547 Apr 06 16:56:15.685665 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1116/2226] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:15 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:15.806485 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dc750ead-0a4c-46d3-a159-0f7385710fee tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:15.807382 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dc750ead-0a4c-46d3-a159-0f7385710fee tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:15.814269 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc750ead-0a4c-46d3-a159-0f7385710fee tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:15.814726 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc750ead-0a4c-46d3-a159-0f7385710fee tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:15.815506 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc750ead-0a4c-46d3-a159-0f7385710fee tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:15.815947 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc750ead-0a4c-46d3-a159-0f7385710fee tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:16.059811 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-dc750ead-0a4c-46d3-a159-0f7385710fee tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:16.072525 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-dc750ead-0a4c-46d3-a159-0f7385710fee tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:16.074284 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-dc750ead-0a4c-46d3-a159-0f7385710fee tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:16.075558 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dc750ead-0a4c-46d3-a159-0f7385710fee tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.273086 Apr 06 16:56:16.076468 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1111/2227] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:15 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:16.652838 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cf4a5451-b622-4207-a78f-c64e7614829b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:16.653652 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cf4a5451-b622-4207-a78f-c64e7614829b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:16.660105 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf4a5451-b622-4207-a78f-c64e7614829b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:16.660554 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf4a5451-b622-4207-a78f-c64e7614829b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:16.661366 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf4a5451-b622-4207-a78f-c64e7614829b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:16.661802 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf4a5451-b622-4207-a78f-c64e7614829b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:16.703293 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bd6b5134-0675-44b0-9047-abc88028a737 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:16.704595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bd6b5134-0675-44b0-9047-abc88028a737 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:16.711851 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd6b5134-0675-44b0-9047-abc88028a737 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:16.713165 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd6b5134-0675-44b0-9047-abc88028a737 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:16.714305 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd6b5134-0675-44b0-9047-abc88028a737 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:16.714923 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd6b5134-0675-44b0-9047-abc88028a737 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:16.733658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-cf4a5451-b622-4207-a78f-c64e7614829b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:16.743758 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cf4a5451-b622-4207-a78f-c64e7614829b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.094972 Apr 06 16:56:16.744893 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1117/2228] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:16 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:17.097662 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ae53fca8-a982-4ffd-ae3e-83592b1e2f89 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:17.098620 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ae53fca8-a982-4ffd-ae3e-83592b1e2f89 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:17.106919 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae53fca8-a982-4ffd-ae3e-83592b1e2f89 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:17.107601 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae53fca8-a982-4ffd-ae3e-83592b1e2f89 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:17.108599 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae53fca8-a982-4ffd-ae3e-83592b1e2f89 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:17.109281 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ae53fca8-a982-4ffd-ae3e-83592b1e2f89 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:17.199392 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-bd6b5134-0675-44b0-9047-abc88028a737 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:17.207962 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bd6b5134-0675-44b0-9047-abc88028a737 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.509136 Apr 06 16:56:17.212739 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1112/2229] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:16 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:17.377569 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ae53fca8-a982-4ffd-ae3e-83592b1e2f89 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:17.387642 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ae53fca8-a982-4ffd-ae3e-83592b1e2f89 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:17.389995 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ae53fca8-a982-4ffd-ae3e-83592b1e2f89 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:17.391512 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ae53fca8-a982-4ffd-ae3e-83592b1e2f89 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.300806 Apr 06 16:56:17.392263 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1118/2230] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:17 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:56:17.764565 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4e8e5cd9-70a3-457c-be55-2edb60d034d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:17.764565 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4e8e5cd9-70a3-457c-be55-2edb60d034d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:17.771160 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e8e5cd9-70a3-457c-be55-2edb60d034d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:17.771699 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e8e5cd9-70a3-457c-be55-2edb60d034d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:17.772546 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e8e5cd9-70a3-457c-be55-2edb60d034d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:17.773058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e8e5cd9-70a3-457c-be55-2edb60d034d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:17.850058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4e8e5cd9-70a3-457c-be55-2edb60d034d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:17.861956 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4e8e5cd9-70a3-457c-be55-2edb60d034d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.103712 Apr 06 16:56:17.862863 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1113/2231] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:17 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:18.226892 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-455a05bb-45f6-4064-b0e0-43e08d0a8efd tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:18.227526 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-455a05bb-45f6-4064-b0e0-43e08d0a8efd tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:18.235602 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-455a05bb-45f6-4064-b0e0-43e08d0a8efd tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:18.236087 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-455a05bb-45f6-4064-b0e0-43e08d0a8efd tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:18.236914 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-455a05bb-45f6-4064-b0e0-43e08d0a8efd tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:18.237332 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-455a05bb-45f6-4064-b0e0-43e08d0a8efd tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:18.402748 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-455a05bb-45f6-4064-b0e0-43e08d0a8efd tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:18.411828 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f6691468-c460-4ee5-b19b-7cab995bf5bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:18.412058 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-455a05bb-45f6-4064-b0e0-43e08d0a8efd tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.189146 Apr 06 16:56:18.412659 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1119/2232] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:18 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:18.413178 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f6691468-c460-4ee5-b19b-7cab995bf5bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:18.421222 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f6691468-c460-4ee5-b19b-7cab995bf5bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:18.422150 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f6691468-c460-4ee5-b19b-7cab995bf5bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:18.423271 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f6691468-c460-4ee5-b19b-7cab995bf5bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:18.423806 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f6691468-c460-4ee5-b19b-7cab995bf5bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:18.577709 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f6691468-c460-4ee5-b19b-7cab995bf5bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:18.587192 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f6691468-c460-4ee5-b19b-7cab995bf5bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:18.588810 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f6691468-c460-4ee5-b19b-7cab995bf5bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:18.590354 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f6691468-c460-4ee5-b19b-7cab995bf5bf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.182535 Apr 06 16:56:18.590873 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1114/2233] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:18 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:56:18.880670 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bc6947ae-b8ec-4eed-9753-43a1b07c8a6e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:18.881545 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bc6947ae-b8ec-4eed-9753-43a1b07c8a6e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:18.890352 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc6947ae-b8ec-4eed-9753-43a1b07c8a6e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:18.890798 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc6947ae-b8ec-4eed-9753-43a1b07c8a6e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:18.891805 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc6947ae-b8ec-4eed-9753-43a1b07c8a6e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:18.892444 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc6947ae-b8ec-4eed-9753-43a1b07c8a6e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:18.979772 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-bc6947ae-b8ec-4eed-9753-43a1b07c8a6e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:18.991159 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bc6947ae-b8ec-4eed-9753-43a1b07c8a6e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.114447 Apr 06 16:56:18.991786 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1120/2234] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:18 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:56:19.433092 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0dfce512-b97b-4ba1-a6b9-c268541384b9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:19.433761 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0dfce512-b97b-4ba1-a6b9-c268541384b9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:19.441723 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dfce512-b97b-4ba1-a6b9-c268541384b9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:19.442333 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dfce512-b97b-4ba1-a6b9-c268541384b9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:19.443551 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dfce512-b97b-4ba1-a6b9-c268541384b9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:19.444161 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dfce512-b97b-4ba1-a6b9-c268541384b9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:19.588597 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0dfce512-b97b-4ba1-a6b9-c268541384b9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:19.597197 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0dfce512-b97b-4ba1-a6b9-c268541384b9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.169116 Apr 06 16:56:19.597788 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1115/2235] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:19 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:19.609208 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cd607f25-519b-4658-9b71-18d337e76e32 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:19.609841 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cd607f25-519b-4658-9b71-18d337e76e32 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:19.616314 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd607f25-519b-4658-9b71-18d337e76e32 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:19.616790 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd607f25-519b-4658-9b71-18d337e76e32 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:19.617555 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd607f25-519b-4658-9b71-18d337e76e32 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:19.618004 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd607f25-519b-4658-9b71-18d337e76e32 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:19.770399 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-cd607f25-519b-4658-9b71-18d337e76e32 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:19.779075 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-cd607f25-519b-4658-9b71-18d337e76e32 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:19.780636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-cd607f25-519b-4658-9b71-18d337e76e32 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:19.781834 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cd607f25-519b-4658-9b71-18d337e76e32 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.176657 Apr 06 16:56:19.782392 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1121/2236] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:19 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:20.010060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bfb10f3b-0611-461e-8baf-dc11d7fef4db tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:20.010659 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bfb10f3b-0611-461e-8baf-dc11d7fef4db tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:20.017799 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bfb10f3b-0611-461e-8baf-dc11d7fef4db tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:20.018256 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bfb10f3b-0611-461e-8baf-dc11d7fef4db tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:20.019044 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bfb10f3b-0611-461e-8baf-dc11d7fef4db tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:20.019481 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bfb10f3b-0611-461e-8baf-dc11d7fef4db tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:20.089245 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-bfb10f3b-0611-461e-8baf-dc11d7fef4db tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:20.097793 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bfb10f3b-0611-461e-8baf-dc11d7fef4db tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.091643 Apr 06 16:56:20.098380 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1116/2237] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:20 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:20.615897 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8653ba74-9985-4de2-878d-863bbcbdb65f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:20.616505 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8653ba74-9985-4de2-878d-863bbcbdb65f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:20.626703 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8653ba74-9985-4de2-878d-863bbcbdb65f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:20.627258 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8653ba74-9985-4de2-878d-863bbcbdb65f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:20.628442 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8653ba74-9985-4de2-878d-863bbcbdb65f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:20.628972 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8653ba74-9985-4de2-878d-863bbcbdb65f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:20.784087 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8653ba74-9985-4de2-878d-863bbcbdb65f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:20.792599 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8653ba74-9985-4de2-878d-863bbcbdb65f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.180884 Apr 06 16:56:20.793239 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1122/2238] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:20 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:20.801177 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-05933973-1e50-4648-8cca-776c906a2a21 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:20.801871 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-05933973-1e50-4648-8cca-776c906a2a21 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:20.809036 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05933973-1e50-4648-8cca-776c906a2a21 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:20.809482 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05933973-1e50-4648-8cca-776c906a2a21 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:20.810249 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05933973-1e50-4648-8cca-776c906a2a21 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:20.810676 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05933973-1e50-4648-8cca-776c906a2a21 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:20.961995 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-05933973-1e50-4648-8cca-776c906a2a21 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:20.971595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-05933973-1e50-4648-8cca-776c906a2a21 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:20.973122 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-05933973-1e50-4648-8cca-776c906a2a21 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:20.974330 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-05933973-1e50-4648-8cca-776c906a2a21 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.177225 Apr 06 16:56:20.974897 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1117/2239] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:20 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:21.115643 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-24852c68-8398-4c75-b033-2eda40204539 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:21.116253 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-24852c68-8398-4c75-b033-2eda40204539 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:21.122973 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24852c68-8398-4c75-b033-2eda40204539 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:21.123419 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24852c68-8398-4c75-b033-2eda40204539 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:21.124193 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24852c68-8398-4c75-b033-2eda40204539 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:21.124622 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24852c68-8398-4c75-b033-2eda40204539 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:21.186729 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-24852c68-8398-4c75-b033-2eda40204539 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:21.195130 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-24852c68-8398-4c75-b033-2eda40204539 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.083413 Apr 06 16:56:21.196341 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1123/2240] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:21 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:21.811077 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b36ca790-1c85-4c33-b3bf-3df7a607f435 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:21.812096 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b36ca790-1c85-4c33-b3bf-3df7a607f435 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:21.822294 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b36ca790-1c85-4c33-b3bf-3df7a607f435 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:21.822749 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b36ca790-1c85-4c33-b3bf-3df7a607f435 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:21.823546 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b36ca790-1c85-4c33-b3bf-3df7a607f435 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:21.823979 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b36ca790-1c85-4c33-b3bf-3df7a607f435 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:21.969284 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b36ca790-1c85-4c33-b3bf-3df7a607f435 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:21.977901 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b36ca790-1c85-4c33-b3bf-3df7a607f435 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.170728 Apr 06 16:56:21.978651 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1118/2241] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:21 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:21.993682 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4f352997-58e9-49d7-8947-ae793ee97504 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:21.994475 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4f352997-58e9-49d7-8947-ae793ee97504 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:22.001191 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f352997-58e9-49d7-8947-ae793ee97504 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:22.001636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f352997-58e9-49d7-8947-ae793ee97504 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:22.002401 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f352997-58e9-49d7-8947-ae793ee97504 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:22.002828 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f352997-58e9-49d7-8947-ae793ee97504 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:22.151711 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4f352997-58e9-49d7-8947-ae793ee97504 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:22.160757 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4f352997-58e9-49d7-8947-ae793ee97504 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:22.162248 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4f352997-58e9-49d7-8947-ae793ee97504 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:22.163412 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4f352997-58e9-49d7-8947-ae793ee97504 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.174080 Apr 06 16:56:22.163976 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1124/2242] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:21 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:22.213745 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2437e965-65f6-4ac4-8d6c-6b1542c11a48 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:22.214344 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2437e965-65f6-4ac4-8d6c-6b1542c11a48 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:22.220671 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2437e965-65f6-4ac4-8d6c-6b1542c11a48 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:22.221142 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2437e965-65f6-4ac4-8d6c-6b1542c11a48 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:22.221899 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2437e965-65f6-4ac4-8d6c-6b1542c11a48 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:22.222325 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2437e965-65f6-4ac4-8d6c-6b1542c11a48 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:22.288935 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2437e965-65f6-4ac4-8d6c-6b1542c11a48 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:22.297567 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2437e965-65f6-4ac4-8d6c-6b1542c11a48 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.089000 Apr 06 16:56:22.298160 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1119/2243] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:22 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:56:22.995667 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-de93c0f3-4076-4665-8430-ec914ed72b9a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:22.996430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-de93c0f3-4076-4665-8430-ec914ed72b9a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:23.004268 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de93c0f3-4076-4665-8430-ec914ed72b9a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:23.004745 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de93c0f3-4076-4665-8430-ec914ed72b9a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:23.005562 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de93c0f3-4076-4665-8430-ec914ed72b9a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:23.005995 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de93c0f3-4076-4665-8430-ec914ed72b9a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:23.158317 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-de93c0f3-4076-4665-8430-ec914ed72b9a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:23.171534 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-de93c0f3-4076-4665-8430-ec914ed72b9a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.179487 Apr 06 16:56:23.172445 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1125/2244] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:22 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:23.182063 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a840adb4-7245-4b90-ac14-ebf5d83c7958 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:23.182648 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a840adb4-7245-4b90-ac14-ebf5d83c7958 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:23.189422 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a840adb4-7245-4b90-ac14-ebf5d83c7958 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:23.189877 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a840adb4-7245-4b90-ac14-ebf5d83c7958 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:23.190660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a840adb4-7245-4b90-ac14-ebf5d83c7958 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:23.191103 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a840adb4-7245-4b90-ac14-ebf5d83c7958 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:23.314702 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ed8f5a91-eb5c-4c80-8cf4-9e7eaf51d128 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:23.315315 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ed8f5a91-eb5c-4c80-8cf4-9e7eaf51d128 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:23.321603 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed8f5a91-eb5c-4c80-8cf4-9e7eaf51d128 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:23.322042 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed8f5a91-eb5c-4c80-8cf4-9e7eaf51d128 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:23.322821 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed8f5a91-eb5c-4c80-8cf4-9e7eaf51d128 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:23.323247 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed8f5a91-eb5c-4c80-8cf4-9e7eaf51d128 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:23.353741 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a840adb4-7245-4b90-ac14-ebf5d83c7958 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:23.369498 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a840adb4-7245-4b90-ac14-ebf5d83c7958 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:23.371156 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a840adb4-7245-4b90-ac14-ebf5d83c7958 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:23.372431 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a840adb4-7245-4b90-ac14-ebf5d83c7958 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.194506 Apr 06 16:56:23.373333 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1120/2245] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:23 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:23.385065 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ed8f5a91-eb5c-4c80-8cf4-9e7eaf51d128 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:23.393455 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ed8f5a91-eb5c-4c80-8cf4-9e7eaf51d128 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.082680 Apr 06 16:56:23.394052 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1126/2246] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:23 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:24.192300 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c53c49f2-89ee-4111-9054-689139dcaef8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:24.193020 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c53c49f2-89ee-4111-9054-689139dcaef8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:24.201016 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c53c49f2-89ee-4111-9054-689139dcaef8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:24.201449 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c53c49f2-89ee-4111-9054-689139dcaef8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:24.202389 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c53c49f2-89ee-4111-9054-689139dcaef8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:24.202814 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c53c49f2-89ee-4111-9054-689139dcaef8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:24.370002 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c53c49f2-89ee-4111-9054-689139dcaef8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:24.378789 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c53c49f2-89ee-4111-9054-689139dcaef8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.191180 Apr 06 16:56:24.379386 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1121/2247] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:24 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:24.395318 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-afeab98e-3515-4d80-a092-3e99832b322e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:24.396277 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-afeab98e-3515-4d80-a092-3e99832b322e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:24.405654 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-afeab98e-3515-4d80-a092-3e99832b322e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:24.406090 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-afeab98e-3515-4d80-a092-3e99832b322e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:24.407386 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-afeab98e-3515-4d80-a092-3e99832b322e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:24.407963 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-afeab98e-3515-4d80-a092-3e99832b322e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:24.414428 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a99bb26b-fd3c-4ba4-9bef-41e0a701be47 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:24.415416 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a99bb26b-fd3c-4ba4-9bef-41e0a701be47 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:24.426636 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a99bb26b-fd3c-4ba4-9bef-41e0a701be47 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:24.427035 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a99bb26b-fd3c-4ba4-9bef-41e0a701be47 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:24.427815 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a99bb26b-fd3c-4ba4-9bef-41e0a701be47 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:24.428251 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a99bb26b-fd3c-4ba4-9bef-41e0a701be47 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:24.494115 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a99bb26b-fd3c-4ba4-9bef-41e0a701be47 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:24.503889 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a99bb26b-fd3c-4ba4-9bef-41e0a701be47 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.095366 Apr 06 16:56:24.504482 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1122/2248] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:24 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:24.563065 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-afeab98e-3515-4d80-a092-3e99832b322e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:24.573277 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-afeab98e-3515-4d80-a092-3e99832b322e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:24.574753 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-afeab98e-3515-4d80-a092-3e99832b322e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:24.575942 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-afeab98e-3515-4d80-a092-3e99832b322e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.188625 Apr 06 16:56:24.576551 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1127/2249] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:24 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:25.397764 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2cfc5876-55aa-47e5-bb7f-fa52387c7702 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:25.398491 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2cfc5876-55aa-47e5-bb7f-fa52387c7702 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:25.408084 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cfc5876-55aa-47e5-bb7f-fa52387c7702 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:25.408859 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cfc5876-55aa-47e5-bb7f-fa52387c7702 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:25.410123 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cfc5876-55aa-47e5-bb7f-fa52387c7702 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:25.410810 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cfc5876-55aa-47e5-bb7f-fa52387c7702 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:25.523285 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-beae3eae-327e-4499-91ae-89f5f2210a12 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:25.523886 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-beae3eae-327e-4499-91ae-89f5f2210a12 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:25.532508 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-beae3eae-327e-4499-91ae-89f5f2210a12 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:25.532962 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-beae3eae-327e-4499-91ae-89f5f2210a12 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:25.533773 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-beae3eae-327e-4499-91ae-89f5f2210a12 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:25.534262 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-beae3eae-327e-4499-91ae-89f5f2210a12 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:25.590814 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2cfc5876-55aa-47e5-bb7f-fa52387c7702 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:25.599780 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2cfc5876-55aa-47e5-bb7f-fa52387c7702 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.206706 Apr 06 16:56:25.600367 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1123/2250] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:25 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:25.606264 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-43e1cd68-298b-4cc1-b000-78b0be220859 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:25.606876 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-43e1cd68-298b-4cc1-b000-78b0be220859 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:25.607263 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-beae3eae-327e-4499-91ae-89f5f2210a12 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:25.615214 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43e1cd68-298b-4cc1-b000-78b0be220859 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:25.615968 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43e1cd68-298b-4cc1-b000-78b0be220859 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:25.616309 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-beae3eae-327e-4499-91ae-89f5f2210a12 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.097219 Apr 06 16:56:25.616961 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1128/2251] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:25 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:25.617464 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43e1cd68-298b-4cc1-b000-78b0be220859 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:25.618433 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43e1cd68-298b-4cc1-b000-78b0be220859 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:25.789504 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-43e1cd68-298b-4cc1-b000-78b0be220859 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:25.803570 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-43e1cd68-298b-4cc1-b000-78b0be220859 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:25.805100 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-43e1cd68-298b-4cc1-b000-78b0be220859 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:25.806505 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-43e1cd68-298b-4cc1-b000-78b0be220859 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.205140 Apr 06 16:56:25.807079 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1124/2252] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:25 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:26.624669 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-97606d88-b048-46b2-b6da-653ce23b85e7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:26.625704 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-97606d88-b048-46b2-b6da-653ce23b85e7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:26.640376 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97606d88-b048-46b2-b6da-653ce23b85e7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:26.641775 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97606d88-b048-46b2-b6da-653ce23b85e7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:26.641968 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97606d88-b048-46b2-b6da-653ce23b85e7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:26.642371 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97606d88-b048-46b2-b6da-653ce23b85e7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:26.642550 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-32f3bc20-98dd-4ed5-bdcf-2aab747ab489 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:26.643088 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-32f3bc20-98dd-4ed5-bdcf-2aab747ab489 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:26.650389 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32f3bc20-98dd-4ed5-bdcf-2aab747ab489 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:26.650844 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32f3bc20-98dd-4ed5-bdcf-2aab747ab489 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:26.651630 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32f3bc20-98dd-4ed5-bdcf-2aab747ab489 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:26.652086 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32f3bc20-98dd-4ed5-bdcf-2aab747ab489 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:26.718355 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-32f3bc20-98dd-4ed5-bdcf-2aab747ab489 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:26.727666 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-32f3bc20-98dd-4ed5-bdcf-2aab747ab489 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.090586 Apr 06 16:56:26.728518 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1125/2253] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:26 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:56:26.793096 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-97606d88-b048-46b2-b6da-653ce23b85e7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:26.801474 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-97606d88-b048-46b2-b6da-653ce23b85e7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.181589 Apr 06 16:56:26.802103 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1129/2254] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:26 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:26.825885 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-90d8ba5d-e1dd-4157-9e33-a611ca495fe7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:26.826488 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-90d8ba5d-e1dd-4157-9e33-a611ca495fe7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:26.833812 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90d8ba5d-e1dd-4157-9e33-a611ca495fe7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:26.833812 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90d8ba5d-e1dd-4157-9e33-a611ca495fe7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:26.834412 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90d8ba5d-e1dd-4157-9e33-a611ca495fe7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:26.834839 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90d8ba5d-e1dd-4157-9e33-a611ca495fe7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:26.978856 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-90d8ba5d-e1dd-4157-9e33-a611ca495fe7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:26.987910 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-90d8ba5d-e1dd-4157-9e33-a611ca495fe7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:26.989446 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-90d8ba5d-e1dd-4157-9e33-a611ca495fe7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:26.990656 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-90d8ba5d-e1dd-4157-9e33-a611ca495fe7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.168916 Apr 06 16:56:26.991182 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1126/2255] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:26 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:27.751923 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-725e0d4b-104d-4181-8164-79a53cfbff20 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:27.752567 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-725e0d4b-104d-4181-8164-79a53cfbff20 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:27.759864 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-725e0d4b-104d-4181-8164-79a53cfbff20 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:27.760315 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-725e0d4b-104d-4181-8164-79a53cfbff20 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:27.761128 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-725e0d4b-104d-4181-8164-79a53cfbff20 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:27.761559 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-725e0d4b-104d-4181-8164-79a53cfbff20 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:27.819624 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cad59f55-35c0-4ded-923a-b37d7eb358fd tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:27.820276 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cad59f55-35c0-4ded-923a-b37d7eb358fd tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:27.825616 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-725e0d4b-104d-4181-8164-79a53cfbff20 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:27.828601 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cad59f55-35c0-4ded-923a-b37d7eb358fd tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:27.829688 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cad59f55-35c0-4ded-923a-b37d7eb358fd tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:27.830811 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cad59f55-35c0-4ded-923a-b37d7eb358fd tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:27.831740 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cad59f55-35c0-4ded-923a-b37d7eb358fd tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:27.833935 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-725e0d4b-104d-4181-8164-79a53cfbff20 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.085908 Apr 06 16:56:27.834487 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1130/2256] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:27 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:27.991205 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cad59f55-35c0-4ded-923a-b37d7eb358fd tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:28.002311 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cad59f55-35c0-4ded-923a-b37d7eb358fd tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.186445 Apr 06 16:56:28.002810 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1127/2257] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:27 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:28.011025 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-44047fb7-d51a-40a7-9cee-d7a85bc1e7b9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:28.011769 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-44047fb7-d51a-40a7-9cee-d7a85bc1e7b9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:28.018197 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44047fb7-d51a-40a7-9cee-d7a85bc1e7b9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:28.018642 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44047fb7-d51a-40a7-9cee-d7a85bc1e7b9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:28.019416 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44047fb7-d51a-40a7-9cee-d7a85bc1e7b9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:28.019846 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44047fb7-d51a-40a7-9cee-d7a85bc1e7b9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:28.165057 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-44047fb7-d51a-40a7-9cee-d7a85bc1e7b9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:28.174720 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-44047fb7-d51a-40a7-9cee-d7a85bc1e7b9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:28.176219 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-44047fb7-d51a-40a7-9cee-d7a85bc1e7b9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:28.177419 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-44047fb7-d51a-40a7-9cee-d7a85bc1e7b9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.170760 Apr 06 16:56:28.177956 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1131/2258] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:28 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:28.852674 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d0259a0c-2881-4840-a88d-7eb22ed3729e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:28.853355 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d0259a0c-2881-4840-a88d-7eb22ed3729e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:28.860070 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0259a0c-2881-4840-a88d-7eb22ed3729e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:28.860525 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0259a0c-2881-4840-a88d-7eb22ed3729e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:28.861411 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0259a0c-2881-4840-a88d-7eb22ed3729e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:28.861855 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0259a0c-2881-4840-a88d-7eb22ed3729e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:28.933945 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d0259a0c-2881-4840-a88d-7eb22ed3729e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:28.942784 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d0259a0c-2881-4840-a88d-7eb22ed3729e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.094672 Apr 06 16:56:28.943609 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1128/2259] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:28 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:29.019616 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-47c2d21c-d12b-4a0d-96fc-6915a70b4631 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:29.020250 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-47c2d21c-d12b-4a0d-96fc-6915a70b4631 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:29.027425 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47c2d21c-d12b-4a0d-96fc-6915a70b4631 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:29.027875 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47c2d21c-d12b-4a0d-96fc-6915a70b4631 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:29.029046 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47c2d21c-d12b-4a0d-96fc-6915a70b4631 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:29.029678 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47c2d21c-d12b-4a0d-96fc-6915a70b4631 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:29.186887 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-47c2d21c-d12b-4a0d-96fc-6915a70b4631 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:29.195130 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-47c2d21c-d12b-4a0d-96fc-6915a70b4631 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.179355 Apr 06 16:56:29.196027 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1132/2260] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:29 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:29.196955 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-597a910a-7d30-45db-8ecb-7e3dc78dcd1b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:29.197702 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-597a910a-7d30-45db-8ecb-7e3dc78dcd1b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:29.204754 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-597a910a-7d30-45db-8ecb-7e3dc78dcd1b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:29.205235 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-597a910a-7d30-45db-8ecb-7e3dc78dcd1b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:29.206010 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-597a910a-7d30-45db-8ecb-7e3dc78dcd1b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:29.206436 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-597a910a-7d30-45db-8ecb-7e3dc78dcd1b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:29.354021 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-597a910a-7d30-45db-8ecb-7e3dc78dcd1b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:29.368820 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-597a910a-7d30-45db-8ecb-7e3dc78dcd1b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:29.370358 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-597a910a-7d30-45db-8ecb-7e3dc78dcd1b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:29.371552 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-597a910a-7d30-45db-8ecb-7e3dc78dcd1b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.178892 Apr 06 16:56:29.372123 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1129/2261] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:29 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:56:29.959775 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6dadf390-3db8-4a77-838a-046e7f957d1f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:29.960375 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6dadf390-3db8-4a77-838a-046e7f957d1f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:29.967174 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6dadf390-3db8-4a77-838a-046e7f957d1f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:29.967597 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6dadf390-3db8-4a77-838a-046e7f957d1f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:29.968395 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6dadf390-3db8-4a77-838a-046e7f957d1f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:29.968861 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6dadf390-3db8-4a77-838a-046e7f957d1f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:30.030175 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6dadf390-3db8-4a77-838a-046e7f957d1f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:30.048068 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6dadf390-3db8-4a77-838a-046e7f957d1f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.092128 Apr 06 16:56:30.048673 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1133/2262] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:29 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:30.214008 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6f1944b9-a258-43ed-b1ef-4ddafa099dd4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:30.214746 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6f1944b9-a258-43ed-b1ef-4ddafa099dd4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:30.221563 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f1944b9-a258-43ed-b1ef-4ddafa099dd4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:30.222018 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f1944b9-a258-43ed-b1ef-4ddafa099dd4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:30.222804 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f1944b9-a258-43ed-b1ef-4ddafa099dd4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:30.223240 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f1944b9-a258-43ed-b1ef-4ddafa099dd4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:30.369211 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6f1944b9-a258-43ed-b1ef-4ddafa099dd4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:30.377847 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6f1944b9-a258-43ed-b1ef-4ddafa099dd4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.167758 Apr 06 16:56:30.378614 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1130/2263] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:30 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:30.390624 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ff189c2c-1285-4c11-ba4c-0f44659d22f7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:30.391234 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ff189c2c-1285-4c11-ba4c-0f44659d22f7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:30.398759 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff189c2c-1285-4c11-ba4c-0f44659d22f7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:30.399190 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff189c2c-1285-4c11-ba4c-0f44659d22f7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:30.400153 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff189c2c-1285-4c11-ba4c-0f44659d22f7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:30.400964 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff189c2c-1285-4c11-ba4c-0f44659d22f7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:30.560569 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ff189c2c-1285-4c11-ba4c-0f44659d22f7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:30.569563 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ff189c2c-1285-4c11-ba4c-0f44659d22f7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:30.571050 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ff189c2c-1285-4c11-ba4c-0f44659d22f7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:30.572482 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ff189c2c-1285-4c11-ba4c-0f44659d22f7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.185621 Apr 06 16:56:30.573256 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1134/2264] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:30 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:56:31.064876 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bf5252ad-81f6-4eb5-868f-b81d123cd9e6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:31.065958 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bf5252ad-81f6-4eb5-868f-b81d123cd9e6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:31.073029 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf5252ad-81f6-4eb5-868f-b81d123cd9e6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:31.073893 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf5252ad-81f6-4eb5-868f-b81d123cd9e6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:31.074732 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf5252ad-81f6-4eb5-868f-b81d123cd9e6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:31.075145 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf5252ad-81f6-4eb5-868f-b81d123cd9e6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:31.151791 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-bf5252ad-81f6-4eb5-868f-b81d123cd9e6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:31.164485 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bf5252ad-81f6-4eb5-868f-b81d123cd9e6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.103566 Apr 06 16:56:31.165115 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1131/2265] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:31 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:31.395890 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aef15fed-f5cb-4771-b3a5-d0e314d67865 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:31.396483 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aef15fed-f5cb-4771-b3a5-d0e314d67865 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:31.403376 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aef15fed-f5cb-4771-b3a5-d0e314d67865 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:31.403818 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aef15fed-f5cb-4771-b3a5-d0e314d67865 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:31.404593 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aef15fed-f5cb-4771-b3a5-d0e314d67865 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:31.405069 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aef15fed-f5cb-4771-b3a5-d0e314d67865 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:31.552366 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-aef15fed-f5cb-4771-b3a5-d0e314d67865 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:31.561832 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aef15fed-f5cb-4771-b3a5-d0e314d67865 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.169957 Apr 06 16:56:31.562401 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1135/2266] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:31 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:31.590778 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-475b0f84-2170-4def-97da-ae4aa61aa510 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:31.591408 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-475b0f84-2170-4def-97da-ae4aa61aa510 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:31.597783 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-475b0f84-2170-4def-97da-ae4aa61aa510 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:31.598221 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-475b0f84-2170-4def-97da-ae4aa61aa510 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:31.598986 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-475b0f84-2170-4def-97da-ae4aa61aa510 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:31.599411 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-475b0f84-2170-4def-97da-ae4aa61aa510 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:31.759288 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-475b0f84-2170-4def-97da-ae4aa61aa510 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:31.769522 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-475b0f84-2170-4def-97da-ae4aa61aa510 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:31.770999 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-475b0f84-2170-4def-97da-ae4aa61aa510 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:31.772182 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-475b0f84-2170-4def-97da-ae4aa61aa510 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.185511 Apr 06 16:56:31.772922 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1132/2267] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:31 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:32.182277 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fb5a899b-efa6-4441-ba7e-f4a190d0088f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:32.182889 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fb5a899b-efa6-4441-ba7e-f4a190d0088f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:32.189705 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb5a899b-efa6-4441-ba7e-f4a190d0088f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:32.190157 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb5a899b-efa6-4441-ba7e-f4a190d0088f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:32.190940 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb5a899b-efa6-4441-ba7e-f4a190d0088f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:32.191345 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb5a899b-efa6-4441-ba7e-f4a190d0088f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:32.255121 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fb5a899b-efa6-4441-ba7e-f4a190d0088f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:32.269982 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fb5a899b-efa6-4441-ba7e-f4a190d0088f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.091628 Apr 06 16:56:32.270579 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1136/2268] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:32 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:32.579395 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c8c7fd44-5710-44a6-9924-5a4556064d2d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:32.579910 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c8c7fd44-5710-44a6-9924-5a4556064d2d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:32.586758 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8c7fd44-5710-44a6-9924-5a4556064d2d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:32.587215 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8c7fd44-5710-44a6-9924-5a4556064d2d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:32.587998 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8c7fd44-5710-44a6-9924-5a4556064d2d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:32.588434 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8c7fd44-5710-44a6-9924-5a4556064d2d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:32.737398 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c8c7fd44-5710-44a6-9924-5a4556064d2d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:32.746652 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c8c7fd44-5710-44a6-9924-5a4556064d2d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.171216 Apr 06 16:56:32.747243 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1133/2269] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:32 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:32.793351 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f22e63a8-8a05-4505-b76a-f684e33ef43c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:32.794065 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f22e63a8-8a05-4505-b76a-f684e33ef43c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:32.800906 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f22e63a8-8a05-4505-b76a-f684e33ef43c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:32.801347 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f22e63a8-8a05-4505-b76a-f684e33ef43c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:32.802138 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f22e63a8-8a05-4505-b76a-f684e33ef43c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:32.802591 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f22e63a8-8a05-4505-b76a-f684e33ef43c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:32.946675 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f22e63a8-8a05-4505-b76a-f684e33ef43c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:32.956589 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f22e63a8-8a05-4505-b76a-f684e33ef43c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:32.958625 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f22e63a8-8a05-4505-b76a-f684e33ef43c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:32.959825 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f22e63a8-8a05-4505-b76a-f684e33ef43c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.172135 Apr 06 16:56:32.960383 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1137/2270] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:32 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:33.287548 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7190bb2c-4ebe-4edb-abc8-c7cb97151ca3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:33.288159 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7190bb2c-4ebe-4edb-abc8-c7cb97151ca3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:33.295011 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7190bb2c-4ebe-4edb-abc8-c7cb97151ca3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:33.295461 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7190bb2c-4ebe-4edb-abc8-c7cb97151ca3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:33.296239 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7190bb2c-4ebe-4edb-abc8-c7cb97151ca3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:33.296670 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7190bb2c-4ebe-4edb-abc8-c7cb97151ca3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:33.363706 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7190bb2c-4ebe-4edb-abc8-c7cb97151ca3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:33.373329 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7190bb2c-4ebe-4edb-abc8-c7cb97151ca3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.089488 Apr 06 16:56:33.373920 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1134/2271] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:33 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:33.764114 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2996facb-80a2-4668-b7f1-aa15081728a8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:33.764715 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2996facb-80a2-4668-b7f1-aa15081728a8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:33.771210 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2996facb-80a2-4668-b7f1-aa15081728a8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:33.771658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2996facb-80a2-4668-b7f1-aa15081728a8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:33.772424 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2996facb-80a2-4668-b7f1-aa15081728a8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:33.772902 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2996facb-80a2-4668-b7f1-aa15081728a8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:33.916273 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2996facb-80a2-4668-b7f1-aa15081728a8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:33.924586 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2996facb-80a2-4668-b7f1-aa15081728a8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.164716 Apr 06 16:56:33.925415 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1138/2272] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:33 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:33.979982 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3d713a2b-f1d9-422a-b76a-1add4492bce7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:33.981434 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3d713a2b-f1d9-422a-b76a-1add4492bce7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:33.988070 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d713a2b-f1d9-422a-b76a-1add4492bce7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:33.988509 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d713a2b-f1d9-422a-b76a-1add4492bce7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:33.989303 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d713a2b-f1d9-422a-b76a-1add4492bce7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:33.989726 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d713a2b-f1d9-422a-b76a-1add4492bce7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:34.236370 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3d713a2b-f1d9-422a-b76a-1add4492bce7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:34.245359 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3d713a2b-f1d9-422a-b76a-1add4492bce7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:34.246985 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3d713a2b-f1d9-422a-b76a-1add4492bce7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:34.248169 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3d713a2b-f1d9-422a-b76a-1add4492bce7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.272574 Apr 06 16:56:34.248762 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1135/2273] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:33 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:34.390834 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8a197b5e-7e87-4b1b-b93f-0f8a63596ae0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:34.391416 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8a197b5e-7e87-4b1b-b93f-0f8a63596ae0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:34.398176 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a197b5e-7e87-4b1b-b93f-0f8a63596ae0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:34.398629 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a197b5e-7e87-4b1b-b93f-0f8a63596ae0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:34.399410 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a197b5e-7e87-4b1b-b93f-0f8a63596ae0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:34.399842 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a197b5e-7e87-4b1b-b93f-0f8a63596ae0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:34.460323 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8a197b5e-7e87-4b1b-b93f-0f8a63596ae0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:34.469619 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8a197b5e-7e87-4b1b-b93f-0f8a63596ae0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.082770 Apr 06 16:56:34.470479 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1139/2274] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:34 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:34.942546 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eee806fd-2357-4e59-b8e1-dc5baedff049 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:34.943176 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eee806fd-2357-4e59-b8e1-dc5baedff049 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:34.950137 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eee806fd-2357-4e59-b8e1-dc5baedff049 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:34.950592 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eee806fd-2357-4e59-b8e1-dc5baedff049 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:34.951357 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eee806fd-2357-4e59-b8e1-dc5baedff049 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:34.951816 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eee806fd-2357-4e59-b8e1-dc5baedff049 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:35.108720 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-eee806fd-2357-4e59-b8e1-dc5baedff049 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:35.117307 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eee806fd-2357-4e59-b8e1-dc5baedff049 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.178664 Apr 06 16:56:35.117871 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1136/2275] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:34 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:35.269262 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6c217253-d694-4d49-8e7b-7aef174d16e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:35.269886 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6c217253-d694-4d49-8e7b-7aef174d16e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:35.276463 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c217253-d694-4d49-8e7b-7aef174d16e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:35.276940 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c217253-d694-4d49-8e7b-7aef174d16e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:35.277725 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c217253-d694-4d49-8e7b-7aef174d16e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:35.278159 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c217253-d694-4d49-8e7b-7aef174d16e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:35.422938 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6c217253-d694-4d49-8e7b-7aef174d16e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:35.431809 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6c217253-d694-4d49-8e7b-7aef174d16e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:35.433371 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6c217253-d694-4d49-8e7b-7aef174d16e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:35.434546 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6c217253-d694-4d49-8e7b-7aef174d16e1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.169351 Apr 06 16:56:35.435097 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1140/2276] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:35 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:35.487491 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c250fd3f-58e6-41e9-9fb2-2aee60cc531f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:35.488093 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c250fd3f-58e6-41e9-9fb2-2aee60cc531f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:35.497089 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c250fd3f-58e6-41e9-9fb2-2aee60cc531f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:35.497532 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c250fd3f-58e6-41e9-9fb2-2aee60cc531f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:35.498294 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c250fd3f-58e6-41e9-9fb2-2aee60cc531f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:35.498688 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c250fd3f-58e6-41e9-9fb2-2aee60cc531f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:35.566249 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c250fd3f-58e6-41e9-9fb2-2aee60cc531f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:35.576460 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c250fd3f-58e6-41e9-9fb2-2aee60cc531f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.092854 Apr 06 16:56:35.577648 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1137/2277] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:35 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:36.135407 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2afa2d90-b94e-4381-8ef9-3353c1a907de tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:36.136271 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2afa2d90-b94e-4381-8ef9-3353c1a907de tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:36.143050 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2afa2d90-b94e-4381-8ef9-3353c1a907de tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:36.143511 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2afa2d90-b94e-4381-8ef9-3353c1a907de tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:36.144285 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2afa2d90-b94e-4381-8ef9-3353c1a907de tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:36.144717 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2afa2d90-b94e-4381-8ef9-3353c1a907de tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:36.280261 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2afa2d90-b94e-4381-8ef9-3353c1a907de tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:36.288714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2afa2d90-b94e-4381-8ef9-3353c1a907de tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.157340 Apr 06 16:56:36.289307 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1141/2278] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:36 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:36.453664 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-75d49873-b310-469b-8008-085eaddd4879 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:36.454265 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-75d49873-b310-469b-8008-085eaddd4879 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:36.460952 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75d49873-b310-469b-8008-085eaddd4879 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:36.461412 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75d49873-b310-469b-8008-085eaddd4879 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:36.462174 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75d49873-b310-469b-8008-085eaddd4879 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:36.462612 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75d49873-b310-469b-8008-085eaddd4879 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:36.594647 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fd1c40e7-46fa-42e2-a6bc-0c34aeb45c0e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:36.595303 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fd1c40e7-46fa-42e2-a6bc-0c34aeb45c0e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:36.598612 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-75d49873-b310-469b-8008-085eaddd4879 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:36.601512 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd1c40e7-46fa-42e2-a6bc-0c34aeb45c0e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:36.602606 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd1c40e7-46fa-42e2-a6bc-0c34aeb45c0e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:36.603096 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd1c40e7-46fa-42e2-a6bc-0c34aeb45c0e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:36.603527 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fd1c40e7-46fa-42e2-a6bc-0c34aeb45c0e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:36.608159 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-75d49873-b310-469b-8008-085eaddd4879 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:36.609660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-75d49873-b310-469b-8008-085eaddd4879 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:36.610816 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-75d49873-b310-469b-8008-085eaddd4879 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.161515 Apr 06 16:56:36.611366 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1138/2279] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:36 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:36.663124 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fd1c40e7-46fa-42e2-a6bc-0c34aeb45c0e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:36.671849 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fd1c40e7-46fa-42e2-a6bc-0c34aeb45c0e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.081153 Apr 06 16:56:36.672437 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1142/2280] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:36 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:37.306178 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-de602339-73c9-4dc0-8c14-cd0e6229387e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:37.306785 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-de602339-73c9-4dc0-8c14-cd0e6229387e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:37.313734 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de602339-73c9-4dc0-8c14-cd0e6229387e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:37.314177 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de602339-73c9-4dc0-8c14-cd0e6229387e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:37.314941 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de602339-73c9-4dc0-8c14-cd0e6229387e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:37.315364 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de602339-73c9-4dc0-8c14-cd0e6229387e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:37.451108 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-de602339-73c9-4dc0-8c14-cd0e6229387e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:37.459422 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-de602339-73c9-4dc0-8c14-cd0e6229387e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.157227 Apr 06 16:56:37.460074 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1139/2281] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:37 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:37.629822 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a8b96aeb-1a38-48e9-b6c2-30de69ab6aae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:37.630435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a8b96aeb-1a38-48e9-b6c2-30de69ab6aae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:37.637537 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8b96aeb-1a38-48e9-b6c2-30de69ab6aae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:37.637977 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8b96aeb-1a38-48e9-b6c2-30de69ab6aae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:37.638729 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8b96aeb-1a38-48e9-b6c2-30de69ab6aae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:37.639166 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8b96aeb-1a38-48e9-b6c2-30de69ab6aae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:37.692282 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9be6a191-8a6a-4b5b-9a37-5b54f1793dd4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:37.692993 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9be6a191-8a6a-4b5b-9a37-5b54f1793dd4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:37.699747 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9be6a191-8a6a-4b5b-9a37-5b54f1793dd4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:37.700218 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9be6a191-8a6a-4b5b-9a37-5b54f1793dd4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:37.701151 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9be6a191-8a6a-4b5b-9a37-5b54f1793dd4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:37.701788 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9be6a191-8a6a-4b5b-9a37-5b54f1793dd4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:37.773872 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9be6a191-8a6a-4b5b-9a37-5b54f1793dd4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:37.781575 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a8b96aeb-1a38-48e9-b6c2-30de69ab6aae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:37.783053 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9be6a191-8a6a-4b5b-9a37-5b54f1793dd4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.097385 Apr 06 16:56:37.783623 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1140/2282] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:37 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:37.789916 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a8b96aeb-1a38-48e9-b6c2-30de69ab6aae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:37.791383 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a8b96aeb-1a38-48e9-b6c2-30de69ab6aae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:37.792848 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a8b96aeb-1a38-48e9-b6c2-30de69ab6aae tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.166726 Apr 06 16:56:37.793496 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1143/2283] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:37 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:38.477140 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a00cbbf6-e32a-45e8-92e2-a16f94ca0036 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:38.477742 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a00cbbf6-e32a-45e8-92e2-a16f94ca0036 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:38.484540 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a00cbbf6-e32a-45e8-92e2-a16f94ca0036 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:38.485013 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a00cbbf6-e32a-45e8-92e2-a16f94ca0036 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:38.485780 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a00cbbf6-e32a-45e8-92e2-a16f94ca0036 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:38.486207 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a00cbbf6-e32a-45e8-92e2-a16f94ca0036 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:38.622785 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a00cbbf6-e32a-45e8-92e2-a16f94ca0036 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:38.631108 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a00cbbf6-e32a-45e8-92e2-a16f94ca0036 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.158245 Apr 06 16:56:38.631694 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1141/2284] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:38 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:38.801354 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a1d7108c-46da-48c3-a925-c61f1f176fab tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:38.802035 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a1d7108c-46da-48c3-a925-c61f1f176fab tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:38.809440 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1d7108c-46da-48c3-a925-c61f1f176fab tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:38.809940 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1d7108c-46da-48c3-a925-c61f1f176fab tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:38.810711 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1d7108c-46da-48c3-a925-c61f1f176fab tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:38.811146 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a1d7108c-46da-48c3-a925-c61f1f176fab tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:38.812063 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2369de65-66bc-4114-b019-bb5ba5fbf823 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:38.812663 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2369de65-66bc-4114-b019-bb5ba5fbf823 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:38.819051 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2369de65-66bc-4114-b019-bb5ba5fbf823 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:38.819503 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2369de65-66bc-4114-b019-bb5ba5fbf823 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:38.820268 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2369de65-66bc-4114-b019-bb5ba5fbf823 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:38.820727 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2369de65-66bc-4114-b019-bb5ba5fbf823 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:38.873744 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a1d7108c-46da-48c3-a925-c61f1f176fab tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:38.882352 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a1d7108c-46da-48c3-a925-c61f1f176fab tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.084907 Apr 06 16:56:38.882949 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1144/2285] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:38 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:38.956421 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2369de65-66bc-4114-b019-bb5ba5fbf823 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:38.966033 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2369de65-66bc-4114-b019-bb5ba5fbf823 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:38.967528 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2369de65-66bc-4114-b019-bb5ba5fbf823 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:38.968698 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2369de65-66bc-4114-b019-bb5ba5fbf823 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.161105 Apr 06 16:56:38.969282 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1142/2286] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:38 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:39.648724 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e82a57d3-b5ad-4dc9-bb3e-1712ac6897d6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:39.649351 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e82a57d3-b5ad-4dc9-bb3e-1712ac6897d6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:39.656253 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e82a57d3-b5ad-4dc9-bb3e-1712ac6897d6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:39.656728 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e82a57d3-b5ad-4dc9-bb3e-1712ac6897d6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:39.657562 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e82a57d3-b5ad-4dc9-bb3e-1712ac6897d6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:39.657993 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e82a57d3-b5ad-4dc9-bb3e-1712ac6897d6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:39.801368 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e82a57d3-b5ad-4dc9-bb3e-1712ac6897d6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:39.810222 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e82a57d3-b5ad-4dc9-bb3e-1712ac6897d6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.165475 Apr 06 16:56:39.810934 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1145/2287] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:39 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:39.901269 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-167d513a-5139-413d-9cbd-3a7c6c6006ba tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:39.901922 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-167d513a-5139-413d-9cbd-3a7c6c6006ba tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:39.909048 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-167d513a-5139-413d-9cbd-3a7c6c6006ba tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:39.909498 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-167d513a-5139-413d-9cbd-3a7c6c6006ba tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:39.910266 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-167d513a-5139-413d-9cbd-3a7c6c6006ba tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:39.910728 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-167d513a-5139-413d-9cbd-3a7c6c6006ba tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:39.974698 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-167d513a-5139-413d-9cbd-3a7c6c6006ba tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:39.983606 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-167d513a-5139-413d-9cbd-3a7c6c6006ba tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.087870 Apr 06 16:56:39.984186 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1143/2288] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:39 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:39.987517 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e1487c6b-51e1-4cfd-b483-75d243977944 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:39.988121 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e1487c6b-51e1-4cfd-b483-75d243977944 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:39.994290 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1487c6b-51e1-4cfd-b483-75d243977944 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:39.994741 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1487c6b-51e1-4cfd-b483-75d243977944 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:39.995666 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1487c6b-51e1-4cfd-b483-75d243977944 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:39.996070 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e1487c6b-51e1-4cfd-b483-75d243977944 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:40.136754 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e1487c6b-51e1-4cfd-b483-75d243977944 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:40.145554 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e1487c6b-51e1-4cfd-b483-75d243977944 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:40.147160 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e1487c6b-51e1-4cfd-b483-75d243977944 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:40.148302 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e1487c6b-51e1-4cfd-b483-75d243977944 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.164746 Apr 06 16:56:40.148896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1146/2289] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:39 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:56:40.830520 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-daa7a4c0-e5d0-4bcf-b639-21f2cb76c3ac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:40.831504 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-daa7a4c0-e5d0-4bcf-b639-21f2cb76c3ac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:40.838302 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-daa7a4c0-e5d0-4bcf-b639-21f2cb76c3ac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:40.838745 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-daa7a4c0-e5d0-4bcf-b639-21f2cb76c3ac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:40.839618 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-daa7a4c0-e5d0-4bcf-b639-21f2cb76c3ac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:40.840053 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-daa7a4c0-e5d0-4bcf-b639-21f2cb76c3ac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:40.994364 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-daa7a4c0-e5d0-4bcf-b639-21f2cb76c3ac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:41.001660 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-41457481-cb26-4741-a9b7-da8e5cfbce58 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:41.002220 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-41457481-cb26-4741-a9b7-da8e5cfbce58 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:41.003003 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-daa7a4c0-e5d0-4bcf-b639-21f2cb76c3ac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.178209 Apr 06 16:56:41.003642 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1144/2290] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:40 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:41.008700 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41457481-cb26-4741-a9b7-da8e5cfbce58 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:41.009165 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41457481-cb26-4741-a9b7-da8e5cfbce58 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:41.009930 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41457481-cb26-4741-a9b7-da8e5cfbce58 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:41.010360 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41457481-cb26-4741-a9b7-da8e5cfbce58 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:41.069847 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-41457481-cb26-4741-a9b7-da8e5cfbce58 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:41.080799 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-41457481-cb26-4741-a9b7-da8e5cfbce58 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.083106 Apr 06 16:56:41.081741 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1147/2291] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:40 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:41.167448 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-954c7723-85aa-4aee-9c76-06c59a1349f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:41.168118 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-954c7723-85aa-4aee-9c76-06c59a1349f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:41.174614 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-954c7723-85aa-4aee-9c76-06c59a1349f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:41.175057 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-954c7723-85aa-4aee-9c76-06c59a1349f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:41.175811 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-954c7723-85aa-4aee-9c76-06c59a1349f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:41.176238 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-954c7723-85aa-4aee-9c76-06c59a1349f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:41.318735 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-954c7723-85aa-4aee-9c76-06c59a1349f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:41.328401 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-954c7723-85aa-4aee-9c76-06c59a1349f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:41.329945 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-954c7723-85aa-4aee-9c76-06c59a1349f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:41.331211 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-954c7723-85aa-4aee-9c76-06c59a1349f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.167864 Apr 06 16:56:41.331932 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1145/2292] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:41 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:42.021350 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3cc1ae2c-81e5-41dd-8903-7620da7539a8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:42.021987 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3cc1ae2c-81e5-41dd-8903-7620da7539a8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:42.028874 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3cc1ae2c-81e5-41dd-8903-7620da7539a8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:42.029324 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3cc1ae2c-81e5-41dd-8903-7620da7539a8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:42.030094 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3cc1ae2c-81e5-41dd-8903-7620da7539a8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:42.030524 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3cc1ae2c-81e5-41dd-8903-7620da7539a8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:42.098739 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ba0fbb9d-a8bc-4cb1-b9e4-29a163a0a6d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:42.099366 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ba0fbb9d-a8bc-4cb1-b9e4-29a163a0a6d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:42.106054 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba0fbb9d-a8bc-4cb1-b9e4-29a163a0a6d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:42.106497 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba0fbb9d-a8bc-4cb1-b9e4-29a163a0a6d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:42.107330 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba0fbb9d-a8bc-4cb1-b9e4-29a163a0a6d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:42.107731 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba0fbb9d-a8bc-4cb1-b9e4-29a163a0a6d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:42.171992 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ba0fbb9d-a8bc-4cb1-b9e4-29a163a0a6d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:42.172490 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3cc1ae2c-81e5-41dd-8903-7620da7539a8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:42.180269 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ba0fbb9d-a8bc-4cb1-b9e4-29a163a0a6d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.085373 Apr 06 16:56:42.180503 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3cc1ae2c-81e5-41dd-8903-7620da7539a8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.162935 Apr 06 16:56:42.180843 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1146/2293] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:42 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:42.180997 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1148/2294] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:42 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:42.350357 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-64e4bd8f-608f-4eb2-a133-266d8d959243 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:42.350957 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-64e4bd8f-608f-4eb2-a133-266d8d959243 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:42.358122 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64e4bd8f-608f-4eb2-a133-266d8d959243 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:42.358561 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64e4bd8f-608f-4eb2-a133-266d8d959243 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:42.359315 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64e4bd8f-608f-4eb2-a133-266d8d959243 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:42.359773 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64e4bd8f-608f-4eb2-a133-266d8d959243 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:42.496726 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-64e4bd8f-608f-4eb2-a133-266d8d959243 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:42.505775 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-64e4bd8f-608f-4eb2-a133-266d8d959243 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:42.507280 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-64e4bd8f-608f-4eb2-a133-266d8d959243 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:42.508450 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-64e4bd8f-608f-4eb2-a133-266d8d959243 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.162087 Apr 06 16:56:42.509050 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1147/2295] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:42 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:43.197805 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0d96e8ad-10c7-4759-88aa-b024cc8edb24 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:43.198435 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dac4a4c6-4f11-4e37-976d-c24567746d97 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:43.199187 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0d96e8ad-10c7-4759-88aa-b024cc8edb24 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:43.199358 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dac4a4c6-4f11-4e37-976d-c24567746d97 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:43.205521 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d96e8ad-10c7-4759-88aa-b024cc8edb24 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:43.205691 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dac4a4c6-4f11-4e37-976d-c24567746d97 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:43.205978 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d96e8ad-10c7-4759-88aa-b024cc8edb24 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:43.206153 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dac4a4c6-4f11-4e37-976d-c24567746d97 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:43.206749 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d96e8ad-10c7-4759-88aa-b024cc8edb24 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:43.206900 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dac4a4c6-4f11-4e37-976d-c24567746d97 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:43.207180 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d96e8ad-10c7-4759-88aa-b024cc8edb24 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:43.207330 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dac4a4c6-4f11-4e37-976d-c24567746d97 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:43.268411 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0d96e8ad-10c7-4759-88aa-b024cc8edb24 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:43.276462 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0d96e8ad-10c7-4759-88aa-b024cc8edb24 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.082517 Apr 06 16:56:43.277070 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1149/2296] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:43 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:43.343413 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-dac4a4c6-4f11-4e37-976d-c24567746d97 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:43.351353 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dac4a4c6-4f11-4e37-976d-c24567746d97 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.157104 Apr 06 16:56:43.352362 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1148/2297] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:43 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:43.528527 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7fcde17d-dfad-4c23-afcf-37e5fba5b81e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:43.528967 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7fcde17d-dfad-4c23-afcf-37e5fba5b81e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:43.538951 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fcde17d-dfad-4c23-afcf-37e5fba5b81e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:43.539695 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fcde17d-dfad-4c23-afcf-37e5fba5b81e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:43.541012 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fcde17d-dfad-4c23-afcf-37e5fba5b81e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:43.541737 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fcde17d-dfad-4c23-afcf-37e5fba5b81e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:43.685282 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7fcde17d-dfad-4c23-afcf-37e5fba5b81e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:43.693903 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7fcde17d-dfad-4c23-afcf-37e5fba5b81e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:43.695576 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7fcde17d-dfad-4c23-afcf-37e5fba5b81e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:43.696714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7fcde17d-dfad-4c23-afcf-37e5fba5b81e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.173054 Apr 06 16:56:43.697313 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1150/2298] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:43 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:44.296007 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-65184d6e-32f8-407e-a682-647455c23f7c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:44.296656 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-65184d6e-32f8-407e-a682-647455c23f7c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:44.303456 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65184d6e-32f8-407e-a682-647455c23f7c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:44.303908 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65184d6e-32f8-407e-a682-647455c23f7c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:44.304709 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65184d6e-32f8-407e-a682-647455c23f7c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:44.305146 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65184d6e-32f8-407e-a682-647455c23f7c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:44.369195 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-65184d6e-32f8-407e-a682-647455c23f7c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:44.369397 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e60c23d5-fb34-490e-ac78-fce8a32fb694 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:44.370020 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e60c23d5-fb34-490e-ac78-fce8a32fb694 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:44.377280 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e60c23d5-fb34-490e-ac78-fce8a32fb694 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:44.377717 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e60c23d5-fb34-490e-ac78-fce8a32fb694 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:44.378265 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-65184d6e-32f8-407e-a682-647455c23f7c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.087028 Apr 06 16:56:44.378430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e60c23d5-fb34-490e-ac78-fce8a32fb694 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:44.378874 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e60c23d5-fb34-490e-ac78-fce8a32fb694 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:44.379025 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1149/2299] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:44 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:44.518870 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e60c23d5-fb34-490e-ac78-fce8a32fb694 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:44.527854 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e60c23d5-fb34-490e-ac78-fce8a32fb694 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.162436 Apr 06 16:56:44.528429 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1151/2300] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:44 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:44.717764 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a23b6ebb-8dd1-43b1-bade-f1dfc8192993 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:44.718346 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a23b6ebb-8dd1-43b1-bade-f1dfc8192993 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:44.724923 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a23b6ebb-8dd1-43b1-bade-f1dfc8192993 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:44.725559 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a23b6ebb-8dd1-43b1-bade-f1dfc8192993 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:44.726711 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a23b6ebb-8dd1-43b1-bade-f1dfc8192993 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:44.727740 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a23b6ebb-8dd1-43b1-bade-f1dfc8192993 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:45.115107 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a23b6ebb-8dd1-43b1-bade-f1dfc8192993 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:45.124220 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a23b6ebb-8dd1-43b1-bade-f1dfc8192993 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:45.125740 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a23b6ebb-8dd1-43b1-bade-f1dfc8192993 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:45.126905 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a23b6ebb-8dd1-43b1-bade-f1dfc8192993 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.413269 Apr 06 16:56:45.127475 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1150/2301] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:44 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:45.395763 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-116ce41d-d5aa-4617-aad4-4ccc11b51372 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:45.396501 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-116ce41d-d5aa-4617-aad4-4ccc11b51372 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:45.403362 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-116ce41d-d5aa-4617-aad4-4ccc11b51372 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:45.403816 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-116ce41d-d5aa-4617-aad4-4ccc11b51372 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:45.404585 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-116ce41d-d5aa-4617-aad4-4ccc11b51372 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:45.405138 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-116ce41d-d5aa-4617-aad4-4ccc11b51372 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:45.465316 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-116ce41d-d5aa-4617-aad4-4ccc11b51372 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:45.474017 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-116ce41d-d5aa-4617-aad4-4ccc11b51372 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.082183 Apr 06 16:56:45.474607 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1152/2302] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:45 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:45.545716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-617e9c76-0c58-43a8-8517-e46c90ab820a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:45.546360 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-617e9c76-0c58-43a8-8517-e46c90ab820a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:45.555595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-617e9c76-0c58-43a8-8517-e46c90ab820a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:45.556199 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-617e9c76-0c58-43a8-8517-e46c90ab820a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:45.557214 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-617e9c76-0c58-43a8-8517-e46c90ab820a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:45.557978 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-617e9c76-0c58-43a8-8517-e46c90ab820a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:45.705176 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-617e9c76-0c58-43a8-8517-e46c90ab820a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:45.713856 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-617e9c76-0c58-43a8-8517-e46c90ab820a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.172372 Apr 06 16:56:45.714448 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1151/2303] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:45 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:46.149219 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c9a41146-229f-48e8-93fe-79e998fccaa7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:46.149990 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c9a41146-229f-48e8-93fe-79e998fccaa7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:46.157501 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9a41146-229f-48e8-93fe-79e998fccaa7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:46.157954 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9a41146-229f-48e8-93fe-79e998fccaa7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:46.158725 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9a41146-229f-48e8-93fe-79e998fccaa7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:46.159165 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9a41146-229f-48e8-93fe-79e998fccaa7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:46.303797 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c9a41146-229f-48e8-93fe-79e998fccaa7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:46.312778 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c9a41146-229f-48e8-93fe-79e998fccaa7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:46.314343 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c9a41146-229f-48e8-93fe-79e998fccaa7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:46.315513 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c9a41146-229f-48e8-93fe-79e998fccaa7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.172818 Apr 06 16:56:46.316077 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1153/2304] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:46 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:46.492059 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-68b0f92b-e236-4650-89a7-91ae1cec995c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:46.492566 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-68b0f92b-e236-4650-89a7-91ae1cec995c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:46.499200 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68b0f92b-e236-4650-89a7-91ae1cec995c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:46.499647 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68b0f92b-e236-4650-89a7-91ae1cec995c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:46.503738 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68b0f92b-e236-4650-89a7-91ae1cec995c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:46.503738 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68b0f92b-e236-4650-89a7-91ae1cec995c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:46.567461 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-68b0f92b-e236-4650-89a7-91ae1cec995c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:46.576717 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-68b0f92b-e236-4650-89a7-91ae1cec995c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.088689 Apr 06 16:56:46.577360 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1152/2305] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:46 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:46.732234 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-80849916-b1de-42c0-91e2-da0ec2f8e920 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:46.732889 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-80849916-b1de-42c0-91e2-da0ec2f8e920 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:46.739782 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80849916-b1de-42c0-91e2-da0ec2f8e920 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:46.740230 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80849916-b1de-42c0-91e2-da0ec2f8e920 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:46.741039 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80849916-b1de-42c0-91e2-da0ec2f8e920 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:46.741473 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80849916-b1de-42c0-91e2-da0ec2f8e920 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:46.911217 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-80849916-b1de-42c0-91e2-da0ec2f8e920 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:46.920093 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-80849916-b1de-42c0-91e2-da0ec2f8e920 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.191813 Apr 06 16:56:46.920708 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1154/2306] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:46 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:47.334815 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-019f5532-6b2a-41ea-bb24-03dab2e17183 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:47.335434 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-019f5532-6b2a-41ea-bb24-03dab2e17183 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:47.342104 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-019f5532-6b2a-41ea-bb24-03dab2e17183 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:47.342556 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-019f5532-6b2a-41ea-bb24-03dab2e17183 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:47.343435 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-019f5532-6b2a-41ea-bb24-03dab2e17183 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:47.343778 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-019f5532-6b2a-41ea-bb24-03dab2e17183 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:47.494661 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-019f5532-6b2a-41ea-bb24-03dab2e17183 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:47.503871 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-019f5532-6b2a-41ea-bb24-03dab2e17183 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:47.505378 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-019f5532-6b2a-41ea-bb24-03dab2e17183 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:47.506553 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-019f5532-6b2a-41ea-bb24-03dab2e17183 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.175866 Apr 06 16:56:47.507120 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1153/2307] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:47 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:47.595138 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c49c00fd-8d62-4e26-8c9d-647f04bb6bed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:47.595777 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c49c00fd-8d62-4e26-8c9d-647f04bb6bed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:47.602771 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c49c00fd-8d62-4e26-8c9d-647f04bb6bed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:47.603216 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c49c00fd-8d62-4e26-8c9d-647f04bb6bed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:47.603968 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c49c00fd-8d62-4e26-8c9d-647f04bb6bed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:47.604401 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c49c00fd-8d62-4e26-8c9d-647f04bb6bed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:47.665127 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c49c00fd-8d62-4e26-8c9d-647f04bb6bed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:47.674351 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c49c00fd-8d62-4e26-8c9d-647f04bb6bed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.083405 Apr 06 16:56:47.674903 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1155/2308] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:47 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:47.940161 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f3096396-127f-4148-8e11-bcb7c3818c83 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:47.941125 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f3096396-127f-4148-8e11-bcb7c3818c83 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:47.950580 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3096396-127f-4148-8e11-bcb7c3818c83 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:47.951026 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3096396-127f-4148-8e11-bcb7c3818c83 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:47.951792 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3096396-127f-4148-8e11-bcb7c3818c83 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:47.952226 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3096396-127f-4148-8e11-bcb7c3818c83 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:48.100359 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f3096396-127f-4148-8e11-bcb7c3818c83 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:48.109516 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f3096396-127f-4148-8e11-bcb7c3818c83 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.175526 Apr 06 16:56:48.110106 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1154/2309] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:47 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:48.525559 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9c5bdfd0-57f0-46f3-9d8a-c08c4e08f7a7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:48.526180 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9c5bdfd0-57f0-46f3-9d8a-c08c4e08f7a7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:48.533498 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c5bdfd0-57f0-46f3-9d8a-c08c4e08f7a7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:48.533942 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c5bdfd0-57f0-46f3-9d8a-c08c4e08f7a7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:48.534711 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c5bdfd0-57f0-46f3-9d8a-c08c4e08f7a7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:48.535141 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9c5bdfd0-57f0-46f3-9d8a-c08c4e08f7a7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:48.684188 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9c5bdfd0-57f0-46f3-9d8a-c08c4e08f7a7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:48.692162 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0a3a31bc-3cee-443e-9a80-98b3d1a8c232 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:48.693341 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0a3a31bc-3cee-443e-9a80-98b3d1a8c232 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:48.696065 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9c5bdfd0-57f0-46f3-9d8a-c08c4e08f7a7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:48.697605 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9c5bdfd0-57f0-46f3-9d8a-c08c4e08f7a7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:48.698921 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9c5bdfd0-57f0-46f3-9d8a-c08c4e08f7a7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.177309 Apr 06 16:56:48.699512 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1156/2310] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:48 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:48.701033 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a3a31bc-3cee-443e-9a80-98b3d1a8c232 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:48.701485 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a3a31bc-3cee-443e-9a80-98b3d1a8c232 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:48.702267 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a3a31bc-3cee-443e-9a80-98b3d1a8c232 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:48.702697 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a3a31bc-3cee-443e-9a80-98b3d1a8c232 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:48.771673 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0a3a31bc-3cee-443e-9a80-98b3d1a8c232 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:48.780104 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0a3a31bc-3cee-443e-9a80-98b3d1a8c232 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.092226 Apr 06 16:56:48.780677 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1155/2311] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:48 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:49.127934 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8e372d92-6abb-4211-88ae-786ea7fb57f7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:49.128543 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8e372d92-6abb-4211-88ae-786ea7fb57f7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:49.136851 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e372d92-6abb-4211-88ae-786ea7fb57f7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:49.137428 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e372d92-6abb-4211-88ae-786ea7fb57f7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:49.138580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e372d92-6abb-4211-88ae-786ea7fb57f7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:49.139217 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e372d92-6abb-4211-88ae-786ea7fb57f7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:49.303831 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8e372d92-6abb-4211-88ae-786ea7fb57f7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:49.313560 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8e372d92-6abb-4211-88ae-786ea7fb57f7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.189423 Apr 06 16:56:49.314159 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1157/2312] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:49 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:49.719235 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c09666a0-af4c-4bbc-b805-027683d1524d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:49.719955 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c09666a0-af4c-4bbc-b805-027683d1524d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:49.729221 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c09666a0-af4c-4bbc-b805-027683d1524d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:49.729822 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c09666a0-af4c-4bbc-b805-027683d1524d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:49.730941 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c09666a0-af4c-4bbc-b805-027683d1524d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:49.731581 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c09666a0-af4c-4bbc-b805-027683d1524d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:49.800951 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ba52269d-2151-450a-b9b0-e83edbb2d92f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:49.801611 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ba52269d-2151-450a-b9b0-e83edbb2d92f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:49.810790 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba52269d-2151-450a-b9b0-e83edbb2d92f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:49.811240 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba52269d-2151-450a-b9b0-e83edbb2d92f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:49.812018 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba52269d-2151-450a-b9b0-e83edbb2d92f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:49.812456 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba52269d-2151-450a-b9b0-e83edbb2d92f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:49.871618 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ba52269d-2151-450a-b9b0-e83edbb2d92f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:49.880234 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ba52269d-2151-450a-b9b0-e83edbb2d92f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.085499 Apr 06 16:56:49.880964 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1158/2313] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:49 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:49.887315 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c09666a0-af4c-4bbc-b805-027683d1524d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:49.900248 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c09666a0-af4c-4bbc-b805-027683d1524d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:49.901791 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c09666a0-af4c-4bbc-b805-027683d1524d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:49.902968 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c09666a0-af4c-4bbc-b805-027683d1524d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.188735 Apr 06 16:56:49.903539 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1156/2314] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:49 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:50.332112 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-215441ad-d49a-41e9-9f69-5418ff2338cb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:50.332325 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-215441ad-d49a-41e9-9f69-5418ff2338cb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:50.338801 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-215441ad-d49a-41e9-9f69-5418ff2338cb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:50.339246 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-215441ad-d49a-41e9-9f69-5418ff2338cb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:50.340002 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-215441ad-d49a-41e9-9f69-5418ff2338cb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:50.340433 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-215441ad-d49a-41e9-9f69-5418ff2338cb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:50.476048 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-215441ad-d49a-41e9-9f69-5418ff2338cb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:50.484642 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-215441ad-d49a-41e9-9f69-5418ff2338cb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.156794 Apr 06 16:56:50.485263 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1159/2315] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:50 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:50.898112 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3f698390-c7cb-4308-9709-8b07ca802f30 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:50.898733 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3f698390-c7cb-4308-9709-8b07ca802f30 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:50.905660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f698390-c7cb-4308-9709-8b07ca802f30 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:50.906119 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f698390-c7cb-4308-9709-8b07ca802f30 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:50.906895 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f698390-c7cb-4308-9709-8b07ca802f30 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:50.907325 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f698390-c7cb-4308-9709-8b07ca802f30 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:50.921899 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-293a2219-9752-48cc-b456-6dda5b3483b7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:50.922537 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-293a2219-9752-48cc-b456-6dda5b3483b7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:50.929221 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-293a2219-9752-48cc-b456-6dda5b3483b7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:50.929666 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-293a2219-9752-48cc-b456-6dda5b3483b7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:50.930436 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-293a2219-9752-48cc-b456-6dda5b3483b7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:50.930861 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-293a2219-9752-48cc-b456-6dda5b3483b7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:50.971415 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3f698390-c7cb-4308-9709-8b07ca802f30 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:50.980648 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3f698390-c7cb-4308-9709-8b07ca802f30 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086310 Apr 06 16:56:50.981271 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1157/2316] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:50 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:51.076960 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-293a2219-9752-48cc-b456-6dda5b3483b7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:51.086442 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-293a2219-9752-48cc-b456-6dda5b3483b7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:51.087921 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-293a2219-9752-48cc-b456-6dda5b3483b7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:51.089137 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-293a2219-9752-48cc-b456-6dda5b3483b7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.171478 Apr 06 16:56:51.089765 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1160/2317] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:50 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:51.503193 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ec461ea9-8170-4ffa-b650-6c3be4f8522d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:51.503799 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ec461ea9-8170-4ffa-b650-6c3be4f8522d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:51.510494 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec461ea9-8170-4ffa-b650-6c3be4f8522d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:51.510936 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec461ea9-8170-4ffa-b650-6c3be4f8522d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:51.511695 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec461ea9-8170-4ffa-b650-6c3be4f8522d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:51.512157 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec461ea9-8170-4ffa-b650-6c3be4f8522d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:51.664371 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ec461ea9-8170-4ffa-b650-6c3be4f8522d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:51.673264 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ec461ea9-8170-4ffa-b650-6c3be4f8522d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.174034 Apr 06 16:56:51.673846 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1158/2318] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:51 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:52.000557 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-28849cda-e002-4f24-a704-9cbbd0f1efca tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:52.001231 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-28849cda-e002-4f24-a704-9cbbd0f1efca tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:52.008064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28849cda-e002-4f24-a704-9cbbd0f1efca tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:52.008522 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28849cda-e002-4f24-a704-9cbbd0f1efca tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:52.009320 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28849cda-e002-4f24-a704-9cbbd0f1efca tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:52.009755 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28849cda-e002-4f24-a704-9cbbd0f1efca tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:52.069739 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-28849cda-e002-4f24-a704-9cbbd0f1efca tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:52.077932 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-28849cda-e002-4f24-a704-9cbbd0f1efca tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.082574 Apr 06 16:56:52.078512 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1161/2319] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:51 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:52.108232 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-46c68c04-32d3-48fb-b712-01b2bf486e14 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:52.108894 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-46c68c04-32d3-48fb-b712-01b2bf486e14 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:52.115740 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46c68c04-32d3-48fb-b712-01b2bf486e14 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:52.116191 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46c68c04-32d3-48fb-b712-01b2bf486e14 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:52.117003 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46c68c04-32d3-48fb-b712-01b2bf486e14 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:52.117437 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46c68c04-32d3-48fb-b712-01b2bf486e14 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:52.273944 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-46c68c04-32d3-48fb-b712-01b2bf486e14 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:52.282909 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-46c68c04-32d3-48fb-b712-01b2bf486e14 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:52.284378 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-46c68c04-32d3-48fb-b712-01b2bf486e14 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:52.285555 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-46c68c04-32d3-48fb-b712-01b2bf486e14 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.181607 Apr 06 16:56:52.286112 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1159/2320] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:52 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:52.699190 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c04b38bf-1aeb-4a31-8893-c901f9b8e277 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:52.700243 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c04b38bf-1aeb-4a31-8893-c901f9b8e277 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:52.711427 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c04b38bf-1aeb-4a31-8893-c901f9b8e277 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:52.712163 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c04b38bf-1aeb-4a31-8893-c901f9b8e277 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:52.713452 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c04b38bf-1aeb-4a31-8893-c901f9b8e277 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:52.714155 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c04b38bf-1aeb-4a31-8893-c901f9b8e277 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:52.853456 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c04b38bf-1aeb-4a31-8893-c901f9b8e277 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:52.861419 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c04b38bf-1aeb-4a31-8893-c901f9b8e277 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.168983 Apr 06 16:56:52.861946 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1162/2321] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:52 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:53.095244 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-99b0c634-b213-483f-b71e-f5b29d3de550 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:53.095755 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-99b0c634-b213-483f-b71e-f5b29d3de550 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:53.102593 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99b0c634-b213-483f-b71e-f5b29d3de550 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:53.103058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99b0c634-b213-483f-b71e-f5b29d3de550 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:53.103814 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99b0c634-b213-483f-b71e-f5b29d3de550 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:53.104242 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99b0c634-b213-483f-b71e-f5b29d3de550 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:53.175254 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-99b0c634-b213-483f-b71e-f5b29d3de550 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:53.183464 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-99b0c634-b213-483f-b71e-f5b29d3de550 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.092389 Apr 06 16:56:53.184039 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1160/2322] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:53 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:53.307930 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e0ed124d-b533-4645-9881-9dad064c2e74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:53.308540 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e0ed124d-b533-4645-9881-9dad064c2e74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:53.316039 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0ed124d-b533-4645-9881-9dad064c2e74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:53.316491 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0ed124d-b533-4645-9881-9dad064c2e74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:53.317301 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0ed124d-b533-4645-9881-9dad064c2e74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:53.317735 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0ed124d-b533-4645-9881-9dad064c2e74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:53.476872 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e0ed124d-b533-4645-9881-9dad064c2e74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:53.486385 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e0ed124d-b533-4645-9881-9dad064c2e74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:53.487880 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e0ed124d-b533-4645-9881-9dad064c2e74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:53.489088 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e0ed124d-b533-4645-9881-9dad064c2e74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.185248 Apr 06 16:56:53.489665 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1163/2323] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:53 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:53.880363 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0b9caa5d-74c7-4b15-9eec-28f45fc961f2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:53.881007 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0b9caa5d-74c7-4b15-9eec-28f45fc961f2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:53.887512 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b9caa5d-74c7-4b15-9eec-28f45fc961f2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:53.887956 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b9caa5d-74c7-4b15-9eec-28f45fc961f2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:53.888735 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b9caa5d-74c7-4b15-9eec-28f45fc961f2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:53.889161 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b9caa5d-74c7-4b15-9eec-28f45fc961f2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:54.033346 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0b9caa5d-74c7-4b15-9eec-28f45fc961f2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:54.045387 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0b9caa5d-74c7-4b15-9eec-28f45fc961f2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.169865 Apr 06 16:56:54.046907 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1161/2324] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:53 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:54.200823 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-46b38821-eb08-4d5c-8c60-88b166059a8c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:54.201389 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-46b38821-eb08-4d5c-8c60-88b166059a8c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:54.208221 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46b38821-eb08-4d5c-8c60-88b166059a8c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:54.208670 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46b38821-eb08-4d5c-8c60-88b166059a8c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:54.209687 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46b38821-eb08-4d5c-8c60-88b166059a8c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:54.210152 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-46b38821-eb08-4d5c-8c60-88b166059a8c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:54.271162 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-46b38821-eb08-4d5c-8c60-88b166059a8c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:54.279433 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-46b38821-eb08-4d5c-8c60-88b166059a8c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.082576 Apr 06 16:56:54.279998 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1164/2325] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:54 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:54.507220 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6f05e6ae-92ea-4d68-88ab-57d8e7d99c46 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:54.507838 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6f05e6ae-92ea-4d68-88ab-57d8e7d99c46 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:54.514556 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f05e6ae-92ea-4d68-88ab-57d8e7d99c46 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:54.515011 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f05e6ae-92ea-4d68-88ab-57d8e7d99c46 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:54.515863 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f05e6ae-92ea-4d68-88ab-57d8e7d99c46 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:54.516304 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f05e6ae-92ea-4d68-88ab-57d8e7d99c46 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:54.657443 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6f05e6ae-92ea-4d68-88ab-57d8e7d99c46 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:54.667153 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6f05e6ae-92ea-4d68-88ab-57d8e7d99c46 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:54.669603 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6f05e6ae-92ea-4d68-88ab-57d8e7d99c46 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:54.671432 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6f05e6ae-92ea-4d68-88ab-57d8e7d99c46 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.168067 Apr 06 16:56:54.672168 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1162/2326] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:54 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:55.074707 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a9f3bb50-db14-4c15-b2e5-fd9ce3e0ed17 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:55.075719 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a9f3bb50-db14-4c15-b2e5-fd9ce3e0ed17 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:55.083698 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9f3bb50-db14-4c15-b2e5-fd9ce3e0ed17 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:55.084151 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9f3bb50-db14-4c15-b2e5-fd9ce3e0ed17 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:55.084929 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9f3bb50-db14-4c15-b2e5-fd9ce3e0ed17 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:55.085355 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9f3bb50-db14-4c15-b2e5-fd9ce3e0ed17 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:55.238517 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a9f3bb50-db14-4c15-b2e5-fd9ce3e0ed17 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:55.246690 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a9f3bb50-db14-4c15-b2e5-fd9ce3e0ed17 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.178449 Apr 06 16:56:55.247283 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1165/2327] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:55 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:55.299234 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eb70154b-ac94-4b88-9b11-415729e87b53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:55.300066 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eb70154b-ac94-4b88-9b11-415729e87b53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:55.306694 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb70154b-ac94-4b88-9b11-415729e87b53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:55.307142 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb70154b-ac94-4b88-9b11-415729e87b53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:55.307931 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb70154b-ac94-4b88-9b11-415729e87b53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:55.308403 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb70154b-ac94-4b88-9b11-415729e87b53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:55.370361 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-eb70154b-ac94-4b88-9b11-415729e87b53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:55.378818 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eb70154b-ac94-4b88-9b11-415729e87b53 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.085157 Apr 06 16:56:55.379376 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1163/2328] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:55 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:55.692084 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6b578c89-2654-45da-9d67-6de8dfbf90d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:55.692699 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6b578c89-2654-45da-9d67-6de8dfbf90d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:55.699229 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b578c89-2654-45da-9d67-6de8dfbf90d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:55.699687 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b578c89-2654-45da-9d67-6de8dfbf90d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:55.700457 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b578c89-2654-45da-9d67-6de8dfbf90d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:55.700935 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b578c89-2654-45da-9d67-6de8dfbf90d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:55.844079 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6b578c89-2654-45da-9d67-6de8dfbf90d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:55.855447 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6b578c89-2654-45da-9d67-6de8dfbf90d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:55.857225 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6b578c89-2654-45da-9d67-6de8dfbf90d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:55.858431 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6b578c89-2654-45da-9d67-6de8dfbf90d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.171170 Apr 06 16:56:55.859009 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1166/2329] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:55 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:56.264163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-442120d2-1218-4484-9b98-320c69a37ef1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:56.264836 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-442120d2-1218-4484-9b98-320c69a37ef1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:56.271941 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-442120d2-1218-4484-9b98-320c69a37ef1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:56.272395 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-442120d2-1218-4484-9b98-320c69a37ef1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:56.273237 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-442120d2-1218-4484-9b98-320c69a37ef1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:56.273675 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-442120d2-1218-4484-9b98-320c69a37ef1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:56.396218 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a664dd01-baca-466b-8d97-e357fa762ad7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:56.397185 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a664dd01-baca-466b-8d97-e357fa762ad7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:56.408060 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a664dd01-baca-466b-8d97-e357fa762ad7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:56.408866 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a664dd01-baca-466b-8d97-e357fa762ad7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:56.410218 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a664dd01-baca-466b-8d97-e357fa762ad7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:56.410935 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a664dd01-baca-466b-8d97-e357fa762ad7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:56.418952 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-442120d2-1218-4484-9b98-320c69a37ef1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:56.430824 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-442120d2-1218-4484-9b98-320c69a37ef1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.170332 Apr 06 16:56:56.431630 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1164/2330] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:56 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:56.495108 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a664dd01-baca-466b-8d97-e357fa762ad7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:56.503902 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a664dd01-baca-466b-8d97-e357fa762ad7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.111864 Apr 06 16:56:56.504450 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1167/2331] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:56 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:56:56.878760 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c53f9c90-453c-4c74-95a7-ba671376782c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:56.879364 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c53f9c90-453c-4c74-95a7-ba671376782c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:56.885927 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c53f9c90-453c-4c74-95a7-ba671376782c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:56.886368 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c53f9c90-453c-4c74-95a7-ba671376782c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:56.887147 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c53f9c90-453c-4c74-95a7-ba671376782c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:56.887580 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c53f9c90-453c-4c74-95a7-ba671376782c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:57.032457 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c53f9c90-453c-4c74-95a7-ba671376782c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:57.041285 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c53f9c90-453c-4c74-95a7-ba671376782c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:57.042783 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c53f9c90-453c-4c74-95a7-ba671376782c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:57.043959 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c53f9c90-453c-4c74-95a7-ba671376782c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.169696 Apr 06 16:56:57.044524 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1165/2332] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:56 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:57.449762 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4a5a5b59-6876-403a-9646-e4625d1b23ce tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:57.450388 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4a5a5b59-6876-403a-9646-e4625d1b23ce tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:57.457672 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a5a5b59-6876-403a-9646-e4625d1b23ce tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:57.458115 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a5a5b59-6876-403a-9646-e4625d1b23ce tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:57.458871 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a5a5b59-6876-403a-9646-e4625d1b23ce tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:57.459294 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4a5a5b59-6876-403a-9646-e4625d1b23ce tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:57.522103 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3816793e-23ff-42e3-8851-c30d16cff792 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:57.522742 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3816793e-23ff-42e3-8851-c30d16cff792 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:57.529640 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3816793e-23ff-42e3-8851-c30d16cff792 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:57.530066 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3816793e-23ff-42e3-8851-c30d16cff792 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:57.530866 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3816793e-23ff-42e3-8851-c30d16cff792 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:57.531253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3816793e-23ff-42e3-8851-c30d16cff792 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:57.596012 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3816793e-23ff-42e3-8851-c30d16cff792 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:57.604488 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3816793e-23ff-42e3-8851-c30d16cff792 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086237 Apr 06 16:56:57.605551 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1166/2333] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:57 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:56:57.609165 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4a5a5b59-6876-403a-9646-e4625d1b23ce tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:57.617868 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4a5a5b59-6876-403a-9646-e4625d1b23ce tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.172591 Apr 06 16:56:57.618461 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1168/2334] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:57 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:58.065528 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-518b0537-6e2d-40bd-a924-fa4b294c1250 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:58.066141 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-518b0537-6e2d-40bd-a924-fa4b294c1250 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:58.072377 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-518b0537-6e2d-40bd-a924-fa4b294c1250 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:58.072874 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-518b0537-6e2d-40bd-a924-fa4b294c1250 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:58.073645 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-518b0537-6e2d-40bd-a924-fa4b294c1250 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:58.074247 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-518b0537-6e2d-40bd-a924-fa4b294c1250 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:58.220546 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-518b0537-6e2d-40bd-a924-fa4b294c1250 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:58.230037 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-518b0537-6e2d-40bd-a924-fa4b294c1250 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:58.231543 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-518b0537-6e2d-40bd-a924-fa4b294c1250 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:58.232735 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-518b0537-6e2d-40bd-a924-fa4b294c1250 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.172361 Apr 06 16:56:58.233319 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1167/2335] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:58 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:58.622578 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f23a6813-65bc-4a63-afb0-c57b53ca5deb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:58.623211 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f23a6813-65bc-4a63-afb0-c57b53ca5deb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:58.629961 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f23a6813-65bc-4a63-afb0-c57b53ca5deb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:58.630410 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f23a6813-65bc-4a63-afb0-c57b53ca5deb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:58.631176 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f23a6813-65bc-4a63-afb0-c57b53ca5deb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:58.631611 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f23a6813-65bc-4a63-afb0-c57b53ca5deb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:58.635055 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-98edf35a-2e9d-4f75-b1fa-a482ec9578d2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:58.635714 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-98edf35a-2e9d-4f75-b1fa-a482ec9578d2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:58.642492 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98edf35a-2e9d-4f75-b1fa-a482ec9578d2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:58.642930 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98edf35a-2e9d-4f75-b1fa-a482ec9578d2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:58.643727 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98edf35a-2e9d-4f75-b1fa-a482ec9578d2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:58.644156 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98edf35a-2e9d-4f75-b1fa-a482ec9578d2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:58.692296 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f23a6813-65bc-4a63-afb0-c57b53ca5deb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:58.701449 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f23a6813-65bc-4a63-afb0-c57b53ca5deb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.083187 Apr 06 16:56:58.702096 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1169/2336] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:58 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:58.780417 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-98edf35a-2e9d-4f75-b1fa-a482ec9578d2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:58.789180 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-98edf35a-2e9d-4f75-b1fa-a482ec9578d2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.157898 Apr 06 16:56:58.789766 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1168/2337] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:58 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:59.251790 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-48b20cae-6671-40be-abab-b190a02751f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:59.252383 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-48b20cae-6671-40be-abab-b190a02751f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:59.258914 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48b20cae-6671-40be-abab-b190a02751f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:59.259356 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48b20cae-6671-40be-abab-b190a02751f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:59.260107 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48b20cae-6671-40be-abab-b190a02751f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:59.260532 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-48b20cae-6671-40be-abab-b190a02751f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:59.398358 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-48b20cae-6671-40be-abab-b190a02751f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:59.407139 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-48b20cae-6671-40be-abab-b190a02751f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:59.408653 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-48b20cae-6671-40be-abab-b190a02751f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:59.409879 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-48b20cae-6671-40be-abab-b190a02751f9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.162204 Apr 06 16:56:59.410485 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1170/2338] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:56:59 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:56:59.719213 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-23ec23f6-8449-4d68-8769-1844b2f181ad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:59.719879 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-23ec23f6-8449-4d68-8769-1844b2f181ad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:59.726641 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23ec23f6-8449-4d68-8769-1844b2f181ad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:59.727090 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23ec23f6-8449-4d68-8769-1844b2f181ad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:59.728227 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23ec23f6-8449-4d68-8769-1844b2f181ad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:59.728627 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23ec23f6-8449-4d68-8769-1844b2f181ad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:59.807817 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4eaaf327-472e-4a11-b2e7-5955b81e3e64 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:56:59.808280 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4eaaf327-472e-4a11-b2e7-5955b81e3e64 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:56:59.808603 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-23ec23f6-8449-4d68-8769-1844b2f181ad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:59.815585 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4eaaf327-472e-4a11-b2e7-5955b81e3e64 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:59.816119 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4eaaf327-472e-4a11-b2e7-5955b81e3e64 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:59.817000 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4eaaf327-472e-4a11-b2e7-5955b81e3e64 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:56:59.817767 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-23ec23f6-8449-4d68-8769-1844b2f181ad tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.102061 Apr 06 16:56:59.817943 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4eaaf327-472e-4a11-b2e7-5955b81e3e64 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:56:59.818063 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1169/2339] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:59 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:56:59.959605 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4eaaf327-472e-4a11-b2e7-5955b81e3e64 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:56:59.968193 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4eaaf327-472e-4a11-b2e7-5955b81e3e64 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.165212 Apr 06 16:56:59.969011 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1171/2340] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:56:59 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:00.428287 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5c265cc1-9411-44b6-ae07-0f68aede680f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:00.428936 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5c265cc1-9411-44b6-ae07-0f68aede680f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:00.435409 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c265cc1-9411-44b6-ae07-0f68aede680f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:00.435862 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c265cc1-9411-44b6-ae07-0f68aede680f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:00.436629 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c265cc1-9411-44b6-ae07-0f68aede680f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:00.437097 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c265cc1-9411-44b6-ae07-0f68aede680f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:00.576404 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5c265cc1-9411-44b6-ae07-0f68aede680f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:00.585831 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5c265cc1-9411-44b6-ae07-0f68aede680f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:00.587231 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5c265cc1-9411-44b6-ae07-0f68aede680f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:00.588389 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5c265cc1-9411-44b6-ae07-0f68aede680f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.164115 Apr 06 16:57:00.588981 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1170/2341] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:00 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:00.834924 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-639bbcff-0e3a-42e1-97e4-1828d9c44149 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:00.835609 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-639bbcff-0e3a-42e1-97e4-1828d9c44149 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:00.842458 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-639bbcff-0e3a-42e1-97e4-1828d9c44149 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:00.842847 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-639bbcff-0e3a-42e1-97e4-1828d9c44149 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:00.843635 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-639bbcff-0e3a-42e1-97e4-1828d9c44149 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:00.844704 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-639bbcff-0e3a-42e1-97e4-1828d9c44149 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:00.904094 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-639bbcff-0e3a-42e1-97e4-1828d9c44149 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:00.912858 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-639bbcff-0e3a-42e1-97e4-1828d9c44149 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.081869 Apr 06 16:57:00.913446 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1172/2342] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:00 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:00.986492 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6c3d4b50-e324-4f0c-ab2e-8ad779e5821f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:00.987112 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6c3d4b50-e324-4f0c-ab2e-8ad779e5821f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:00.993946 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c3d4b50-e324-4f0c-ab2e-8ad779e5821f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:00.994398 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c3d4b50-e324-4f0c-ab2e-8ad779e5821f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:00.995164 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c3d4b50-e324-4f0c-ab2e-8ad779e5821f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:00.995597 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c3d4b50-e324-4f0c-ab2e-8ad779e5821f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:01.144842 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6c3d4b50-e324-4f0c-ab2e-8ad779e5821f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:01.152927 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6c3d4b50-e324-4f0c-ab2e-8ad779e5821f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.170396 Apr 06 16:57:01.153500 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1171/2343] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:00 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:01.608216 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f5b9c55c-d4f0-44c3-b4bb-5e9781385321 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:01.608712 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f5b9c55c-d4f0-44c3-b4bb-5e9781385321 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:01.615784 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5b9c55c-d4f0-44c3-b4bb-5e9781385321 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:01.616237 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5b9c55c-d4f0-44c3-b4bb-5e9781385321 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:01.617029 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5b9c55c-d4f0-44c3-b4bb-5e9781385321 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:01.617456 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5b9c55c-d4f0-44c3-b4bb-5e9781385321 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:01.756399 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f5b9c55c-d4f0-44c3-b4bb-5e9781385321 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:01.765228 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f5b9c55c-d4f0-44c3-b4bb-5e9781385321 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:01.766864 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f5b9c55c-d4f0-44c3-b4bb-5e9781385321 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:01.768028 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f5b9c55c-d4f0-44c3-b4bb-5e9781385321 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.164000 Apr 06 16:57:01.768595 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1173/2344] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:01 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:01.930283 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-96508c49-a0df-46ad-a5f6-546915991eb1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:01.930895 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-96508c49-a0df-46ad-a5f6-546915991eb1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:01.937724 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96508c49-a0df-46ad-a5f6-546915991eb1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:01.938182 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96508c49-a0df-46ad-a5f6-546915991eb1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:01.938947 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96508c49-a0df-46ad-a5f6-546915991eb1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:01.939387 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96508c49-a0df-46ad-a5f6-546915991eb1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:02.004711 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-96508c49-a0df-46ad-a5f6-546915991eb1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:02.013255 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-96508c49-a0df-46ad-a5f6-546915991eb1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086918 Apr 06 16:57:02.013830 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1172/2345] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:01 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:02.170945 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0acd8b3d-da20-460d-9316-e409aae9e4cd tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:02.171577 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0acd8b3d-da20-460d-9316-e409aae9e4cd tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:02.178431 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0acd8b3d-da20-460d-9316-e409aae9e4cd tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:02.178896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0acd8b3d-da20-460d-9316-e409aae9e4cd tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:02.179640 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0acd8b3d-da20-460d-9316-e409aae9e4cd tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:02.180074 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0acd8b3d-da20-460d-9316-e409aae9e4cd tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:02.317651 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0acd8b3d-da20-460d-9316-e409aae9e4cd tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:02.325614 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0acd8b3d-da20-460d-9316-e409aae9e4cd tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.158555 Apr 06 16:57:02.326594 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1174/2346] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:02 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:02.787751 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-04881864-4d99-4821-bbae-d111f8b4f77a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:02.788379 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-04881864-4d99-4821-bbae-d111f8b4f77a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:02.794828 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04881864-4d99-4821-bbae-d111f8b4f77a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:02.795285 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04881864-4d99-4821-bbae-d111f8b4f77a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:02.796079 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04881864-4d99-4821-bbae-d111f8b4f77a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:02.796494 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04881864-4d99-4821-bbae-d111f8b4f77a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:02.940802 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-04881864-4d99-4821-bbae-d111f8b4f77a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:02.949477 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-04881864-4d99-4821-bbae-d111f8b4f77a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:02.950958 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-04881864-4d99-4821-bbae-d111f8b4f77a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:02.952135 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-04881864-4d99-4821-bbae-d111f8b4f77a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.168854 Apr 06 16:57:02.952718 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1173/2347] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:02 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:03.030148 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-42afef11-5510-48a8-98ae-4235cfc4c329 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:03.030776 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-42afef11-5510-48a8-98ae-4235cfc4c329 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:03.037316 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42afef11-5510-48a8-98ae-4235cfc4c329 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:03.037762 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42afef11-5510-48a8-98ae-4235cfc4c329 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:03.038513 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42afef11-5510-48a8-98ae-4235cfc4c329 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:03.038939 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42afef11-5510-48a8-98ae-4235cfc4c329 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:03.102227 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-42afef11-5510-48a8-98ae-4235cfc4c329 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:03.110941 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-42afef11-5510-48a8-98ae-4235cfc4c329 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.084731 Apr 06 16:57:03.111515 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1175/2348] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:03 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:03.344200 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-22e606d4-bf8c-40a9-a59f-ecab708a4bd3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:03.345026 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-22e606d4-bf8c-40a9-a59f-ecab708a4bd3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:03.351822 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22e606d4-bf8c-40a9-a59f-ecab708a4bd3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:03.352273 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22e606d4-bf8c-40a9-a59f-ecab708a4bd3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:03.353437 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22e606d4-bf8c-40a9-a59f-ecab708a4bd3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:03.353883 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22e606d4-bf8c-40a9-a59f-ecab708a4bd3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:03.490344 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-22e606d4-bf8c-40a9-a59f-ecab708a4bd3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:03.498882 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-22e606d4-bf8c-40a9-a59f-ecab708a4bd3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.158955 Apr 06 16:57:03.499458 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1174/2349] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:03 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:03.971282 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-134ba7a5-e075-462a-82fc-a88a00dec704 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:03.971912 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-134ba7a5-e075-462a-82fc-a88a00dec704 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:03.979065 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-134ba7a5-e075-462a-82fc-a88a00dec704 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:03.979514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-134ba7a5-e075-462a-82fc-a88a00dec704 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:03.980286 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-134ba7a5-e075-462a-82fc-a88a00dec704 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:03.980727 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-134ba7a5-e075-462a-82fc-a88a00dec704 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:04.034910 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 16:57:04.035201 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 16:57:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c (ip 10.222.0.64) !!! Apr 06 16:57:04.118886 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-134ba7a5-e075-462a-82fc-a88a00dec704 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:04.127877 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-063e8c2c-b467-4528-a664-8b40220dfe07 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:04.128116 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-134ba7a5-e075-462a-82fc-a88a00dec704 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:04.128787 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-063e8c2c-b467-4528-a664-8b40220dfe07 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:04.129514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-134ba7a5-e075-462a-82fc-a88a00dec704 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:04.130685 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-134ba7a5-e075-462a-82fc-a88a00dec704 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.163508 Apr 06 16:57:04.131242 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1176/2350] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:03 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:04.135058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-063e8c2c-b467-4528-a664-8b40220dfe07 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:04.135577 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-063e8c2c-b467-4528-a664-8b40220dfe07 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:04.136387 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-063e8c2c-b467-4528-a664-8b40220dfe07 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:04.136955 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-063e8c2c-b467-4528-a664-8b40220dfe07 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:04.199128 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-063e8c2c-b467-4528-a664-8b40220dfe07 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:04.207601 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-063e8c2c-b467-4528-a664-8b40220dfe07 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.084049 Apr 06 16:57:04.208198 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1175/2351] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:04 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:57:04.516884 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-302041fe-b5bf-4623-8372-d7ebbd4a0400 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:04.517496 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-302041fe-b5bf-4623-8372-d7ebbd4a0400 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:04.524026 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-302041fe-b5bf-4623-8372-d7ebbd4a0400 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:04.524477 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-302041fe-b5bf-4623-8372-d7ebbd4a0400 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:04.525284 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-302041fe-b5bf-4623-8372-d7ebbd4a0400 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:04.525717 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-302041fe-b5bf-4623-8372-d7ebbd4a0400 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:04.657412 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-302041fe-b5bf-4623-8372-d7ebbd4a0400 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:04.665208 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-302041fe-b5bf-4623-8372-d7ebbd4a0400 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.152526 Apr 06 16:57:04.665792 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1177/2352] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:04 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:05.152382 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-573ff352-0605-4997-ad8b-aec5bc0e4710 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:05.153277 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-573ff352-0605-4997-ad8b-aec5bc0e4710 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:05.160933 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-573ff352-0605-4997-ad8b-aec5bc0e4710 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:05.161376 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-573ff352-0605-4997-ad8b-aec5bc0e4710 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:05.162186 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-573ff352-0605-4997-ad8b-aec5bc0e4710 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:05.162620 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-573ff352-0605-4997-ad8b-aec5bc0e4710 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:05.225527 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-03a63e6a-c3c5-4a43-a40c-242787ad6d95 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:05.226123 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-03a63e6a-c3c5-4a43-a40c-242787ad6d95 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:05.236933 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03a63e6a-c3c5-4a43-a40c-242787ad6d95 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:05.237789 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03a63e6a-c3c5-4a43-a40c-242787ad6d95 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:05.238723 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03a63e6a-c3c5-4a43-a40c-242787ad6d95 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:05.239166 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03a63e6a-c3c5-4a43-a40c-242787ad6d95 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:05.305567 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-03a63e6a-c3c5-4a43-a40c-242787ad6d95 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:05.314288 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-03a63e6a-c3c5-4a43-a40c-242787ad6d95 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.092533 Apr 06 16:57:05.315175 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1178/2353] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:05 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:05.323020 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-573ff352-0605-4997-ad8b-aec5bc0e4710 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:05.332008 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-573ff352-0605-4997-ad8b-aec5bc0e4710 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:05.333520 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-573ff352-0605-4997-ad8b-aec5bc0e4710 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:05.334681 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-573ff352-0605-4997-ad8b-aec5bc0e4710 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.188397 Apr 06 16:57:05.335238 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1176/2354] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:05 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:05.682710 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-855b441c-f5c0-4ae7-8d24-20cf4fff08a2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:05.683319 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-855b441c-f5c0-4ae7-8d24-20cf4fff08a2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:05.689952 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-855b441c-f5c0-4ae7-8d24-20cf4fff08a2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:05.690401 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-855b441c-f5c0-4ae7-8d24-20cf4fff08a2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:05.691168 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-855b441c-f5c0-4ae7-8d24-20cf4fff08a2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:05.691605 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-855b441c-f5c0-4ae7-8d24-20cf4fff08a2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:05.824517 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-855b441c-f5c0-4ae7-8d24-20cf4fff08a2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:05.833281 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-855b441c-f5c0-4ae7-8d24-20cf4fff08a2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.154505 Apr 06 16:57:05.833861 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1179/2355] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:05 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:06.331736 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2aabeb41-7aa4-486a-b5a0-c967a111dc6e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:06.332352 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2aabeb41-7aa4-486a-b5a0-c967a111dc6e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:06.339410 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2aabeb41-7aa4-486a-b5a0-c967a111dc6e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:06.339861 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2aabeb41-7aa4-486a-b5a0-c967a111dc6e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:06.340628 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2aabeb41-7aa4-486a-b5a0-c967a111dc6e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:06.341092 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2aabeb41-7aa4-486a-b5a0-c967a111dc6e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:06.353534 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4f05cf9a-e0c8-4245-b270-27403c28ee2f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:06.354136 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4f05cf9a-e0c8-4245-b270-27403c28ee2f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:06.361164 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f05cf9a-e0c8-4245-b270-27403c28ee2f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:06.361604 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f05cf9a-e0c8-4245-b270-27403c28ee2f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:06.362380 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f05cf9a-e0c8-4245-b270-27403c28ee2f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:06.362801 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f05cf9a-e0c8-4245-b270-27403c28ee2f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:06.413522 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2aabeb41-7aa4-486a-b5a0-c967a111dc6e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:06.423510 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2aabeb41-7aa4-486a-b5a0-c967a111dc6e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.095645 Apr 06 16:57:06.424365 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1177/2356] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:06 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:06.497889 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4f05cf9a-e0c8-4245-b270-27403c28ee2f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:06.506827 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4f05cf9a-e0c8-4245-b270-27403c28ee2f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:06.508350 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4f05cf9a-e0c8-4245-b270-27403c28ee2f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:06.509534 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4f05cf9a-e0c8-4245-b270-27403c28ee2f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.160273 Apr 06 16:57:06.510069 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1180/2357] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:06 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:06.851612 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-16c65dde-0634-4acd-a1cc-1955891453e8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:06.851932 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-16c65dde-0634-4acd-a1cc-1955891453e8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:06.858840 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16c65dde-0634-4acd-a1cc-1955891453e8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:06.859289 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16c65dde-0634-4acd-a1cc-1955891453e8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:06.860228 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16c65dde-0634-4acd-a1cc-1955891453e8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:06.860663 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16c65dde-0634-4acd-a1cc-1955891453e8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:07.011980 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-16c65dde-0634-4acd-a1cc-1955891453e8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:07.020456 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-16c65dde-0634-4acd-a1cc-1955891453e8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.173358 Apr 06 16:57:07.021344 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1178/2358] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:06 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:07.440778 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5f355ac9-7396-488e-a635-27c0473d4a74 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:07.441372 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5f355ac9-7396-488e-a635-27c0473d4a74 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:07.448903 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f355ac9-7396-488e-a635-27c0473d4a74 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:07.449361 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f355ac9-7396-488e-a635-27c0473d4a74 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:07.450102 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f355ac9-7396-488e-a635-27c0473d4a74 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:07.450529 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f355ac9-7396-488e-a635-27c0473d4a74 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:07.517203 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5f355ac9-7396-488e-a635-27c0473d4a74 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:07.526789 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5f355ac9-7396-488e-a635-27c0473d4a74 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.090915 Apr 06 16:57:07.527412 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1181/2359] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:07 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:07.528295 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5c8235ee-e44a-4725-b5a6-7118275e01c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:07.528936 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5c8235ee-e44a-4725-b5a6-7118275e01c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:07.535698 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c8235ee-e44a-4725-b5a6-7118275e01c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:07.536140 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c8235ee-e44a-4725-b5a6-7118275e01c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:07.536936 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c8235ee-e44a-4725-b5a6-7118275e01c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:07.537371 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c8235ee-e44a-4725-b5a6-7118275e01c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:07.675898 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5c8235ee-e44a-4725-b5a6-7118275e01c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:07.684734 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5c8235ee-e44a-4725-b5a6-7118275e01c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:07.686207 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5c8235ee-e44a-4725-b5a6-7118275e01c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:07.687363 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5c8235ee-e44a-4725-b5a6-7118275e01c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.163031 Apr 06 16:57:07.687923 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1179/2360] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:07 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:08.042613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-89dab808-88b5-43b3-97a0-447422dc3d40 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:08.043144 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-89dab808-88b5-43b3-97a0-447422dc3d40 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:08.049804 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89dab808-88b5-43b3-97a0-447422dc3d40 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:08.050249 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89dab808-88b5-43b3-97a0-447422dc3d40 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:08.051003 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89dab808-88b5-43b3-97a0-447422dc3d40 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:08.051428 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-89dab808-88b5-43b3-97a0-447422dc3d40 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:08.186898 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-89dab808-88b5-43b3-97a0-447422dc3d40 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:08.195523 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-89dab808-88b5-43b3-97a0-447422dc3d40 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.156887 Apr 06 16:57:08.196099 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1182/2361] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:08 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:08.544650 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c5e45dd6-b3bf-4864-8ab1-08dc1716d99f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:08.545310 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c5e45dd6-b3bf-4864-8ab1-08dc1716d99f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:08.552184 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5e45dd6-b3bf-4864-8ab1-08dc1716d99f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:08.552629 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5e45dd6-b3bf-4864-8ab1-08dc1716d99f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:08.553436 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5e45dd6-b3bf-4864-8ab1-08dc1716d99f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:08.553877 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5e45dd6-b3bf-4864-8ab1-08dc1716d99f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:08.615905 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c5e45dd6-b3bf-4864-8ab1-08dc1716d99f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:08.624465 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c5e45dd6-b3bf-4864-8ab1-08dc1716d99f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.083727 Apr 06 16:57:08.625100 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1180/2362] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:08 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:08.706865 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ed3bd255-19e2-41d9-a5d3-5255abe48dcb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:08.707477 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ed3bd255-19e2-41d9-a5d3-5255abe48dcb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:08.714196 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed3bd255-19e2-41d9-a5d3-5255abe48dcb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:08.714642 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed3bd255-19e2-41d9-a5d3-5255abe48dcb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:08.715396 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed3bd255-19e2-41d9-a5d3-5255abe48dcb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:08.715826 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ed3bd255-19e2-41d9-a5d3-5255abe48dcb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:08.857144 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ed3bd255-19e2-41d9-a5d3-5255abe48dcb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:08.867280 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ed3bd255-19e2-41d9-a5d3-5255abe48dcb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:08.868826 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ed3bd255-19e2-41d9-a5d3-5255abe48dcb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:08.870021 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ed3bd255-19e2-41d9-a5d3-5255abe48dcb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.167601 Apr 06 16:57:08.870617 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1183/2363] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:08 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:09.212430 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3f8e6072-d0ab-4132-b94b-d7107baf30ea tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:09.212962 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3f8e6072-d0ab-4132-b94b-d7107baf30ea tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:09.219495 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f8e6072-d0ab-4132-b94b-d7107baf30ea tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:09.219939 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f8e6072-d0ab-4132-b94b-d7107baf30ea tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:09.220704 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f8e6072-d0ab-4132-b94b-d7107baf30ea tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:09.221142 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f8e6072-d0ab-4132-b94b-d7107baf30ea tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:09.361345 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3f8e6072-d0ab-4132-b94b-d7107baf30ea tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:09.369693 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3f8e6072-d0ab-4132-b94b-d7107baf30ea tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.161272 Apr 06 16:57:09.370264 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1181/2364] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:09 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:09.642710 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fb2a7b5f-f439-4aad-ac2b-52745754f7ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:09.643344 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fb2a7b5f-f439-4aad-ac2b-52745754f7ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:09.649819 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb2a7b5f-f439-4aad-ac2b-52745754f7ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:09.650265 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb2a7b5f-f439-4aad-ac2b-52745754f7ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:09.651023 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb2a7b5f-f439-4aad-ac2b-52745754f7ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:09.651455 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fb2a7b5f-f439-4aad-ac2b-52745754f7ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:09.714287 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fb2a7b5f-f439-4aad-ac2b-52745754f7ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:09.722712 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fb2a7b5f-f439-4aad-ac2b-52745754f7ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.084137 Apr 06 16:57:09.723301 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1184/2365] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:09 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:09.889146 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f679e627-25a6-4d09-98a5-f37f302908be tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:09.889758 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f679e627-25a6-4d09-98a5-f37f302908be tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:09.896942 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f679e627-25a6-4d09-98a5-f37f302908be tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:09.897329 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f679e627-25a6-4d09-98a5-f37f302908be tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:09.898101 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f679e627-25a6-4d09-98a5-f37f302908be tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:09.898538 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f679e627-25a6-4d09-98a5-f37f302908be tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:10.035017 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f679e627-25a6-4d09-98a5-f37f302908be tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:10.043562 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f679e627-25a6-4d09-98a5-f37f302908be tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:10.045208 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f679e627-25a6-4d09-98a5-f37f302908be tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:10.046388 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f679e627-25a6-4d09-98a5-f37f302908be tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.161153 Apr 06 16:57:10.047351 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1182/2366] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:09 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:10.387383 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3cf2cfdd-14f6-4d45-8029-2eee76f99e35 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:10.387980 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3cf2cfdd-14f6-4d45-8029-2eee76f99e35 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:10.394489 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3cf2cfdd-14f6-4d45-8029-2eee76f99e35 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:10.394972 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3cf2cfdd-14f6-4d45-8029-2eee76f99e35 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:10.395740 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3cf2cfdd-14f6-4d45-8029-2eee76f99e35 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:10.396182 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3cf2cfdd-14f6-4d45-8029-2eee76f99e35 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:10.531190 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3cf2cfdd-14f6-4d45-8029-2eee76f99e35 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:10.539713 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3cf2cfdd-14f6-4d45-8029-2eee76f99e35 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.156296 Apr 06 16:57:10.540295 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1185/2367] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:10 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:10.739752 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b9b3c14b-7196-44ce-8796-313ff9462809 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:10.740340 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b9b3c14b-7196-44ce-8796-313ff9462809 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:10.746879 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9b3c14b-7196-44ce-8796-313ff9462809 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:10.747342 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9b3c14b-7196-44ce-8796-313ff9462809 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:10.748106 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9b3c14b-7196-44ce-8796-313ff9462809 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:10.748543 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9b3c14b-7196-44ce-8796-313ff9462809 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:10.807957 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b9b3c14b-7196-44ce-8796-313ff9462809 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:10.816422 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b9b3c14b-7196-44ce-8796-313ff9462809 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.080599 Apr 06 16:57:10.817043 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1183/2368] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:10 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:11.066233 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-82bda29b-fc2a-4094-9eb3-2737a4318871 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:11.066819 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-82bda29b-fc2a-4094-9eb3-2737a4318871 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:11.073283 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82bda29b-fc2a-4094-9eb3-2737a4318871 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:11.073736 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82bda29b-fc2a-4094-9eb3-2737a4318871 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:11.074506 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82bda29b-fc2a-4094-9eb3-2737a4318871 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:11.074941 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-82bda29b-fc2a-4094-9eb3-2737a4318871 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:11.216756 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-82bda29b-fc2a-4094-9eb3-2737a4318871 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:11.225516 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-82bda29b-fc2a-4094-9eb3-2737a4318871 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:11.227011 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-82bda29b-fc2a-4094-9eb3-2737a4318871 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:11.228554 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-82bda29b-fc2a-4094-9eb3-2737a4318871 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.166698 Apr 06 16:57:11.229155 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1186/2369] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:11 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:11.540670 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 16:57:11.541365 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 16:57:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 16:57:11.557049 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a1157eb0-b517-44a0-8cd1-d3ac6176d7e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:11.557688 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a1157eb0-b517-44a0-8cd1-d3ac6176d7e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:11.564442 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1157eb0-b517-44a0-8cd1-d3ac6176d7e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:11.564925 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1157eb0-b517-44a0-8cd1-d3ac6176d7e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:11.565705 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1157eb0-b517-44a0-8cd1-d3ac6176d7e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:11.566149 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1157eb0-b517-44a0-8cd1-d3ac6176d7e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:11.706995 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a1157eb0-b517-44a0-8cd1-d3ac6176d7e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:11.715191 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a1157eb0-b517-44a0-8cd1-d3ac6176d7e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.161919 Apr 06 16:57:11.715769 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1184/2370] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:11 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:11.834122 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c282be7c-f0c3-425e-b645-7c5f158f0d15 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:11.834753 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c282be7c-f0c3-425e-b645-7c5f158f0d15 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:11.841362 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c282be7c-f0c3-425e-b645-7c5f158f0d15 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:11.841812 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c282be7c-f0c3-425e-b645-7c5f158f0d15 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:11.842571 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c282be7c-f0c3-425e-b645-7c5f158f0d15 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:11.843001 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c282be7c-f0c3-425e-b645-7c5f158f0d15 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:11.906245 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c282be7c-f0c3-425e-b645-7c5f158f0d15 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:11.914374 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c282be7c-f0c3-425e-b645-7c5f158f0d15 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.084260 Apr 06 16:57:11.914948 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1187/2371] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:11 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:12.246697 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-90144769-51eb-4536-926c-812e1cef0101 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:12.247205 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-90144769-51eb-4536-926c-812e1cef0101 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:12.253978 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90144769-51eb-4536-926c-812e1cef0101 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:12.254431 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90144769-51eb-4536-926c-812e1cef0101 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:12.255243 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90144769-51eb-4536-926c-812e1cef0101 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:12.255676 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90144769-51eb-4536-926c-812e1cef0101 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:12.391926 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-90144769-51eb-4536-926c-812e1cef0101 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:12.400349 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-90144769-51eb-4536-926c-812e1cef0101 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:12.401886 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-90144769-51eb-4536-926c-812e1cef0101 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:12.403135 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-90144769-51eb-4536-926c-812e1cef0101 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.160545 Apr 06 16:57:12.403721 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1185/2372] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:12 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:12.733561 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-20afe4e0-83a4-4d6a-8159-72abb366f61f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:12.734160 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-20afe4e0-83a4-4d6a-8159-72abb366f61f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:12.741380 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20afe4e0-83a4-4d6a-8159-72abb366f61f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:12.741835 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20afe4e0-83a4-4d6a-8159-72abb366f61f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:12.742597 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20afe4e0-83a4-4d6a-8159-72abb366f61f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:12.743030 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20afe4e0-83a4-4d6a-8159-72abb366f61f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:12.878868 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-20afe4e0-83a4-4d6a-8159-72abb366f61f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:12.886851 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-20afe4e0-83a4-4d6a-8159-72abb366f61f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.157384 Apr 06 16:57:12.887425 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1188/2373] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:12 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:12.931756 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-141b9993-b367-4865-ac1a-a78c9329b839 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:12.932399 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-141b9993-b367-4865-ac1a-a78c9329b839 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:12.935027 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 16:57:12.935197 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 16:57:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 16:57:12.939391 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-141b9993-b367-4865-ac1a-a78c9329b839 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:12.939849 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-141b9993-b367-4865-ac1a-a78c9329b839 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:12.940627 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-141b9993-b367-4865-ac1a-a78c9329b839 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:12.941118 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-141b9993-b367-4865-ac1a-a78c9329b839 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:13.000779 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-141b9993-b367-4865-ac1a-a78c9329b839 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:13.009084 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-141b9993-b367-4865-ac1a-a78c9329b839 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.081288 Apr 06 16:57:13.009654 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1186/2374] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:12 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:13.423072 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-014cc57c-2f17-40ab-b6d3-c8a2e0f1f426 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:13.423677 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-014cc57c-2f17-40ab-b6d3-c8a2e0f1f426 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:13.430307 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-014cc57c-2f17-40ab-b6d3-c8a2e0f1f426 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:13.430777 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-014cc57c-2f17-40ab-b6d3-c8a2e0f1f426 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:13.431548 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-014cc57c-2f17-40ab-b6d3-c8a2e0f1f426 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:13.431967 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-014cc57c-2f17-40ab-b6d3-c8a2e0f1f426 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:13.570646 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-014cc57c-2f17-40ab-b6d3-c8a2e0f1f426 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:13.582744 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-014cc57c-2f17-40ab-b6d3-c8a2e0f1f426 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:13.584159 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-014cc57c-2f17-40ab-b6d3-c8a2e0f1f426 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:13.585343 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-014cc57c-2f17-40ab-b6d3-c8a2e0f1f426 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.166525 Apr 06 16:57:13.585941 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1189/2375] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:13 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:13.905019 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f1058fcc-a6fd-4f9b-ac72-542b1a2ae726 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:13.905674 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f1058fcc-a6fd-4f9b-ac72-542b1a2ae726 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:13.912475 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1058fcc-a6fd-4f9b-ac72-542b1a2ae726 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:13.913097 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1058fcc-a6fd-4f9b-ac72-542b1a2ae726 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:13.913872 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1058fcc-a6fd-4f9b-ac72-542b1a2ae726 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:13.914324 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1058fcc-a6fd-4f9b-ac72-542b1a2ae726 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:14.028648 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3322074a-1e95-46d7-b2ae-aef8740a0436 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:14.029311 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3322074a-1e95-46d7-b2ae-aef8740a0436 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:14.036592 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3322074a-1e95-46d7-b2ae-aef8740a0436 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:14.037076 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3322074a-1e95-46d7-b2ae-aef8740a0436 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:14.037850 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3322074a-1e95-46d7-b2ae-aef8740a0436 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:14.038282 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3322074a-1e95-46d7-b2ae-aef8740a0436 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:14.061368 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f1058fcc-a6fd-4f9b-ac72-542b1a2ae726 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:14.075112 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f1058fcc-a6fd-4f9b-ac72-542b1a2ae726 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.173875 Apr 06 16:57:14.075910 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1187/2376] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:13 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:14.107651 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3322074a-1e95-46d7-b2ae-aef8740a0436 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:14.116335 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3322074a-1e95-46d7-b2ae-aef8740a0436 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.092279 Apr 06 16:57:14.116951 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1190/2377] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:14 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:14.605608 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ed965a12-1324-45a3-bea2-045a97e561fd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:14.606110 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ed965a12-1324-45a3-bea2-045a97e561fd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:14.612721 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed965a12-1324-45a3-bea2-045a97e561fd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:14.613174 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed965a12-1324-45a3-bea2-045a97e561fd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:14.613929 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed965a12-1324-45a3-bea2-045a97e561fd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:14.614354 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed965a12-1324-45a3-bea2-045a97e561fd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:14.751214 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ed965a12-1324-45a3-bea2-045a97e561fd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:14.759848 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ed965a12-1324-45a3-bea2-045a97e561fd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:14.761393 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ed965a12-1324-45a3-bea2-045a97e561fd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:14.762547 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ed965a12-1324-45a3-bea2-045a97e561fd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.161433 Apr 06 16:57:14.763103 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1188/2378] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:14 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:15.093040 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bd8e9a50-2e09-4925-93d2-b7d79ea3f3e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:15.093673 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bd8e9a50-2e09-4925-93d2-b7d79ea3f3e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:15.100319 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd8e9a50-2e09-4925-93d2-b7d79ea3f3e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:15.100788 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd8e9a50-2e09-4925-93d2-b7d79ea3f3e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:15.101538 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd8e9a50-2e09-4925-93d2-b7d79ea3f3e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:15.101963 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd8e9a50-2e09-4925-93d2-b7d79ea3f3e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:15.132856 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3c536e14-1e5e-4b64-9b0c-897f171eae01 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:15.133474 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3c536e14-1e5e-4b64-9b0c-897f171eae01 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:15.140137 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c536e14-1e5e-4b64-9b0c-897f171eae01 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:15.140586 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c536e14-1e5e-4b64-9b0c-897f171eae01 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:15.141872 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c536e14-1e5e-4b64-9b0c-897f171eae01 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:15.143004 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c536e14-1e5e-4b64-9b0c-897f171eae01 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:15.204156 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3c536e14-1e5e-4b64-9b0c-897f171eae01 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:15.212320 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3c536e14-1e5e-4b64-9b0c-897f171eae01 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.083399 Apr 06 16:57:15.212924 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1189/2379] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:15 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:15.240624 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-bd8e9a50-2e09-4925-93d2-b7d79ea3f3e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:15.248727 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bd8e9a50-2e09-4925-93d2-b7d79ea3f3e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.159680 Apr 06 16:57:15.249304 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1191/2380] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:15 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:15.781664 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-210fbece-2809-4753-9517-c50cae7c925e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:15.782401 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-210fbece-2809-4753-9517-c50cae7c925e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:15.788913 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-210fbece-2809-4753-9517-c50cae7c925e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:15.789353 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-210fbece-2809-4753-9517-c50cae7c925e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:15.790130 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-210fbece-2809-4753-9517-c50cae7c925e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:15.790554 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-210fbece-2809-4753-9517-c50cae7c925e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:15.932038 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-210fbece-2809-4753-9517-c50cae7c925e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:15.940761 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-210fbece-2809-4753-9517-c50cae7c925e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:15.942259 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-210fbece-2809-4753-9517-c50cae7c925e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:15.943507 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-210fbece-2809-4753-9517-c50cae7c925e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.166142 Apr 06 16:57:15.944016 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1190/2381] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:15 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:16.230641 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1bda27cb-1386-4b14-b743-75a9ec2ee81f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:16.231409 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1bda27cb-1386-4b14-b743-75a9ec2ee81f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:16.238446 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bda27cb-1386-4b14-b743-75a9ec2ee81f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:16.238889 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bda27cb-1386-4b14-b743-75a9ec2ee81f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:16.239644 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bda27cb-1386-4b14-b743-75a9ec2ee81f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:16.240074 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1bda27cb-1386-4b14-b743-75a9ec2ee81f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:16.266331 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-56dd2418-65a1-418d-9319-ed8b451e05dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:16.267141 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-56dd2418-65a1-418d-9319-ed8b451e05dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:16.273732 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56dd2418-65a1-418d-9319-ed8b451e05dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:16.274183 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56dd2418-65a1-418d-9319-ed8b451e05dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:16.274974 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56dd2418-65a1-418d-9319-ed8b451e05dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:16.275416 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56dd2418-65a1-418d-9319-ed8b451e05dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:16.301852 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1bda27cb-1386-4b14-b743-75a9ec2ee81f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:16.310540 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1bda27cb-1386-4b14-b743-75a9ec2ee81f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.084131 Apr 06 16:57:16.311131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1192/2382] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:16 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:16.416640 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-56dd2418-65a1-418d-9319-ed8b451e05dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:16.425251 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-56dd2418-65a1-418d-9319-ed8b451e05dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.162858 Apr 06 16:57:16.425831 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1191/2383] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:16 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:16.962308 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1b1c9ca5-cde5-4eaf-a07f-62d1b1cc78eb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:16.962902 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1b1c9ca5-cde5-4eaf-a07f-62d1b1cc78eb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:16.969270 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b1c9ca5-cde5-4eaf-a07f-62d1b1cc78eb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:16.969677 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b1c9ca5-cde5-4eaf-a07f-62d1b1cc78eb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:16.970627 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b1c9ca5-cde5-4eaf-a07f-62d1b1cc78eb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:16.971050 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b1c9ca5-cde5-4eaf-a07f-62d1b1cc78eb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:17.114256 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1b1c9ca5-cde5-4eaf-a07f-62d1b1cc78eb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:17.123199 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1b1c9ca5-cde5-4eaf-a07f-62d1b1cc78eb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:17.124669 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1b1c9ca5-cde5-4eaf-a07f-62d1b1cc78eb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:17.126209 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1b1c9ca5-cde5-4eaf-a07f-62d1b1cc78eb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.168048 Apr 06 16:57:17.127530 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1193/2384] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:16 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:17.328709 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-546537b2-0532-478f-828d-99b377c71047 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:17.329500 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-546537b2-0532-478f-828d-99b377c71047 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:17.336056 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-546537b2-0532-478f-828d-99b377c71047 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:17.336510 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-546537b2-0532-478f-828d-99b377c71047 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:17.337311 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-546537b2-0532-478f-828d-99b377c71047 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:17.337748 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-546537b2-0532-478f-828d-99b377c71047 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:17.401893 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-546537b2-0532-478f-828d-99b377c71047 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:17.410368 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-546537b2-0532-478f-828d-99b377c71047 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.085831 Apr 06 16:57:17.410932 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1192/2385] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:17 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:57:17.442500 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0c967e11-02ef-4661-8bc3-77193ceb5b4d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:17.443066 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0c967e11-02ef-4661-8bc3-77193ceb5b4d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:17.449845 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c967e11-02ef-4661-8bc3-77193ceb5b4d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:17.450292 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c967e11-02ef-4661-8bc3-77193ceb5b4d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:17.451043 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c967e11-02ef-4661-8bc3-77193ceb5b4d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:17.451468 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c967e11-02ef-4661-8bc3-77193ceb5b4d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:17.589218 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0c967e11-02ef-4661-8bc3-77193ceb5b4d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:17.597893 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0c967e11-02ef-4661-8bc3-77193ceb5b4d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.159246 Apr 06 16:57:17.598456 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1194/2386] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:17 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:18.146122 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d2c7cce1-fa9c-4752-81f4-b4c05cd758b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:18.146731 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d2c7cce1-fa9c-4752-81f4-b4c05cd758b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:18.153055 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2c7cce1-fa9c-4752-81f4-b4c05cd758b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:18.153513 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2c7cce1-fa9c-4752-81f4-b4c05cd758b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:18.154322 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2c7cce1-fa9c-4752-81f4-b4c05cd758b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:18.154760 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2c7cce1-fa9c-4752-81f4-b4c05cd758b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:18.289460 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d2c7cce1-fa9c-4752-81f4-b4c05cd758b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:18.298735 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d2c7cce1-fa9c-4752-81f4-b4c05cd758b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:18.300232 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d2c7cce1-fa9c-4752-81f4-b4c05cd758b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:18.301453 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d2c7cce1-fa9c-4752-81f4-b4c05cd758b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.159355 Apr 06 16:57:18.302169 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1193/2387] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:18 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:18.428127 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c1670ff8-791c-445e-bbd7-019c637dcf2b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:18.428642 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c1670ff8-791c-445e-bbd7-019c637dcf2b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:18.435244 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1670ff8-791c-445e-bbd7-019c637dcf2b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:18.435697 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1670ff8-791c-445e-bbd7-019c637dcf2b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:18.436470 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1670ff8-791c-445e-bbd7-019c637dcf2b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:18.436944 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c1670ff8-791c-445e-bbd7-019c637dcf2b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:18.510932 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c1670ff8-791c-445e-bbd7-019c637dcf2b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:18.518960 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c1670ff8-791c-445e-bbd7-019c637dcf2b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.094876 Apr 06 16:57:18.519523 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1195/2388] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:18 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:18.615776 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7895416f-297f-4125-9148-6c933eafe898 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:18.616356 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7895416f-297f-4125-9148-6c933eafe898 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:18.622997 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7895416f-297f-4125-9148-6c933eafe898 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:18.623439 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7895416f-297f-4125-9148-6c933eafe898 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:18.624194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7895416f-297f-4125-9148-6c933eafe898 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:18.624620 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7895416f-297f-4125-9148-6c933eafe898 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:18.760381 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7895416f-297f-4125-9148-6c933eafe898 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:18.768869 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7895416f-297f-4125-9148-6c933eafe898 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.156984 Apr 06 16:57:18.769469 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1194/2389] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:18 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:19.319939 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-10fb8388-7f18-4efe-9b32-e8691941fba5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:19.320576 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-10fb8388-7f18-4efe-9b32-e8691941fba5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:19.327171 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10fb8388-7f18-4efe-9b32-e8691941fba5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:19.327618 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10fb8388-7f18-4efe-9b32-e8691941fba5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:19.328366 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10fb8388-7f18-4efe-9b32-e8691941fba5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:19.328833 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10fb8388-7f18-4efe-9b32-e8691941fba5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:19.467430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-10fb8388-7f18-4efe-9b32-e8691941fba5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:19.481611 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-10fb8388-7f18-4efe-9b32-e8691941fba5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:19.483887 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-10fb8388-7f18-4efe-9b32-e8691941fba5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:19.485879 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-10fb8388-7f18-4efe-9b32-e8691941fba5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.169757 Apr 06 16:57:19.486797 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1196/2390] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:19 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:19.535909 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2ec7a17d-e0b3-4c0b-9a8f-a5d28b4c28c3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:19.536553 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2ec7a17d-e0b3-4c0b-9a8f-a5d28b4c28c3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:19.543144 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ec7a17d-e0b3-4c0b-9a8f-a5d28b4c28c3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:19.543581 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ec7a17d-e0b3-4c0b-9a8f-a5d28b4c28c3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:19.544367 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ec7a17d-e0b3-4c0b-9a8f-a5d28b4c28c3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:19.544799 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ec7a17d-e0b3-4c0b-9a8f-a5d28b4c28c3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:19.609429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2ec7a17d-e0b3-4c0b-9a8f-a5d28b4c28c3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:19.617832 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2ec7a17d-e0b3-4c0b-9a8f-a5d28b4c28c3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086098 Apr 06 16:57:19.618482 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1195/2391] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:19 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:19.786728 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c9e90ebd-f5fb-4717-8fee-015ec30ea826 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:19.787386 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c9e90ebd-f5fb-4717-8fee-015ec30ea826 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:19.793910 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9e90ebd-f5fb-4717-8fee-015ec30ea826 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:19.794353 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9e90ebd-f5fb-4717-8fee-015ec30ea826 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:19.795107 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9e90ebd-f5fb-4717-8fee-015ec30ea826 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:19.795540 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9e90ebd-f5fb-4717-8fee-015ec30ea826 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:19.933364 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c9e90ebd-f5fb-4717-8fee-015ec30ea826 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:19.941990 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c9e90ebd-f5fb-4717-8fee-015ec30ea826 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.159307 Apr 06 16:57:19.942527 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1197/2392] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:19 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:20.509833 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bc114671-7561-4271-92f7-0d004b52e103 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:20.510442 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bc114671-7561-4271-92f7-0d004b52e103 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:20.518631 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc114671-7561-4271-92f7-0d004b52e103 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:20.519157 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc114671-7561-4271-92f7-0d004b52e103 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:20.520065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc114671-7561-4271-92f7-0d004b52e103 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:20.520550 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc114671-7561-4271-92f7-0d004b52e103 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:20.635514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b7a534f1-2369-49ce-b9e8-c76fe486deec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:20.636175 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b7a534f1-2369-49ce-b9e8-c76fe486deec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:20.642813 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7a534f1-2369-49ce-b9e8-c76fe486deec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:20.643257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7a534f1-2369-49ce-b9e8-c76fe486deec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:20.644022 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7a534f1-2369-49ce-b9e8-c76fe486deec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:20.644441 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7a534f1-2369-49ce-b9e8-c76fe486deec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:20.658379 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-bc114671-7561-4271-92f7-0d004b52e103 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:20.666869 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-bc114671-7561-4271-92f7-0d004b52e103 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:20.668366 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-bc114671-7561-4271-92f7-0d004b52e103 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:20.671292 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bc114671-7561-4271-92f7-0d004b52e103 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.163823 Apr 06 16:57:20.671292 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1196/2393] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:20 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:20.705230 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b7a534f1-2369-49ce-b9e8-c76fe486deec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:20.713171 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b7a534f1-2369-49ce-b9e8-c76fe486deec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.081651 Apr 06 16:57:20.713717 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1198/2394] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:20 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:20.959998 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ffa99c04-f6c0-47eb-adbb-178504cd88a9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:20.960547 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ffa99c04-f6c0-47eb-adbb-178504cd88a9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:20.967472 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffa99c04-f6c0-47eb-adbb-178504cd88a9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:20.968172 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffa99c04-f6c0-47eb-adbb-178504cd88a9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:20.969776 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffa99c04-f6c0-47eb-adbb-178504cd88a9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:20.970211 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffa99c04-f6c0-47eb-adbb-178504cd88a9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:21.122144 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ffa99c04-f6c0-47eb-adbb-178504cd88a9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:21.130743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ffa99c04-f6c0-47eb-adbb-178504cd88a9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.174840 Apr 06 16:57:21.131322 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1197/2395] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:20 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:21.688576 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-68f63521-d202-488f-84ec-4f98a96f6931 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:21.689238 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-68f63521-d202-488f-84ec-4f98a96f6931 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:21.695985 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68f63521-d202-488f-84ec-4f98a96f6931 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:21.696434 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68f63521-d202-488f-84ec-4f98a96f6931 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:21.697239 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68f63521-d202-488f-84ec-4f98a96f6931 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:21.697676 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68f63521-d202-488f-84ec-4f98a96f6931 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:21.731190 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6d076686-7784-42ac-ae74-aec0034c8a52 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:21.731812 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6d076686-7784-42ac-ae74-aec0034c8a52 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:21.738448 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d076686-7784-42ac-ae74-aec0034c8a52 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:21.739011 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d076686-7784-42ac-ae74-aec0034c8a52 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:21.739870 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d076686-7784-42ac-ae74-aec0034c8a52 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:21.740299 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d076686-7784-42ac-ae74-aec0034c8a52 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:21.803796 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6d076686-7784-42ac-ae74-aec0034c8a52 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:21.811971 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6d076686-7784-42ac-ae74-aec0034c8a52 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.084894 Apr 06 16:57:21.812527 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1198/2396] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:21 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:21.839921 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-68f63521-d202-488f-84ec-4f98a96f6931 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:21.849150 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-68f63521-d202-488f-84ec-4f98a96f6931 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:21.850644 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-68f63521-d202-488f-84ec-4f98a96f6931 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:21.851828 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-68f63521-d202-488f-84ec-4f98a96f6931 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.167430 Apr 06 16:57:21.852392 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1199/2397] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:21 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:22.151692 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a1ed5203-1f59-4451-92bf-b6bbc6a04c0c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:22.152379 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a1ed5203-1f59-4451-92bf-b6bbc6a04c0c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:22.158858 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1ed5203-1f59-4451-92bf-b6bbc6a04c0c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:22.159305 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1ed5203-1f59-4451-92bf-b6bbc6a04c0c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:22.160056 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1ed5203-1f59-4451-92bf-b6bbc6a04c0c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:22.160478 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1ed5203-1f59-4451-92bf-b6bbc6a04c0c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:22.308073 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a1ed5203-1f59-4451-92bf-b6bbc6a04c0c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:22.316251 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a1ed5203-1f59-4451-92bf-b6bbc6a04c0c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.168452 Apr 06 16:57:22.316869 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1199/2398] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:22 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:22.836071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3fc42f52-b732-4a09-9f82-9ba1a203bbd1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:22.836071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3fc42f52-b732-4a09-9f82-9ba1a203bbd1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:22.842642 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fc42f52-b732-4a09-9f82-9ba1a203bbd1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:22.843086 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fc42f52-b732-4a09-9f82-9ba1a203bbd1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:22.843901 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fc42f52-b732-4a09-9f82-9ba1a203bbd1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:22.844533 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fc42f52-b732-4a09-9f82-9ba1a203bbd1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:22.871287 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-db6a7435-3c34-48c2-9b8e-2859509fd8f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:22.871892 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-db6a7435-3c34-48c2-9b8e-2859509fd8f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:22.878824 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db6a7435-3c34-48c2-9b8e-2859509fd8f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:22.879275 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db6a7435-3c34-48c2-9b8e-2859509fd8f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:22.880057 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db6a7435-3c34-48c2-9b8e-2859509fd8f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:22.880488 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db6a7435-3c34-48c2-9b8e-2859509fd8f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:22.911695 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3fc42f52-b732-4a09-9f82-9ba1a203bbd1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:22.919938 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3fc42f52-b732-4a09-9f82-9ba1a203bbd1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.090040 Apr 06 16:57:22.920522 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1200/2399] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:22 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:23.016322 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-db6a7435-3c34-48c2-9b8e-2859509fd8f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:23.025075 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-db6a7435-3c34-48c2-9b8e-2859509fd8f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:23.026534 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-db6a7435-3c34-48c2-9b8e-2859509fd8f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:23.027723 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-db6a7435-3c34-48c2-9b8e-2859509fd8f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.160635 Apr 06 16:57:23.028278 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1200/2400] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:22 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:23.334042 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e2e459bd-34d2-4bcf-899f-fc66d9eba6a2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:23.334677 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e2e459bd-34d2-4bcf-899f-fc66d9eba6a2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:23.341300 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2e459bd-34d2-4bcf-899f-fc66d9eba6a2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:23.341746 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2e459bd-34d2-4bcf-899f-fc66d9eba6a2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:23.342505 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2e459bd-34d2-4bcf-899f-fc66d9eba6a2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:23.342936 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2e459bd-34d2-4bcf-899f-fc66d9eba6a2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:23.476230 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e2e459bd-34d2-4bcf-899f-fc66d9eba6a2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:23.485394 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e2e459bd-34d2-4bcf-899f-fc66d9eba6a2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.155032 Apr 06 16:57:23.485908 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1201/2401] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:23 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:23.937279 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c74ed74f-023f-4e73-8220-e19da975b07c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:23.938039 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c74ed74f-023f-4e73-8220-e19da975b07c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:23.945065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c74ed74f-023f-4e73-8220-e19da975b07c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:23.945523 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c74ed74f-023f-4e73-8220-e19da975b07c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:23.946294 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c74ed74f-023f-4e73-8220-e19da975b07c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:23.946728 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c74ed74f-023f-4e73-8220-e19da975b07c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:24.009616 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c74ed74f-023f-4e73-8220-e19da975b07c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:24.018211 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c74ed74f-023f-4e73-8220-e19da975b07c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.084853 Apr 06 16:57:24.018792 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1201/2402] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:23 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:24.046311 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eda4fc0d-4929-4e4d-a9be-83c23763a578 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:24.046897 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eda4fc0d-4929-4e4d-a9be-83c23763a578 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:24.053610 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eda4fc0d-4929-4e4d-a9be-83c23763a578 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:24.054063 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eda4fc0d-4929-4e4d-a9be-83c23763a578 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:24.054833 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eda4fc0d-4929-4e4d-a9be-83c23763a578 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:24.055270 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eda4fc0d-4929-4e4d-a9be-83c23763a578 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:24.202058 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-eda4fc0d-4929-4e4d-a9be-83c23763a578 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:24.211383 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-eda4fc0d-4929-4e4d-a9be-83c23763a578 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:24.212924 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-eda4fc0d-4929-4e4d-a9be-83c23763a578 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:24.214094 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eda4fc0d-4929-4e4d-a9be-83c23763a578 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.171788 Apr 06 16:57:24.214841 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1202/2403] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:24 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:24.503226 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7f42793a-0f0d-42cd-97bb-aea79857e55f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:24.503743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7f42793a-0f0d-42cd-97bb-aea79857e55f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:24.510236 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f42793a-0f0d-42cd-97bb-aea79857e55f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:24.510683 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f42793a-0f0d-42cd-97bb-aea79857e55f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:24.511445 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f42793a-0f0d-42cd-97bb-aea79857e55f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:24.511880 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f42793a-0f0d-42cd-97bb-aea79857e55f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:24.648672 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7f42793a-0f0d-42cd-97bb-aea79857e55f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:24.657508 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7f42793a-0f0d-42cd-97bb-aea79857e55f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.158531 Apr 06 16:57:24.658081 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1202/2404] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:24 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:25.035243 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-324dd4ad-df76-4ad8-b144-cf980007a20d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:25.035853 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-324dd4ad-df76-4ad8-b144-cf980007a20d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:25.042592 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-324dd4ad-df76-4ad8-b144-cf980007a20d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:25.043041 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-324dd4ad-df76-4ad8-b144-cf980007a20d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:25.043818 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-324dd4ad-df76-4ad8-b144-cf980007a20d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:25.044279 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-324dd4ad-df76-4ad8-b144-cf980007a20d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:25.105600 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-324dd4ad-df76-4ad8-b144-cf980007a20d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:25.114667 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-324dd4ad-df76-4ad8-b144-cf980007a20d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.083675 Apr 06 16:57:25.115248 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1203/2405] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:25 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:25.234072 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eeb4cde0-84e7-4e87-82bb-b7512d0b0510 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:25.234990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eeb4cde0-84e7-4e87-82bb-b7512d0b0510 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:25.241443 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eeb4cde0-84e7-4e87-82bb-b7512d0b0510 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:25.241889 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eeb4cde0-84e7-4e87-82bb-b7512d0b0510 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:25.242653 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eeb4cde0-84e7-4e87-82bb-b7512d0b0510 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:25.243087 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eeb4cde0-84e7-4e87-82bb-b7512d0b0510 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:25.383364 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-eeb4cde0-84e7-4e87-82bb-b7512d0b0510 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:25.392317 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-eeb4cde0-84e7-4e87-82bb-b7512d0b0510 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:25.394114 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-eeb4cde0-84e7-4e87-82bb-b7512d0b0510 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:25.395289 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eeb4cde0-84e7-4e87-82bb-b7512d0b0510 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.165252 Apr 06 16:57:25.395824 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1203/2406] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:25 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:25.678272 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eabd0768-8a57-40ef-afc8-0ec4e58a3718 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:25.678579 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eabd0768-8a57-40ef-afc8-0ec4e58a3718 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:25.687913 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eabd0768-8a57-40ef-afc8-0ec4e58a3718 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:25.688675 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eabd0768-8a57-40ef-afc8-0ec4e58a3718 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:25.690086 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eabd0768-8a57-40ef-afc8-0ec4e58a3718 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:25.690618 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eabd0768-8a57-40ef-afc8-0ec4e58a3718 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:25.857613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-eabd0768-8a57-40ef-afc8-0ec4e58a3718 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:25.871902 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eabd0768-8a57-40ef-afc8-0ec4e58a3718 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.198917 Apr 06 16:57:25.872481 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1204/2407] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:25 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:26.131810 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-abaa9eff-f94c-4186-bf82-6a590424d8d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:26.132414 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-abaa9eff-f94c-4186-bf82-6a590424d8d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:26.138749 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abaa9eff-f94c-4186-bf82-6a590424d8d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:26.139975 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abaa9eff-f94c-4186-bf82-6a590424d8d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:26.141309 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abaa9eff-f94c-4186-bf82-6a590424d8d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:26.142130 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abaa9eff-f94c-4186-bf82-6a590424d8d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:26.223185 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-abaa9eff-f94c-4186-bf82-6a590424d8d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:26.236363 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-abaa9eff-f94c-4186-bf82-6a590424d8d0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.107976 Apr 06 16:57:26.237521 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1204/2408] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:26 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:26.414175 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2e68fd4c-9591-4264-9ad6-ac9a6392c2b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:26.414777 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2e68fd4c-9591-4264-9ad6-ac9a6392c2b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:26.421493 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e68fd4c-9591-4264-9ad6-ac9a6392c2b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:26.421993 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e68fd4c-9591-4264-9ad6-ac9a6392c2b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:26.422816 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e68fd4c-9591-4264-9ad6-ac9a6392c2b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:26.423232 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e68fd4c-9591-4264-9ad6-ac9a6392c2b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:26.558859 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2e68fd4c-9591-4264-9ad6-ac9a6392c2b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:26.568009 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2e68fd4c-9591-4264-9ad6-ac9a6392c2b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:26.569550 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2e68fd4c-9591-4264-9ad6-ac9a6392c2b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:26.570724 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2e68fd4c-9591-4264-9ad6-ac9a6392c2b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.160682 Apr 06 16:57:26.571259 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1205/2409] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:26 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:26.891853 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ae988009-be21-4b40-87e3-fb37e2aaed72 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:26.892463 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ae988009-be21-4b40-87e3-fb37e2aaed72 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:26.899350 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae988009-be21-4b40-87e3-fb37e2aaed72 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:26.899835 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae988009-be21-4b40-87e3-fb37e2aaed72 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:26.900613 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae988009-be21-4b40-87e3-fb37e2aaed72 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:26.901081 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae988009-be21-4b40-87e3-fb37e2aaed72 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:27.036173 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ae988009-be21-4b40-87e3-fb37e2aaed72 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:27.044272 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ae988009-be21-4b40-87e3-fb37e2aaed72 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.156534 Apr 06 16:57:27.044875 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1205/2410] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:26 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:27.263088 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-369975d5-1b21-4312-9465-c6988a91549b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:27.263693 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-369975d5-1b21-4312-9465-c6988a91549b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:27.270758 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-369975d5-1b21-4312-9465-c6988a91549b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:27.271205 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-369975d5-1b21-4312-9465-c6988a91549b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:27.271965 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-369975d5-1b21-4312-9465-c6988a91549b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:27.272396 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-369975d5-1b21-4312-9465-c6988a91549b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:27.333765 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-369975d5-1b21-4312-9465-c6988a91549b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:27.342410 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-369975d5-1b21-4312-9465-c6988a91549b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.083247 Apr 06 16:57:27.342988 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1206/2411] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:27 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:27.589464 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9963ee73-2f93-4535-9f85-c661c5db181c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:27.590051 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9963ee73-2f93-4535-9f85-c661c5db181c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:27.596580 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9963ee73-2f93-4535-9f85-c661c5db181c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:27.597059 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9963ee73-2f93-4535-9f85-c661c5db181c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:27.597826 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9963ee73-2f93-4535-9f85-c661c5db181c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:27.598262 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9963ee73-2f93-4535-9f85-c661c5db181c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:27.734092 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9963ee73-2f93-4535-9f85-c661c5db181c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:27.743016 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9963ee73-2f93-4535-9f85-c661c5db181c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:27.744513 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9963ee73-2f93-4535-9f85-c661c5db181c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:27.745708 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9963ee73-2f93-4535-9f85-c661c5db181c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.160364 Apr 06 16:57:27.746269 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1206/2412] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:27 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:28.062187 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-685d780f-bf58-4c50-a8d4-d0b7c9368647 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:28.062853 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-685d780f-bf58-4c50-a8d4-d0b7c9368647 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:28.069689 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-685d780f-bf58-4c50-a8d4-d0b7c9368647 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:28.070118 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-685d780f-bf58-4c50-a8d4-d0b7c9368647 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:28.070873 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-685d780f-bf58-4c50-a8d4-d0b7c9368647 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:28.071326 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-685d780f-bf58-4c50-a8d4-d0b7c9368647 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:28.225418 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-685d780f-bf58-4c50-a8d4-d0b7c9368647 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:28.235161 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-685d780f-bf58-4c50-a8d4-d0b7c9368647 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.176875 Apr 06 16:57:28.235980 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1207/2413] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:28 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:28.360424 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fd2bec7c-aab8-4a1b-9199-93ae2da11470 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:28.361244 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fd2bec7c-aab8-4a1b-9199-93ae2da11470 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:28.367949 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd2bec7c-aab8-4a1b-9199-93ae2da11470 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:28.368402 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd2bec7c-aab8-4a1b-9199-93ae2da11470 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:28.369200 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd2bec7c-aab8-4a1b-9199-93ae2da11470 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:28.369662 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd2bec7c-aab8-4a1b-9199-93ae2da11470 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:28.433964 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fd2bec7c-aab8-4a1b-9199-93ae2da11470 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:28.442892 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fd2bec7c-aab8-4a1b-9199-93ae2da11470 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086412 Apr 06 16:57:28.443474 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1207/2414] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:28 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:28.764602 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-af5c5e8a-9c42-40f2-9d84-7ead5afcd6bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:28.765252 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-af5c5e8a-9c42-40f2-9d84-7ead5afcd6bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:28.772117 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af5c5e8a-9c42-40f2-9d84-7ead5afcd6bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:28.772566 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af5c5e8a-9c42-40f2-9d84-7ead5afcd6bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:28.773358 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af5c5e8a-9c42-40f2-9d84-7ead5afcd6bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:28.773789 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-af5c5e8a-9c42-40f2-9d84-7ead5afcd6bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:28.908836 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-af5c5e8a-9c42-40f2-9d84-7ead5afcd6bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:28.917743 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-af5c5e8a-9c42-40f2-9d84-7ead5afcd6bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:28.919215 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-af5c5e8a-9c42-40f2-9d84-7ead5afcd6bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:28.920359 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-af5c5e8a-9c42-40f2-9d84-7ead5afcd6bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.159811 Apr 06 16:57:28.920955 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1208/2415] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:28 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:29.253329 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fa5f9f6f-c3dd-4e24-91cc-08f9d286c37b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:29.253963 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fa5f9f6f-c3dd-4e24-91cc-08f9d286c37b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:29.260339 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa5f9f6f-c3dd-4e24-91cc-08f9d286c37b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:29.260815 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa5f9f6f-c3dd-4e24-91cc-08f9d286c37b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:29.261581 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa5f9f6f-c3dd-4e24-91cc-08f9d286c37b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:29.262010 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa5f9f6f-c3dd-4e24-91cc-08f9d286c37b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:29.400063 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fa5f9f6f-c3dd-4e24-91cc-08f9d286c37b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:29.408264 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fa5f9f6f-c3dd-4e24-91cc-08f9d286c37b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.159255 Apr 06 16:57:29.408855 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1208/2416] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:29 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:29.460346 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2a1ba7d8-3155-4a01-ac8c-4ea9b89fc373 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:29.460954 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2a1ba7d8-3155-4a01-ac8c-4ea9b89fc373 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:29.467843 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a1ba7d8-3155-4a01-ac8c-4ea9b89fc373 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:29.468296 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a1ba7d8-3155-4a01-ac8c-4ea9b89fc373 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:29.469092 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a1ba7d8-3155-4a01-ac8c-4ea9b89fc373 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:29.469531 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a1ba7d8-3155-4a01-ac8c-4ea9b89fc373 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:29.530983 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2a1ba7d8-3155-4a01-ac8c-4ea9b89fc373 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:29.539101 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2a1ba7d8-3155-4a01-ac8c-4ea9b89fc373 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.082722 Apr 06 16:57:29.539706 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1209/2417] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:29 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:29.940178 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e6045e90-3335-48b7-a86e-a64d03a955f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:29.940821 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e6045e90-3335-48b7-a86e-a64d03a955f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:29.947962 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6045e90-3335-48b7-a86e-a64d03a955f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:29.948414 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6045e90-3335-48b7-a86e-a64d03a955f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:29.949244 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6045e90-3335-48b7-a86e-a64d03a955f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:29.949677 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6045e90-3335-48b7-a86e-a64d03a955f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:30.101449 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e6045e90-3335-48b7-a86e-a64d03a955f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:30.111531 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e6045e90-3335-48b7-a86e-a64d03a955f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:30.113055 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e6045e90-3335-48b7-a86e-a64d03a955f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:30.114221 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e6045e90-3335-48b7-a86e-a64d03a955f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.178432 Apr 06 16:57:30.114783 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1209/2418] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:29 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:30.429495 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-100238a5-bf11-45e6-8f9f-b3b074e4b3ed tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:30.430553 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-100238a5-bf11-45e6-8f9f-b3b074e4b3ed tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:30.437220 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-100238a5-bf11-45e6-8f9f-b3b074e4b3ed tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:30.437780 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-100238a5-bf11-45e6-8f9f-b3b074e4b3ed tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:30.438966 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-100238a5-bf11-45e6-8f9f-b3b074e4b3ed tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:30.439377 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-100238a5-bf11-45e6-8f9f-b3b074e4b3ed tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:30.559525 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a32923a3-2d6b-4497-9186-5e9d4fcbaf39 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:30.560595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a32923a3-2d6b-4497-9186-5e9d4fcbaf39 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:30.570739 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a32923a3-2d6b-4497-9186-5e9d4fcbaf39 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:30.571228 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a32923a3-2d6b-4497-9186-5e9d4fcbaf39 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:30.571984 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a32923a3-2d6b-4497-9186-5e9d4fcbaf39 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:30.572408 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a32923a3-2d6b-4497-9186-5e9d4fcbaf39 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:30.587523 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-100238a5-bf11-45e6-8f9f-b3b074e4b3ed tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:30.599191 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-100238a5-bf11-45e6-8f9f-b3b074e4b3ed tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.175235 Apr 06 16:57:30.599777 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1210/2419] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:30 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:30.637066 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a32923a3-2d6b-4497-9186-5e9d4fcbaf39 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:30.645095 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a32923a3-2d6b-4497-9186-5e9d4fcbaf39 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.092263 Apr 06 16:57:30.645673 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1210/2420] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:30 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:31.132449 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e7d18d9-cdf4-451c-be54-3da76e69ac98 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:31.133087 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1e7d18d9-cdf4-451c-be54-3da76e69ac98 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:31.139369 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e7d18d9-cdf4-451c-be54-3da76e69ac98 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:31.139813 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e7d18d9-cdf4-451c-be54-3da76e69ac98 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:31.140564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e7d18d9-cdf4-451c-be54-3da76e69ac98 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:31.141790 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e7d18d9-cdf4-451c-be54-3da76e69ac98 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:31.287774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e7d18d9-cdf4-451c-be54-3da76e69ac98 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:31.296935 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e7d18d9-cdf4-451c-be54-3da76e69ac98 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:31.298691 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e7d18d9-cdf4-451c-be54-3da76e69ac98 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:31.299862 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1e7d18d9-cdf4-451c-be54-3da76e69ac98 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.171491 Apr 06 16:57:31.300434 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1211/2421] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:31 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:31.618699 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-55b8b0bb-477e-489b-9be4-3a798df55fc6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:31.619317 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-55b8b0bb-477e-489b-9be4-3a798df55fc6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:31.626095 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55b8b0bb-477e-489b-9be4-3a798df55fc6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:31.626540 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55b8b0bb-477e-489b-9be4-3a798df55fc6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:31.627308 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55b8b0bb-477e-489b-9be4-3a798df55fc6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:31.627743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55b8b0bb-477e-489b-9be4-3a798df55fc6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:31.662209 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d0cbb367-e6ec-42d8-b7fa-5845ccd763ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:31.662795 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d0cbb367-e6ec-42d8-b7fa-5845ccd763ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:31.669448 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0cbb367-e6ec-42d8-b7fa-5845ccd763ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:31.669885 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0cbb367-e6ec-42d8-b7fa-5845ccd763ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:31.670643 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0cbb367-e6ec-42d8-b7fa-5845ccd763ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:31.671067 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d0cbb367-e6ec-42d8-b7fa-5845ccd763ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:31.744485 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d0cbb367-e6ec-42d8-b7fa-5845ccd763ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:31.753511 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d0cbb367-e6ec-42d8-b7fa-5845ccd763ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.094965 Apr 06 16:57:31.754115 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1212/2422] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:31 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:57:31.777439 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-55b8b0bb-477e-489b-9be4-3a798df55fc6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:31.787823 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-55b8b0bb-477e-489b-9be4-3a798df55fc6 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.173697 Apr 06 16:57:31.788577 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1211/2423] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:31 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:32.318759 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-df3c0c3d-d43f-4d0d-8f1a-8dad27cc7710 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:32.319372 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-df3c0c3d-d43f-4d0d-8f1a-8dad27cc7710 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:32.326003 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df3c0c3d-d43f-4d0d-8f1a-8dad27cc7710 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:32.326457 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df3c0c3d-d43f-4d0d-8f1a-8dad27cc7710 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:32.327299 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df3c0c3d-d43f-4d0d-8f1a-8dad27cc7710 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:32.327822 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df3c0c3d-d43f-4d0d-8f1a-8dad27cc7710 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:32.717609 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-df3c0c3d-d43f-4d0d-8f1a-8dad27cc7710 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:32.726954 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-df3c0c3d-d43f-4d0d-8f1a-8dad27cc7710 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:32.728819 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-df3c0c3d-d43f-4d0d-8f1a-8dad27cc7710 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:32.729977 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-df3c0c3d-d43f-4d0d-8f1a-8dad27cc7710 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.415290 Apr 06 16:57:32.730525 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1213/2424] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:32 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:32.772138 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f767d04e-84c3-4d47-8b55-8f8865f8d653 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:32.773037 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f767d04e-84c3-4d47-8b55-8f8865f8d653 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:32.781276 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f767d04e-84c3-4d47-8b55-8f8865f8d653 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:32.782079 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f767d04e-84c3-4d47-8b55-8f8865f8d653 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:32.783295 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f767d04e-84c3-4d47-8b55-8f8865f8d653 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:32.783796 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f767d04e-84c3-4d47-8b55-8f8865f8d653 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:32.806859 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c5e0d5ea-d162-40c9-93d4-8dbf171a70d0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:32.807476 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c5e0d5ea-d162-40c9-93d4-8dbf171a70d0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:32.814192 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5e0d5ea-d162-40c9-93d4-8dbf171a70d0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:32.814619 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5e0d5ea-d162-40c9-93d4-8dbf171a70d0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:32.815522 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5e0d5ea-d162-40c9-93d4-8dbf171a70d0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:32.815961 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c5e0d5ea-d162-40c9-93d4-8dbf171a70d0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:32.850349 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f767d04e-84c3-4d47-8b55-8f8865f8d653 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:32.864078 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f767d04e-84c3-4d47-8b55-8f8865f8d653 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.095635 Apr 06 16:57:32.865207 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1212/2425] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:32 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:32.950719 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c5e0d5ea-d162-40c9-93d4-8dbf171a70d0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:32.959328 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c5e0d5ea-d162-40c9-93d4-8dbf171a70d0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.156387 Apr 06 16:57:32.959872 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1214/2426] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:32 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:33.748091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-42b9af20-b000-48d7-9a54-a7984141d33f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:33.748603 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-42b9af20-b000-48d7-9a54-a7984141d33f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:33.755303 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42b9af20-b000-48d7-9a54-a7984141d33f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:33.755756 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42b9af20-b000-48d7-9a54-a7984141d33f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:33.756532 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42b9af20-b000-48d7-9a54-a7984141d33f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:33.756998 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42b9af20-b000-48d7-9a54-a7984141d33f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:33.882040 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-411dbc7e-c0ed-4e5e-a5f6-431951facb49 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:33.882635 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-411dbc7e-c0ed-4e5e-a5f6-431951facb49 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:33.889408 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-411dbc7e-c0ed-4e5e-a5f6-431951facb49 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:33.890148 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-411dbc7e-c0ed-4e5e-a5f6-431951facb49 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:33.891485 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-411dbc7e-c0ed-4e5e-a5f6-431951facb49 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:33.892361 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-411dbc7e-c0ed-4e5e-a5f6-431951facb49 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:33.898078 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-42b9af20-b000-48d7-9a54-a7984141d33f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:33.906987 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-42b9af20-b000-48d7-9a54-a7984141d33f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:33.908482 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-42b9af20-b000-48d7-9a54-a7984141d33f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:33.909863 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-42b9af20-b000-48d7-9a54-a7984141d33f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.165858 Apr 06 16:57:33.910416 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1213/2427] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:33 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:33.953134 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-411dbc7e-c0ed-4e5e-a5f6-431951facb49 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:33.962378 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-411dbc7e-c0ed-4e5e-a5f6-431951facb49 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.084472 Apr 06 16:57:33.963011 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1215/2428] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:33 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:33.977030 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b2cb1bd1-13d3-4ea5-b15d-52d299407d1a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:33.977648 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b2cb1bd1-13d3-4ea5-b15d-52d299407d1a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:33.985025 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2cb1bd1-13d3-4ea5-b15d-52d299407d1a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:33.985492 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2cb1bd1-13d3-4ea5-b15d-52d299407d1a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:33.986399 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2cb1bd1-13d3-4ea5-b15d-52d299407d1a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:33.986873 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2cb1bd1-13d3-4ea5-b15d-52d299407d1a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:34.137522 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b2cb1bd1-13d3-4ea5-b15d-52d299407d1a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:34.146218 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b2cb1bd1-13d3-4ea5-b15d-52d299407d1a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.173162 Apr 06 16:57:34.146957 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1214/2429] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:33 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:34.927823 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-044e52f4-08f6-4e85-8bd1-d1eef19a1b59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:34.928451 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-044e52f4-08f6-4e85-8bd1-d1eef19a1b59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:34.934618 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-044e52f4-08f6-4e85-8bd1-d1eef19a1b59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:34.935067 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-044e52f4-08f6-4e85-8bd1-d1eef19a1b59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:34.935844 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-044e52f4-08f6-4e85-8bd1-d1eef19a1b59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:34.936280 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-044e52f4-08f6-4e85-8bd1-d1eef19a1b59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:34.983236 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7db547a7-bf7f-4c38-ad79-1794dfce18e3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:34.984003 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7db547a7-bf7f-4c38-ad79-1794dfce18e3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:34.992742 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7db547a7-bf7f-4c38-ad79-1794dfce18e3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:34.992742 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7db547a7-bf7f-4c38-ad79-1794dfce18e3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:34.993390 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7db547a7-bf7f-4c38-ad79-1794dfce18e3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:34.994351 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7db547a7-bf7f-4c38-ad79-1794dfce18e3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:35.082854 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7db547a7-bf7f-4c38-ad79-1794dfce18e3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:35.095521 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7db547a7-bf7f-4c38-ad79-1794dfce18e3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.118149 Apr 06 16:57:35.097277 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1215/2430] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:34 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:35.108111 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-044e52f4-08f6-4e85-8bd1-d1eef19a1b59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:35.117474 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-044e52f4-08f6-4e85-8bd1-d1eef19a1b59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:35.118987 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-044e52f4-08f6-4e85-8bd1-d1eef19a1b59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:35.120145 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-044e52f4-08f6-4e85-8bd1-d1eef19a1b59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.196331 Apr 06 16:57:35.120789 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1216/2431] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:34 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:35.163681 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ef5a796e-673c-4201-a731-a9fb70c36c07 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:35.164805 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ef5a796e-673c-4201-a731-a9fb70c36c07 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:35.170767 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef5a796e-673c-4201-a731-a9fb70c36c07 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:35.171283 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef5a796e-673c-4201-a731-a9fb70c36c07 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:35.172189 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef5a796e-673c-4201-a731-a9fb70c36c07 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:35.172718 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef5a796e-673c-4201-a731-a9fb70c36c07 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:35.401288 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ef5a796e-673c-4201-a731-a9fb70c36c07 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:35.409690 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ef5a796e-673c-4201-a731-a9fb70c36c07 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.249982 Apr 06 16:57:35.410395 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1216/2432] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:35 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:36.124313 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-15719120-7570-490d-8e04-415a6d0975cd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:36.125608 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-15719120-7570-490d-8e04-415a6d0975cd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:36.139289 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15719120-7570-490d-8e04-415a6d0975cd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:36.140344 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15719120-7570-490d-8e04-415a6d0975cd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:36.141837 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-44def690-9f20-4232-9327-d4fd90d28399 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:36.142487 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15719120-7570-490d-8e04-415a6d0975cd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:36.142646 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-44def690-9f20-4232-9327-d4fd90d28399 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:36.142910 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-15719120-7570-490d-8e04-415a6d0975cd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:36.151927 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44def690-9f20-4232-9327-d4fd90d28399 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:36.152636 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44def690-9f20-4232-9327-d4fd90d28399 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:36.154013 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44def690-9f20-4232-9327-d4fd90d28399 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:36.154771 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44def690-9f20-4232-9327-d4fd90d28399 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:36.224108 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-15719120-7570-490d-8e04-415a6d0975cd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:36.234628 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-15719120-7570-490d-8e04-415a6d0975cd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.118007 Apr 06 16:57:36.236082 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1217/2433] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:36 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:36.332425 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-44def690-9f20-4232-9327-d4fd90d28399 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:36.341581 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-44def690-9f20-4232-9327-d4fd90d28399 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:36.343102 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-44def690-9f20-4232-9327-d4fd90d28399 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:36.349214 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-44def690-9f20-4232-9327-d4fd90d28399 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.208316 Apr 06 16:57:36.349214 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1217/2434] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:36 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:36.427463 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f166fab4-4f49-4e47-97c7-ab6723be76cc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:36.427964 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f166fab4-4f49-4e47-97c7-ab6723be76cc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:36.434206 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f166fab4-4f49-4e47-97c7-ab6723be76cc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:36.434653 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f166fab4-4f49-4e47-97c7-ab6723be76cc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:36.435430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f166fab4-4f49-4e47-97c7-ab6723be76cc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:36.435852 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f166fab4-4f49-4e47-97c7-ab6723be76cc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:36.600666 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f166fab4-4f49-4e47-97c7-ab6723be76cc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:36.610010 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f166fab4-4f49-4e47-97c7-ab6723be76cc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.186485 Apr 06 16:57:36.610603 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1218/2435] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:36 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:37.255671 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b177b0b4-c4d4-41f3-8b61-b63ad8fbc96e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:37.256318 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b177b0b4-c4d4-41f3-8b61-b63ad8fbc96e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:37.262977 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b177b0b4-c4d4-41f3-8b61-b63ad8fbc96e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:37.263424 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b177b0b4-c4d4-41f3-8b61-b63ad8fbc96e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:37.264184 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b177b0b4-c4d4-41f3-8b61-b63ad8fbc96e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:37.264612 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b177b0b4-c4d4-41f3-8b61-b63ad8fbc96e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:37.332582 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b177b0b4-c4d4-41f3-8b61-b63ad8fbc96e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:37.340487 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b177b0b4-c4d4-41f3-8b61-b63ad8fbc96e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.088738 Apr 06 16:57:37.341235 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1218/2436] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:37 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:37.364038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6804ec7e-7c93-4db2-802f-91a68209d93a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:37.364716 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6804ec7e-7c93-4db2-802f-91a68209d93a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:37.371258 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6804ec7e-7c93-4db2-802f-91a68209d93a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:37.371696 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6804ec7e-7c93-4db2-802f-91a68209d93a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:37.372444 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6804ec7e-7c93-4db2-802f-91a68209d93a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:37.373079 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6804ec7e-7c93-4db2-802f-91a68209d93a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:37.518111 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6804ec7e-7c93-4db2-802f-91a68209d93a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:37.527647 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6804ec7e-7c93-4db2-802f-91a68209d93a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:37.529182 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6804ec7e-7c93-4db2-802f-91a68209d93a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:37.530905 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6804ec7e-7c93-4db2-802f-91a68209d93a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.170981 Apr 06 16:57:37.531876 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1219/2437] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:37 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:37.628550 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5eac12d4-3de1-48a0-8abf-3a1e94fa7a1a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:37.629193 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5eac12d4-3de1-48a0-8abf-3a1e94fa7a1a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:37.635683 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5eac12d4-3de1-48a0-8abf-3a1e94fa7a1a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:37.636138 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5eac12d4-3de1-48a0-8abf-3a1e94fa7a1a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:37.636951 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5eac12d4-3de1-48a0-8abf-3a1e94fa7a1a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:37.637388 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5eac12d4-3de1-48a0-8abf-3a1e94fa7a1a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:37.780073 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5eac12d4-3de1-48a0-8abf-3a1e94fa7a1a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:37.788675 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5eac12d4-3de1-48a0-8abf-3a1e94fa7a1a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.164747 Apr 06 16:57:37.789261 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1219/2438] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:37 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:38.358989 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0ef46995-73b9-49af-b102-962560a6d5a0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:38.359707 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0ef46995-73b9-49af-b102-962560a6d5a0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:38.366479 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ef46995-73b9-49af-b102-962560a6d5a0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:38.367116 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ef46995-73b9-49af-b102-962560a6d5a0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:38.367696 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ef46995-73b9-49af-b102-962560a6d5a0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:38.368121 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0ef46995-73b9-49af-b102-962560a6d5a0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:38.431869 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0ef46995-73b9-49af-b102-962560a6d5a0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:38.444170 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0ef46995-73b9-49af-b102-962560a6d5a0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.088868 Apr 06 16:57:38.444965 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1220/2439] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:38 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:38.551907 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c48df3ae-05de-43fc-9d7a-36e49a246d74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:38.552541 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c48df3ae-05de-43fc-9d7a-36e49a246d74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:38.559466 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c48df3ae-05de-43fc-9d7a-36e49a246d74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:38.559973 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c48df3ae-05de-43fc-9d7a-36e49a246d74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:38.560800 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c48df3ae-05de-43fc-9d7a-36e49a246d74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:38.561239 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c48df3ae-05de-43fc-9d7a-36e49a246d74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:38.724144 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c48df3ae-05de-43fc-9d7a-36e49a246d74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:38.738552 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c48df3ae-05de-43fc-9d7a-36e49a246d74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:38.740584 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c48df3ae-05de-43fc-9d7a-36e49a246d74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:38.742132 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c48df3ae-05de-43fc-9d7a-36e49a246d74 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.194253 Apr 06 16:57:38.743013 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1220/2440] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:38 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:38.806729 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6bb2b0ff-22c6-490c-a894-c9b9d769478c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:38.807341 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6bb2b0ff-22c6-490c-a894-c9b9d769478c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:38.815228 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bb2b0ff-22c6-490c-a894-c9b9d769478c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:38.815695 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bb2b0ff-22c6-490c-a894-c9b9d769478c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:38.816470 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bb2b0ff-22c6-490c-a894-c9b9d769478c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:38.816940 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bb2b0ff-22c6-490c-a894-c9b9d769478c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:38.977468 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6bb2b0ff-22c6-490c-a894-c9b9d769478c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:38.986293 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6bb2b0ff-22c6-490c-a894-c9b9d769478c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.183555 Apr 06 16:57:38.986894 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1221/2441] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:38 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:39.469605 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0b4c6c0a-95f1-4ac0-8d2a-2ebb80fd20cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:39.470217 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0b4c6c0a-95f1-4ac0-8d2a-2ebb80fd20cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:39.476708 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b4c6c0a-95f1-4ac0-8d2a-2ebb80fd20cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:39.477185 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b4c6c0a-95f1-4ac0-8d2a-2ebb80fd20cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:39.477956 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b4c6c0a-95f1-4ac0-8d2a-2ebb80fd20cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:39.478761 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b4c6c0a-95f1-4ac0-8d2a-2ebb80fd20cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:39.542730 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0b4c6c0a-95f1-4ac0-8d2a-2ebb80fd20cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:39.555569 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0b4c6c0a-95f1-4ac0-8d2a-2ebb80fd20cc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.092117 Apr 06 16:57:39.556218 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1221/2442] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:39 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:39.763525 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8f75b423-2ab1-4c66-b36b-13101c266161 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:39.764340 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8f75b423-2ab1-4c66-b36b-13101c266161 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:39.771987 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f75b423-2ab1-4c66-b36b-13101c266161 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:39.772438 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f75b423-2ab1-4c66-b36b-13101c266161 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:39.773242 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f75b423-2ab1-4c66-b36b-13101c266161 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:39.773671 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f75b423-2ab1-4c66-b36b-13101c266161 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:39.922859 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8f75b423-2ab1-4c66-b36b-13101c266161 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:39.931693 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8f75b423-2ab1-4c66-b36b-13101c266161 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:39.933191 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8f75b423-2ab1-4c66-b36b-13101c266161 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:39.934421 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8f75b423-2ab1-4c66-b36b-13101c266161 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.176449 Apr 06 16:57:39.934979 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1222/2443] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:39 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:40.005773 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d37a71d8-5e58-4b0c-bfec-04c6f9a0fb90 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:40.006386 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d37a71d8-5e58-4b0c-bfec-04c6f9a0fb90 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:40.013127 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d37a71d8-5e58-4b0c-bfec-04c6f9a0fb90 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:40.013671 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d37a71d8-5e58-4b0c-bfec-04c6f9a0fb90 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:40.014341 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d37a71d8-5e58-4b0c-bfec-04c6f9a0fb90 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:40.014774 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d37a71d8-5e58-4b0c-bfec-04c6f9a0fb90 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:40.172348 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d37a71d8-5e58-4b0c-bfec-04c6f9a0fb90 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:40.184290 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d37a71d8-5e58-4b0c-bfec-04c6f9a0fb90 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.182086 Apr 06 16:57:40.185144 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1222/2444] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:40 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:40.575602 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3a1ee3c4-cd25-45da-b7bb-2a3ef63fbb09 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:40.576195 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3a1ee3c4-cd25-45da-b7bb-2a3ef63fbb09 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:40.583278 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a1ee3c4-cd25-45da-b7bb-2a3ef63fbb09 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:40.583648 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a1ee3c4-cd25-45da-b7bb-2a3ef63fbb09 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:40.584415 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a1ee3c4-cd25-45da-b7bb-2a3ef63fbb09 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:40.584893 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a1ee3c4-cd25-45da-b7bb-2a3ef63fbb09 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:40.647707 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3a1ee3c4-cd25-45da-b7bb-2a3ef63fbb09 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:40.656683 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3a1ee3c4-cd25-45da-b7bb-2a3ef63fbb09 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.084924 Apr 06 16:57:40.657661 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1223/2445] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:40 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:40.961005 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0ec220df-01b9-4baa-af00-99e395a3ee9a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:40.961989 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0ec220df-01b9-4baa-af00-99e395a3ee9a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:40.970930 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ec220df-01b9-4baa-af00-99e395a3ee9a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:40.971379 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ec220df-01b9-4baa-af00-99e395a3ee9a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:40.972152 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ec220df-01b9-4baa-af00-99e395a3ee9a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:40.972583 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ec220df-01b9-4baa-af00-99e395a3ee9a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:41.117663 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0ec220df-01b9-4baa-af00-99e395a3ee9a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:41.126657 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0ec220df-01b9-4baa-af00-99e395a3ee9a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:41.128166 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0ec220df-01b9-4baa-af00-99e395a3ee9a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:41.129350 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0ec220df-01b9-4baa-af00-99e395a3ee9a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.173937 Apr 06 16:57:41.129902 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1223/2446] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:40 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:41.203090 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7b0de9d0-b2f1-4074-9908-d661006d4775 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:41.203709 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7b0de9d0-b2f1-4074-9908-d661006d4775 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:41.210297 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b0de9d0-b2f1-4074-9908-d661006d4775 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:41.210745 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b0de9d0-b2f1-4074-9908-d661006d4775 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:41.212192 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b0de9d0-b2f1-4074-9908-d661006d4775 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:41.212667 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b0de9d0-b2f1-4074-9908-d661006d4775 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:41.357427 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7b0de9d0-b2f1-4074-9908-d661006d4775 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:41.367048 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7b0de9d0-b2f1-4074-9908-d661006d4775 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.167867 Apr 06 16:57:41.367663 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1224/2447] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:41 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:41.677213 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2a6f148d-9ec6-493b-84ae-547beabe402f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:41.677988 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2a6f148d-9ec6-493b-84ae-547beabe402f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:41.687314 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a6f148d-9ec6-493b-84ae-547beabe402f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:41.687834 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a6f148d-9ec6-493b-84ae-547beabe402f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:41.688639 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a6f148d-9ec6-493b-84ae-547beabe402f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:41.689089 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a6f148d-9ec6-493b-84ae-547beabe402f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:41.756893 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2a6f148d-9ec6-493b-84ae-547beabe402f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:41.765083 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2a6f148d-9ec6-493b-84ae-547beabe402f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.094469 Apr 06 16:57:41.765639 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1224/2448] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:41 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:42.148509 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e05bec48-bbec-48e4-a73a-7bd9fec3c79c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:42.149132 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e05bec48-bbec-48e4-a73a-7bd9fec3c79c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:42.155581 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e05bec48-bbec-48e4-a73a-7bd9fec3c79c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:42.156027 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e05bec48-bbec-48e4-a73a-7bd9fec3c79c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:42.156975 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e05bec48-bbec-48e4-a73a-7bd9fec3c79c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:42.157420 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e05bec48-bbec-48e4-a73a-7bd9fec3c79c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:42.316839 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e05bec48-bbec-48e4-a73a-7bd9fec3c79c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:42.325093 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e05bec48-bbec-48e4-a73a-7bd9fec3c79c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:42.326603 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e05bec48-bbec-48e4-a73a-7bd9fec3c79c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:42.327771 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e05bec48-bbec-48e4-a73a-7bd9fec3c79c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.183334 Apr 06 16:57:42.328458 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1225/2449] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:42 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:42.384675 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-40a59c30-a900-418a-8ba5-08cbca8238e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:42.385275 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-40a59c30-a900-418a-8ba5-08cbca8238e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:42.391526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40a59c30-a900-418a-8ba5-08cbca8238e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:42.391952 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40a59c30-a900-418a-8ba5-08cbca8238e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:42.392755 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40a59c30-a900-418a-8ba5-08cbca8238e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:42.393197 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40a59c30-a900-418a-8ba5-08cbca8238e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:42.548205 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-40a59c30-a900-418a-8ba5-08cbca8238e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:42.557263 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-40a59c30-a900-418a-8ba5-08cbca8238e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.176527 Apr 06 16:57:42.557820 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1225/2450] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:42 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:42.786905 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ee1e55e6-1a2a-495c-aa3d-37541cc0e3df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:42.787757 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ee1e55e6-1a2a-495c-aa3d-37541cc0e3df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:42.797783 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee1e55e6-1a2a-495c-aa3d-37541cc0e3df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:42.798224 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee1e55e6-1a2a-495c-aa3d-37541cc0e3df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:42.798999 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee1e55e6-1a2a-495c-aa3d-37541cc0e3df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:42.799422 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee1e55e6-1a2a-495c-aa3d-37541cc0e3df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:42.870712 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ee1e55e6-1a2a-495c-aa3d-37541cc0e3df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:42.879287 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ee1e55e6-1a2a-495c-aa3d-37541cc0e3df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.099386 Apr 06 16:57:42.879859 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1226/2451] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:42 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:43.352229 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f65f3cb1-2e04-4352-b5a7-4acd0b483f12 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:43.352928 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f65f3cb1-2e04-4352-b5a7-4acd0b483f12 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:43.360605 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f65f3cb1-2e04-4352-b5a7-4acd0b483f12 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:43.361263 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f65f3cb1-2e04-4352-b5a7-4acd0b483f12 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:43.362493 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f65f3cb1-2e04-4352-b5a7-4acd0b483f12 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:43.363176 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f65f3cb1-2e04-4352-b5a7-4acd0b483f12 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:43.513300 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f65f3cb1-2e04-4352-b5a7-4acd0b483f12 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:43.522457 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f65f3cb1-2e04-4352-b5a7-4acd0b483f12 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:43.523930 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f65f3cb1-2e04-4352-b5a7-4acd0b483f12 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:43.525162 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f65f3cb1-2e04-4352-b5a7-4acd0b483f12 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.176918 Apr 06 16:57:43.525746 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1226/2452] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:43 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:43.581056 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2a406822-b698-467c-a318-88da2ca11dd9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:43.581664 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2a406822-b698-467c-a318-88da2ca11dd9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:43.588612 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a406822-b698-467c-a318-88da2ca11dd9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:43.589041 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a406822-b698-467c-a318-88da2ca11dd9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:43.589815 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a406822-b698-467c-a318-88da2ca11dd9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:43.590251 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a406822-b698-467c-a318-88da2ca11dd9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:43.739506 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2a406822-b698-467c-a318-88da2ca11dd9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:43.748017 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2a406822-b698-467c-a318-88da2ca11dd9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.171147 Apr 06 16:57:43.748578 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1227/2453] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:43 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:43.897292 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ba73e5d2-f2b1-4396-a025-3b00fb277195 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:43.897905 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ba73e5d2-f2b1-4396-a025-3b00fb277195 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:43.904400 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba73e5d2-f2b1-4396-a025-3b00fb277195 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:43.904883 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba73e5d2-f2b1-4396-a025-3b00fb277195 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:43.905657 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba73e5d2-f2b1-4396-a025-3b00fb277195 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:43.906162 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba73e5d2-f2b1-4396-a025-3b00fb277195 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:43.974486 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ba73e5d2-f2b1-4396-a025-3b00fb277195 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:43.983284 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ba73e5d2-f2b1-4396-a025-3b00fb277195 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.090231 Apr 06 16:57:43.983834 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1227/2454] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:43 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:44.544297 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fdf6c5b8-bcae-4e86-975d-3f01002211a6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:44.544953 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fdf6c5b8-bcae-4e86-975d-3f01002211a6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:44.552482 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdf6c5b8-bcae-4e86-975d-3f01002211a6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:44.552959 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdf6c5b8-bcae-4e86-975d-3f01002211a6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:44.553724 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdf6c5b8-bcae-4e86-975d-3f01002211a6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:44.554155 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdf6c5b8-bcae-4e86-975d-3f01002211a6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:44.696238 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fdf6c5b8-bcae-4e86-975d-3f01002211a6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:44.706470 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fdf6c5b8-bcae-4e86-975d-3f01002211a6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:44.708342 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fdf6c5b8-bcae-4e86-975d-3f01002211a6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:44.709561 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fdf6c5b8-bcae-4e86-975d-3f01002211a6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.169419 Apr 06 16:57:44.710131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1228/2455] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:44 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:57:44.767784 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bd16c86b-9a60-4b60-8caa-61ea7e5bf99e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:44.768385 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bd16c86b-9a60-4b60-8caa-61ea7e5bf99e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:44.776455 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd16c86b-9a60-4b60-8caa-61ea7e5bf99e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:44.777253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd16c86b-9a60-4b60-8caa-61ea7e5bf99e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:44.778523 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd16c86b-9a60-4b60-8caa-61ea7e5bf99e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:44.779258 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd16c86b-9a60-4b60-8caa-61ea7e5bf99e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:45.001261 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b5cf9ffb-d751-4989-a4ba-fb992303e309 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:45.001778 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b5cf9ffb-d751-4989-a4ba-fb992303e309 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:45.008795 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5cf9ffb-d751-4989-a4ba-fb992303e309 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:45.009254 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5cf9ffb-d751-4989-a4ba-fb992303e309 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:45.010075 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5cf9ffb-d751-4989-a4ba-fb992303e309 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:45.010511 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b5cf9ffb-d751-4989-a4ba-fb992303e309 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:45.073299 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b5cf9ffb-d751-4989-a4ba-fb992303e309 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:45.082406 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b5cf9ffb-d751-4989-a4ba-fb992303e309 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.085286 Apr 06 16:57:45.082978 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1229/2456] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:44 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:45.195490 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-bd16c86b-9a60-4b60-8caa-61ea7e5bf99e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:45.203875 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bd16c86b-9a60-4b60-8caa-61ea7e5bf99e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.441432 Apr 06 16:57:45.204452 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1228/2457] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:44 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:45.732638 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-540d449d-5be2-49bd-8741-4f480a983ccc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:45.733676 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-540d449d-5be2-49bd-8741-4f480a983ccc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:45.743832 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-540d449d-5be2-49bd-8741-4f480a983ccc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:45.744567 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-540d449d-5be2-49bd-8741-4f480a983ccc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:45.745852 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-540d449d-5be2-49bd-8741-4f480a983ccc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:45.746587 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-540d449d-5be2-49bd-8741-4f480a983ccc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:45.892747 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-540d449d-5be2-49bd-8741-4f480a983ccc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:45.901207 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-540d449d-5be2-49bd-8741-4f480a983ccc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:45.902692 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-540d449d-5be2-49bd-8741-4f480a983ccc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:45.903849 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-540d449d-5be2-49bd-8741-4f480a983ccc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.178864 Apr 06 16:57:45.904421 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1230/2458] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:45 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:46.102604 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fbaab2e8-c84b-487a-8be9-18c4758b1a8b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:46.103170 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fbaab2e8-c84b-487a-8be9-18c4758b1a8b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:46.110283 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbaab2e8-c84b-487a-8be9-18c4758b1a8b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:46.110810 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbaab2e8-c84b-487a-8be9-18c4758b1a8b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:46.111608 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbaab2e8-c84b-487a-8be9-18c4758b1a8b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:46.112036 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbaab2e8-c84b-487a-8be9-18c4758b1a8b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:46.177392 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fbaab2e8-c84b-487a-8be9-18c4758b1a8b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:46.185579 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fbaab2e8-c84b-487a-8be9-18c4758b1a8b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086997 Apr 06 16:57:46.186187 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1229/2459] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:46 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:46.226339 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a99a2ca1-eadc-4fa3-8a68-b8c6f7f18018 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:46.226949 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a99a2ca1-eadc-4fa3-8a68-b8c6f7f18018 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:46.233794 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a99a2ca1-eadc-4fa3-8a68-b8c6f7f18018 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:46.234247 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a99a2ca1-eadc-4fa3-8a68-b8c6f7f18018 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:46.235012 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a99a2ca1-eadc-4fa3-8a68-b8c6f7f18018 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:46.235615 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a99a2ca1-eadc-4fa3-8a68-b8c6f7f18018 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:46.377846 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a99a2ca1-eadc-4fa3-8a68-b8c6f7f18018 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:46.386456 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a99a2ca1-eadc-4fa3-8a68-b8c6f7f18018 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.164038 Apr 06 16:57:46.387069 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1231/2460] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:46 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:46.922962 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b8b03c75-4e05-4b57-8d75-4a74c601178b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:46.923566 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b8b03c75-4e05-4b57-8d75-4a74c601178b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:46.930456 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8b03c75-4e05-4b57-8d75-4a74c601178b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:46.930902 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8b03c75-4e05-4b57-8d75-4a74c601178b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:46.931684 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8b03c75-4e05-4b57-8d75-4a74c601178b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:46.932113 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8b03c75-4e05-4b57-8d75-4a74c601178b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:47.081191 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b8b03c75-4e05-4b57-8d75-4a74c601178b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:47.089783 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b8b03c75-4e05-4b57-8d75-4a74c601178b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:47.091289 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b8b03c75-4e05-4b57-8d75-4a74c601178b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:47.092463 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b8b03c75-4e05-4b57-8d75-4a74c601178b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.173625 Apr 06 16:57:47.093055 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1230/2461] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:46 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:47.203814 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d62d04b7-5f8e-48c8-971f-a7659a37b85e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:47.204562 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d62d04b7-5f8e-48c8-971f-a7659a37b85e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:47.211582 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d62d04b7-5f8e-48c8-971f-a7659a37b85e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:47.212032 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d62d04b7-5f8e-48c8-971f-a7659a37b85e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:47.213026 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d62d04b7-5f8e-48c8-971f-a7659a37b85e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:47.213770 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d62d04b7-5f8e-48c8-971f-a7659a37b85e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:47.280446 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d62d04b7-5f8e-48c8-971f-a7659a37b85e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:47.289345 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d62d04b7-5f8e-48c8-971f-a7659a37b85e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.089521 Apr 06 16:57:47.289930 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1232/2462] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:47 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:47.403961 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2da03fa3-a69c-4d1d-91e9-1d5d00b76e64 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:47.404585 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2da03fa3-a69c-4d1d-91e9-1d5d00b76e64 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:47.411411 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2da03fa3-a69c-4d1d-91e9-1d5d00b76e64 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:47.411853 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2da03fa3-a69c-4d1d-91e9-1d5d00b76e64 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:47.412622 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2da03fa3-a69c-4d1d-91e9-1d5d00b76e64 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:47.413086 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2da03fa3-a69c-4d1d-91e9-1d5d00b76e64 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:47.552413 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2da03fa3-a69c-4d1d-91e9-1d5d00b76e64 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:47.560328 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2da03fa3-a69c-4d1d-91e9-1d5d00b76e64 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.160338 Apr 06 16:57:47.560974 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1231/2463] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:47 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:48.114748 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fa9a4bcf-5267-437e-b031-d29d632ab5d6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:48.115348 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fa9a4bcf-5267-437e-b031-d29d632ab5d6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:48.121614 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa9a4bcf-5267-437e-b031-d29d632ab5d6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:48.122059 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa9a4bcf-5267-437e-b031-d29d632ab5d6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:48.122817 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa9a4bcf-5267-437e-b031-d29d632ab5d6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:48.123245 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa9a4bcf-5267-437e-b031-d29d632ab5d6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:48.261896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fa9a4bcf-5267-437e-b031-d29d632ab5d6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:48.274406 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fa9a4bcf-5267-437e-b031-d29d632ab5d6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:48.276800 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fa9a4bcf-5267-437e-b031-d29d632ab5d6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:48.278562 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fa9a4bcf-5267-437e-b031-d29d632ab5d6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.169714 Apr 06 16:57:48.279335 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1233/2464] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:48 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:48.306672 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-51c93782-0f3c-4129-802f-a18d2a0b20e3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:48.307281 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-51c93782-0f3c-4129-802f-a18d2a0b20e3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:48.313800 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51c93782-0f3c-4129-802f-a18d2a0b20e3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:48.314251 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51c93782-0f3c-4129-802f-a18d2a0b20e3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:48.315035 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51c93782-0f3c-4129-802f-a18d2a0b20e3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:48.315472 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51c93782-0f3c-4129-802f-a18d2a0b20e3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:48.380733 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-51c93782-0f3c-4129-802f-a18d2a0b20e3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:48.389776 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-51c93782-0f3c-4129-802f-a18d2a0b20e3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086562 Apr 06 16:57:48.390363 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1232/2465] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:48 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:48.578419 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7bea1c1c-11f2-4dac-ac52-b0ef74660a33 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:48.578936 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7bea1c1c-11f2-4dac-ac52-b0ef74660a33 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:48.585488 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bea1c1c-11f2-4dac-ac52-b0ef74660a33 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:48.585958 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bea1c1c-11f2-4dac-ac52-b0ef74660a33 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:48.586740 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bea1c1c-11f2-4dac-ac52-b0ef74660a33 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:48.587146 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bea1c1c-11f2-4dac-ac52-b0ef74660a33 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:48.726657 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7bea1c1c-11f2-4dac-ac52-b0ef74660a33 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:48.735575 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7bea1c1c-11f2-4dac-ac52-b0ef74660a33 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.161235 Apr 06 16:57:48.736334 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1234/2466] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:48 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:49.303753 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-abab6921-53e9-4cd3-a23e-ed16415eaf13 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:49.304393 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-abab6921-53e9-4cd3-a23e-ed16415eaf13 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:49.311270 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abab6921-53e9-4cd3-a23e-ed16415eaf13 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:49.311716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abab6921-53e9-4cd3-a23e-ed16415eaf13 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:49.312491 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abab6921-53e9-4cd3-a23e-ed16415eaf13 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:49.313036 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abab6921-53e9-4cd3-a23e-ed16415eaf13 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:49.412203 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-819898da-b9bb-469a-ba78-f214877f55df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:49.413143 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-819898da-b9bb-469a-ba78-f214877f55df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:49.419336 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-819898da-b9bb-469a-ba78-f214877f55df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:49.419783 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-819898da-b9bb-469a-ba78-f214877f55df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:49.420590 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-819898da-b9bb-469a-ba78-f214877f55df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:49.421057 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-819898da-b9bb-469a-ba78-f214877f55df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:49.457393 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-abab6921-53e9-4cd3-a23e-ed16415eaf13 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:49.466016 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-abab6921-53e9-4cd3-a23e-ed16415eaf13 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:49.467508 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-abab6921-53e9-4cd3-a23e-ed16415eaf13 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:49.468662 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-abab6921-53e9-4cd3-a23e-ed16415eaf13 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.168936 Apr 06 16:57:49.469316 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1233/2467] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:49 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:49.486078 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-819898da-b9bb-469a-ba78-f214877f55df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:49.494013 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-819898da-b9bb-469a-ba78-f214877f55df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.085462 Apr 06 16:57:49.494589 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1235/2468] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:49 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:49.762770 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e79bd298-6c18-4aad-9c9b-4fcc6e13a294 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:49.764514 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e79bd298-6c18-4aad-9c9b-4fcc6e13a294 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:49.774810 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e79bd298-6c18-4aad-9c9b-4fcc6e13a294 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:49.775531 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e79bd298-6c18-4aad-9c9b-4fcc6e13a294 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:49.776726 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e79bd298-6c18-4aad-9c9b-4fcc6e13a294 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:49.777499 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e79bd298-6c18-4aad-9c9b-4fcc6e13a294 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:49.935050 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e79bd298-6c18-4aad-9c9b-4fcc6e13a294 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:49.943106 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e79bd298-6c18-4aad-9c9b-4fcc6e13a294 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.191238 Apr 06 16:57:49.943677 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1234/2469] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:49 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:50.488247 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-578e7ffa-7346-43a3-907b-9899d3e81ff1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:50.489185 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-578e7ffa-7346-43a3-907b-9899d3e81ff1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:50.495618 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-578e7ffa-7346-43a3-907b-9899d3e81ff1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:50.496278 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-578e7ffa-7346-43a3-907b-9899d3e81ff1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:50.497537 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-578e7ffa-7346-43a3-907b-9899d3e81ff1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:50.498227 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-578e7ffa-7346-43a3-907b-9899d3e81ff1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:50.516083 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9b9e388a-7a17-43e3-b666-60d1b30d8a16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:50.517102 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9b9e388a-7a17-43e3-b666-60d1b30d8a16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:50.527602 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b9e388a-7a17-43e3-b666-60d1b30d8a16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:50.528308 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b9e388a-7a17-43e3-b666-60d1b30d8a16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:50.529628 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b9e388a-7a17-43e3-b666-60d1b30d8a16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:50.530361 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b9e388a-7a17-43e3-b666-60d1b30d8a16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:50.592971 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9b9e388a-7a17-43e3-b666-60d1b30d8a16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:50.601342 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9b9e388a-7a17-43e3-b666-60d1b30d8a16 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.092046 Apr 06 16:57:50.607430 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1235/2470] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:50 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:50.641312 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-578e7ffa-7346-43a3-907b-9899d3e81ff1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:50.650202 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-578e7ffa-7346-43a3-907b-9899d3e81ff1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:50.651698 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-578e7ffa-7346-43a3-907b-9899d3e81ff1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:50.653001 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-578e7ffa-7346-43a3-907b-9899d3e81ff1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.168734 Apr 06 16:57:50.653539 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1236/2471] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:50 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:50.964190 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1dd996c6-de52-473e-94df-535709b6df3e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:50.964832 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1dd996c6-de52-473e-94df-535709b6df3e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:50.972249 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dd996c6-de52-473e-94df-535709b6df3e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:50.972717 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dd996c6-de52-473e-94df-535709b6df3e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:50.973497 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dd996c6-de52-473e-94df-535709b6df3e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:50.973931 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dd996c6-de52-473e-94df-535709b6df3e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:51.143410 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1dd996c6-de52-473e-94df-535709b6df3e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:51.151775 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1dd996c6-de52-473e-94df-535709b6df3e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.192014 Apr 06 16:57:51.152353 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1236/2472] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:50 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:51.619028 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2b978d8c-07b0-462c-99fc-50c1378eb28b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:51.619643 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2b978d8c-07b0-462c-99fc-50c1378eb28b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:51.626829 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b978d8c-07b0-462c-99fc-50c1378eb28b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:51.627281 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b978d8c-07b0-462c-99fc-50c1378eb28b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:51.628040 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b978d8c-07b0-462c-99fc-50c1378eb28b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:51.628468 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b978d8c-07b0-462c-99fc-50c1378eb28b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:51.671909 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-54a5b389-7e20-45d6-8f48-5b97f67e2e85 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:51.673133 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-54a5b389-7e20-45d6-8f48-5b97f67e2e85 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:51.680372 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54a5b389-7e20-45d6-8f48-5b97f67e2e85 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:51.680854 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54a5b389-7e20-45d6-8f48-5b97f67e2e85 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:51.681641 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54a5b389-7e20-45d6-8f48-5b97f67e2e85 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:51.682067 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54a5b389-7e20-45d6-8f48-5b97f67e2e85 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:51.689764 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2b978d8c-07b0-462c-99fc-50c1378eb28b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:51.697997 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2b978d8c-07b0-462c-99fc-50c1378eb28b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.082915 Apr 06 16:57:51.698576 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1237/2473] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:51 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:51.817502 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-54a5b389-7e20-45d6-8f48-5b97f67e2e85 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:51.826418 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-54a5b389-7e20-45d6-8f48-5b97f67e2e85 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:51.827892 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-54a5b389-7e20-45d6-8f48-5b97f67e2e85 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:51.829297 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-54a5b389-7e20-45d6-8f48-5b97f67e2e85 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.161369 Apr 06 16:57:51.829851 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1237/2474] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:51 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:52.170720 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-461b1809-a21d-48ef-9bf7-409b16316338 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:52.171334 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-461b1809-a21d-48ef-9bf7-409b16316338 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:52.177984 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-461b1809-a21d-48ef-9bf7-409b16316338 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:52.178427 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-461b1809-a21d-48ef-9bf7-409b16316338 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:52.179191 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-461b1809-a21d-48ef-9bf7-409b16316338 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:52.179622 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-461b1809-a21d-48ef-9bf7-409b16316338 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:52.320888 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-461b1809-a21d-48ef-9bf7-409b16316338 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:52.329126 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-461b1809-a21d-48ef-9bf7-409b16316338 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.162427 Apr 06 16:57:52.329734 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1238/2475] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:52 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:52.715606 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-be7499cd-8343-47ad-b194-580c1e52fee2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:52.716253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-be7499cd-8343-47ad-b194-580c1e52fee2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:52.723132 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be7499cd-8343-47ad-b194-580c1e52fee2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:52.723581 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be7499cd-8343-47ad-b194-580c1e52fee2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:52.724341 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be7499cd-8343-47ad-b194-580c1e52fee2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:52.724805 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be7499cd-8343-47ad-b194-580c1e52fee2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:52.788196 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-be7499cd-8343-47ad-b194-580c1e52fee2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:52.796231 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-be7499cd-8343-47ad-b194-580c1e52fee2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.084586 Apr 06 16:57:52.796885 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1238/2476] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:52 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:52.848111 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7b4a6dbe-fc45-4d42-80d1-6655ae8a9330 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:52.848766 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7b4a6dbe-fc45-4d42-80d1-6655ae8a9330 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:52.856735 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b4a6dbe-fc45-4d42-80d1-6655ae8a9330 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:52.857218 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b4a6dbe-fc45-4d42-80d1-6655ae8a9330 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:52.857980 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b4a6dbe-fc45-4d42-80d1-6655ae8a9330 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:52.858415 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b4a6dbe-fc45-4d42-80d1-6655ae8a9330 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:52.995428 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7b4a6dbe-fc45-4d42-80d1-6655ae8a9330 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:53.004286 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7b4a6dbe-fc45-4d42-80d1-6655ae8a9330 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:53.005797 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7b4a6dbe-fc45-4d42-80d1-6655ae8a9330 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:53.006941 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7b4a6dbe-fc45-4d42-80d1-6655ae8a9330 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.163163 Apr 06 16:57:53.007496 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1239/2477] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:52 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:53.346387 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f4074b6d-45e8-48dd-9c3a-083b21cf1147 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:53.346987 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f4074b6d-45e8-48dd-9c3a-083b21cf1147 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:53.353503 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4074b6d-45e8-48dd-9c3a-083b21cf1147 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:53.354306 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4074b6d-45e8-48dd-9c3a-083b21cf1147 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:53.355064 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4074b6d-45e8-48dd-9c3a-083b21cf1147 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:53.355492 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4074b6d-45e8-48dd-9c3a-083b21cf1147 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:53.505058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f4074b6d-45e8-48dd-9c3a-083b21cf1147 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:53.513413 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f4074b6d-45e8-48dd-9c3a-083b21cf1147 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.171009 Apr 06 16:57:53.513976 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1239/2478] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:53 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:53.814212 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-551d0e04-a330-4996-af80-b6f9dc1edb18 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:53.814819 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-551d0e04-a330-4996-af80-b6f9dc1edb18 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:53.821620 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-551d0e04-a330-4996-af80-b6f9dc1edb18 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:53.822085 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-551d0e04-a330-4996-af80-b6f9dc1edb18 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:53.822865 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-551d0e04-a330-4996-af80-b6f9dc1edb18 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:53.823289 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-551d0e04-a330-4996-af80-b6f9dc1edb18 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:53.900971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-551d0e04-a330-4996-af80-b6f9dc1edb18 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:53.910312 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-551d0e04-a330-4996-af80-b6f9dc1edb18 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.100182 Apr 06 16:57:53.910903 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1240/2479] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:53 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:54.025995 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-90f4c1fa-c736-4bb8-bf1e-cfe6761f5c2a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:54.026882 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-90f4c1fa-c736-4bb8-bf1e-cfe6761f5c2a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:54.038274 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90f4c1fa-c736-4bb8-bf1e-cfe6761f5c2a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:54.038732 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90f4c1fa-c736-4bb8-bf1e-cfe6761f5c2a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:54.039536 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90f4c1fa-c736-4bb8-bf1e-cfe6761f5c2a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:54.039974 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90f4c1fa-c736-4bb8-bf1e-cfe6761f5c2a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:54.177699 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-90f4c1fa-c736-4bb8-bf1e-cfe6761f5c2a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:54.186441 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-90f4c1fa-c736-4bb8-bf1e-cfe6761f5c2a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:54.188151 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-90f4c1fa-c736-4bb8-bf1e-cfe6761f5c2a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:54.189604 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-90f4c1fa-c736-4bb8-bf1e-cfe6761f5c2a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.168211 Apr 06 16:57:54.190360 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1240/2480] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:54 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:54.531507 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-020ddd4d-8646-4af5-bfdd-fcee2f3bfd06 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:54.532109 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-020ddd4d-8646-4af5-bfdd-fcee2f3bfd06 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:54.538821 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-020ddd4d-8646-4af5-bfdd-fcee2f3bfd06 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:54.539266 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-020ddd4d-8646-4af5-bfdd-fcee2f3bfd06 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:54.540016 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-020ddd4d-8646-4af5-bfdd-fcee2f3bfd06 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:54.540443 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-020ddd4d-8646-4af5-bfdd-fcee2f3bfd06 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:54.678659 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-020ddd4d-8646-4af5-bfdd-fcee2f3bfd06 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:54.686696 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-020ddd4d-8646-4af5-bfdd-fcee2f3bfd06 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.159497 Apr 06 16:57:54.687269 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1241/2481] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:54 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:54.927869 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b83c47f8-dcd3-467f-96a2-766a09f24f5a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:54.928377 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b83c47f8-dcd3-467f-96a2-766a09f24f5a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:54.934878 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b83c47f8-dcd3-467f-96a2-766a09f24f5a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:54.935329 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b83c47f8-dcd3-467f-96a2-766a09f24f5a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:54.936093 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b83c47f8-dcd3-467f-96a2-766a09f24f5a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:54.936510 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b83c47f8-dcd3-467f-96a2-766a09f24f5a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:55.001382 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b83c47f8-dcd3-467f-96a2-766a09f24f5a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:55.010230 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b83c47f8-dcd3-467f-96a2-766a09f24f5a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086317 Apr 06 16:57:55.010836 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1241/2482] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:54 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:55.208078 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9568d207-e593-49c6-af4b-c3386e02fa77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:55.208665 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9568d207-e593-49c6-af4b-c3386e02fa77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:55.215392 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9568d207-e593-49c6-af4b-c3386e02fa77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:55.215841 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9568d207-e593-49c6-af4b-c3386e02fa77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:55.216605 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9568d207-e593-49c6-af4b-c3386e02fa77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:55.217073 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9568d207-e593-49c6-af4b-c3386e02fa77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:55.357305 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9568d207-e593-49c6-af4b-c3386e02fa77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:55.368741 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9568d207-e593-49c6-af4b-c3386e02fa77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:55.370949 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9568d207-e593-49c6-af4b-c3386e02fa77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:55.372552 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9568d207-e593-49c6-af4b-c3386e02fa77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.168402 Apr 06 16:57:55.373397 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1242/2483] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:55 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:55.703885 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4af36fc1-767e-47b0-bb13-06eb8c0c0943 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:55.704575 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4af36fc1-767e-47b0-bb13-06eb8c0c0943 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:55.711507 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4af36fc1-767e-47b0-bb13-06eb8c0c0943 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:55.711960 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4af36fc1-767e-47b0-bb13-06eb8c0c0943 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:55.712814 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4af36fc1-767e-47b0-bb13-06eb8c0c0943 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:55.713246 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4af36fc1-767e-47b0-bb13-06eb8c0c0943 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:55.853542 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4af36fc1-767e-47b0-bb13-06eb8c0c0943 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:55.862484 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4af36fc1-767e-47b0-bb13-06eb8c0c0943 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.162734 Apr 06 16:57:55.863266 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1242/2484] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:55 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:56.028392 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-74a58ffa-ab9e-4889-b9a5-b57c644fcaed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:56.028958 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-74a58ffa-ab9e-4889-b9a5-b57c644fcaed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:56.035664 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74a58ffa-ab9e-4889-b9a5-b57c644fcaed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:56.036111 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74a58ffa-ab9e-4889-b9a5-b57c644fcaed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:56.036949 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74a58ffa-ab9e-4889-b9a5-b57c644fcaed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:56.037414 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-74a58ffa-ab9e-4889-b9a5-b57c644fcaed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:56.097703 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-74a58ffa-ab9e-4889-b9a5-b57c644fcaed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:56.106306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-74a58ffa-ab9e-4889-b9a5-b57c644fcaed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.082002 Apr 06 16:57:56.106881 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1243/2485] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:56 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:56.392375 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e47dc554-27b1-40e9-9c1b-ddc7c34c3bc6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:56.393011 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e47dc554-27b1-40e9-9c1b-ddc7c34c3bc6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:56.399478 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e47dc554-27b1-40e9-9c1b-ddc7c34c3bc6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:56.399919 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e47dc554-27b1-40e9-9c1b-ddc7c34c3bc6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:56.400676 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e47dc554-27b1-40e9-9c1b-ddc7c34c3bc6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:56.401157 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e47dc554-27b1-40e9-9c1b-ddc7c34c3bc6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:56.541845 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e47dc554-27b1-40e9-9c1b-ddc7c34c3bc6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:56.550844 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e47dc554-27b1-40e9-9c1b-ddc7c34c3bc6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:56.552293 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e47dc554-27b1-40e9-9c1b-ddc7c34c3bc6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:56.553491 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e47dc554-27b1-40e9-9c1b-ddc7c34c3bc6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.165312 Apr 06 16:57:56.554093 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1243/2486] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:56 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:56.879909 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f4645a36-4e89-4b8d-a24e-9503bf1f1913 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:56.880551 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f4645a36-4e89-4b8d-a24e-9503bf1f1913 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:56.887190 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4645a36-4e89-4b8d-a24e-9503bf1f1913 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:56.887648 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4645a36-4e89-4b8d-a24e-9503bf1f1913 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:56.888423 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4645a36-4e89-4b8d-a24e-9503bf1f1913 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:56.888904 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4645a36-4e89-4b8d-a24e-9503bf1f1913 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:57.033635 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f4645a36-4e89-4b8d-a24e-9503bf1f1913 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:57.041508 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f4645a36-4e89-4b8d-a24e-9503bf1f1913 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.165548 Apr 06 16:57:57.042089 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1244/2487] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:56 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:57.123736 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b022516e-0812-4a86-aaac-aa0050df4040 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:57.124359 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b022516e-0812-4a86-aaac-aa0050df4040 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:57.131409 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b022516e-0812-4a86-aaac-aa0050df4040 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:57.131795 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b022516e-0812-4a86-aaac-aa0050df4040 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:57.132566 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b022516e-0812-4a86-aaac-aa0050df4040 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:57.133042 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b022516e-0812-4a86-aaac-aa0050df4040 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:57.195440 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b022516e-0812-4a86-aaac-aa0050df4040 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:57.204189 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b022516e-0812-4a86-aaac-aa0050df4040 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.084252 Apr 06 16:57:57.204792 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1244/2488] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:57 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:57.572592 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-674d9490-e178-4936-8b79-352eaa7bc8f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:57.573117 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-674d9490-e178-4936-8b79-352eaa7bc8f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:57.580062 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-674d9490-e178-4936-8b79-352eaa7bc8f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:57.580509 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-674d9490-e178-4936-8b79-352eaa7bc8f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:57.581317 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-674d9490-e178-4936-8b79-352eaa7bc8f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:57.581769 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-674d9490-e178-4936-8b79-352eaa7bc8f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:57.718147 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-674d9490-e178-4936-8b79-352eaa7bc8f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:57.726755 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-674d9490-e178-4936-8b79-352eaa7bc8f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:57.728270 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-674d9490-e178-4936-8b79-352eaa7bc8f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:57.729826 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-674d9490-e178-4936-8b79-352eaa7bc8f2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.161383 Apr 06 16:57:57.730401 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1245/2489] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:57 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:58.062140 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-caffcce7-d00a-46e7-9c39-0f3d0faef679 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:58.062935 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-caffcce7-d00a-46e7-9c39-0f3d0faef679 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:58.069535 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-caffcce7-d00a-46e7-9c39-0f3d0faef679 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:58.070007 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-caffcce7-d00a-46e7-9c39-0f3d0faef679 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:58.070765 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-caffcce7-d00a-46e7-9c39-0f3d0faef679 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:58.071236 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-caffcce7-d00a-46e7-9c39-0f3d0faef679 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:58.207961 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-caffcce7-d00a-46e7-9c39-0f3d0faef679 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:58.216029 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-caffcce7-d00a-46e7-9c39-0f3d0faef679 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.159404 Apr 06 16:57:58.216591 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1245/2490] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:58 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:58.221635 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-610b4db1-745b-44f3-87c2-271f866dd657 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:58.222219 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-610b4db1-745b-44f3-87c2-271f866dd657 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:58.229457 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-610b4db1-745b-44f3-87c2-271f866dd657 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:58.229910 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-610b4db1-745b-44f3-87c2-271f866dd657 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:58.230683 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-610b4db1-745b-44f3-87c2-271f866dd657 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:58.231117 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-610b4db1-745b-44f3-87c2-271f866dd657 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:58.295899 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-610b4db1-745b-44f3-87c2-271f866dd657 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:58.304608 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-610b4db1-745b-44f3-87c2-271f866dd657 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086734 Apr 06 16:57:58.305198 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1246/2491] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:58 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:58.749012 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4a033616-3dd2-4160-b633-220de1c64f9c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:58.749622 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4a033616-3dd2-4160-b633-220de1c64f9c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:58.756097 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a033616-3dd2-4160-b633-220de1c64f9c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:58.756547 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a033616-3dd2-4160-b633-220de1c64f9c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:58.757337 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a033616-3dd2-4160-b633-220de1c64f9c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:58.757774 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a033616-3dd2-4160-b633-220de1c64f9c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:58.891516 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4a033616-3dd2-4160-b633-220de1c64f9c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:58.900328 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4a033616-3dd2-4160-b633-220de1c64f9c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:58.901877 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4a033616-3dd2-4160-b633-220de1c64f9c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:58.903034 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4a033616-3dd2-4160-b633-220de1c64f9c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.158060 Apr 06 16:57:58.903599 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1246/2492] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:58 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:57:59.233718 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8dba46e6-264c-44db-9f71-ba0c361d667b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:59.234345 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8dba46e6-264c-44db-9f71-ba0c361d667b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:59.242662 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dba46e6-264c-44db-9f71-ba0c361d667b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:59.243259 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dba46e6-264c-44db-9f71-ba0c361d667b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:59.244484 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dba46e6-264c-44db-9f71-ba0c361d667b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:59.245119 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dba46e6-264c-44db-9f71-ba0c361d667b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:59.323060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cf39ef1c-c771-4520-8194-dffe48576586 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:59.323934 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cf39ef1c-c771-4520-8194-dffe48576586 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:59.330750 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf39ef1c-c771-4520-8194-dffe48576586 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:59.331287 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf39ef1c-c771-4520-8194-dffe48576586 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:59.332055 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf39ef1c-c771-4520-8194-dffe48576586 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:59.332508 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf39ef1c-c771-4520-8194-dffe48576586 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:59.387324 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8dba46e6-264c-44db-9f71-ba0c361d667b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:59.396538 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8dba46e6-264c-44db-9f71-ba0c361d667b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.166221 Apr 06 16:57:59.398825 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1247/2493] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:59 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:59.398999 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cf39ef1c-c771-4520-8194-dffe48576586 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:57:59.406563 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cf39ef1c-c771-4520-8194-dffe48576586 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.087459 Apr 06 16:57:59.407326 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1247/2494] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:57:59 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:57:59.922006 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d526d1b9-268f-4839-aa5e-05c102edb320 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:57:59.922806 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d526d1b9-268f-4839-aa5e-05c102edb320 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:57:59.937292 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d526d1b9-268f-4839-aa5e-05c102edb320 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:59.938191 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d526d1b9-268f-4839-aa5e-05c102edb320 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:57:59.939294 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d526d1b9-268f-4839-aa5e-05c102edb320 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:57:59.939712 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d526d1b9-268f-4839-aa5e-05c102edb320 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:00.090971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d526d1b9-268f-4839-aa5e-05c102edb320 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:00.100024 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d526d1b9-268f-4839-aa5e-05c102edb320 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:00.101558 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d526d1b9-268f-4839-aa5e-05c102edb320 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:00.102728 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d526d1b9-268f-4839-aa5e-05c102edb320 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.185270 Apr 06 16:58:00.103262 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1248/2495] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:57:59 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:00.413695 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-570287b1-7919-4d89-8606-affb31dc2dd3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:00.414305 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-570287b1-7919-4d89-8606-affb31dc2dd3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:00.421008 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-570287b1-7919-4d89-8606-affb31dc2dd3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:00.421492 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-570287b1-7919-4d89-8606-affb31dc2dd3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:00.422240 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-570287b1-7919-4d89-8606-affb31dc2dd3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:00.422749 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-570287b1-7919-4d89-8606-affb31dc2dd3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:00.423698 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ef1ade46-8e78-4638-afdb-dab30abd158f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:00.424299 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ef1ade46-8e78-4638-afdb-dab30abd158f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:00.430774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef1ade46-8e78-4638-afdb-dab30abd158f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:00.431223 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef1ade46-8e78-4638-afdb-dab30abd158f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:00.431988 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef1ade46-8e78-4638-afdb-dab30abd158f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:00.432420 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef1ade46-8e78-4638-afdb-dab30abd158f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:00.498353 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ef1ade46-8e78-4638-afdb-dab30abd158f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:00.506646 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ef1ade46-8e78-4638-afdb-dab30abd158f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086910 Apr 06 16:58:00.507318 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1249/2496] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:00 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:00.565669 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-570287b1-7919-4d89-8606-affb31dc2dd3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:00.574121 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-570287b1-7919-4d89-8606-affb31dc2dd3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.164341 Apr 06 16:58:00.574671 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1248/2497] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:00 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:01.121742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3ed1b0a5-b8a4-47fb-a6df-a966f6cdc41a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:01.122346 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3ed1b0a5-b8a4-47fb-a6df-a966f6cdc41a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:01.129056 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ed1b0a5-b8a4-47fb-a6df-a966f6cdc41a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:01.129443 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ed1b0a5-b8a4-47fb-a6df-a966f6cdc41a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:01.130210 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ed1b0a5-b8a4-47fb-a6df-a966f6cdc41a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:01.130649 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ed1b0a5-b8a4-47fb-a6df-a966f6cdc41a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:01.273639 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3ed1b0a5-b8a4-47fb-a6df-a966f6cdc41a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:01.282518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3ed1b0a5-b8a4-47fb-a6df-a966f6cdc41a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:01.284156 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3ed1b0a5-b8a4-47fb-a6df-a966f6cdc41a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:01.285349 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3ed1b0a5-b8a4-47fb-a6df-a966f6cdc41a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.167605 Apr 06 16:58:01.285907 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1250/2498] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:01 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:01.524076 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c7fe8cf5-101b-4096-8717-cddcf0f7af57 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:01.524704 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c7fe8cf5-101b-4096-8717-cddcf0f7af57 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:01.531560 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7fe8cf5-101b-4096-8717-cddcf0f7af57 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:01.532330 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7fe8cf5-101b-4096-8717-cddcf0f7af57 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:01.533759 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7fe8cf5-101b-4096-8717-cddcf0f7af57 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:01.534555 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7fe8cf5-101b-4096-8717-cddcf0f7af57 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:01.591500 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7a6c95df-608b-4491-908b-09e10125f52e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:01.592127 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7a6c95df-608b-4491-908b-09e10125f52e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:01.595961 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c7fe8cf5-101b-4096-8717-cddcf0f7af57 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:01.598731 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a6c95df-608b-4491-908b-09e10125f52e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:01.599195 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a6c95df-608b-4491-908b-09e10125f52e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:01.599967 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a6c95df-608b-4491-908b-09e10125f52e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:01.600396 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a6c95df-608b-4491-908b-09e10125f52e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:01.604772 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c7fe8cf5-101b-4096-8717-cddcf0f7af57 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.084775 Apr 06 16:58:01.605334 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1249/2499] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:01 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:01.735148 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7a6c95df-608b-4491-908b-09e10125f52e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:01.743830 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7a6c95df-608b-4491-908b-09e10125f52e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.156122 Apr 06 16:58:01.744382 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1251/2500] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:01 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:02.304489 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eea44015-4a6e-485f-a5ab-9ff4758e9152 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:02.305116 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eea44015-4a6e-485f-a5ab-9ff4758e9152 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:02.311666 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eea44015-4a6e-485f-a5ab-9ff4758e9152 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:02.312115 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eea44015-4a6e-485f-a5ab-9ff4758e9152 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:02.312924 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eea44015-4a6e-485f-a5ab-9ff4758e9152 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:02.313579 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eea44015-4a6e-485f-a5ab-9ff4758e9152 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:02.457937 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-eea44015-4a6e-485f-a5ab-9ff4758e9152 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:02.466414 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-eea44015-4a6e-485f-a5ab-9ff4758e9152 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:02.467901 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-eea44015-4a6e-485f-a5ab-9ff4758e9152 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:02.469098 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eea44015-4a6e-485f-a5ab-9ff4758e9152 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.168583 Apr 06 16:58:02.469693 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1250/2501] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:02 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:02.625662 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2950fcb0-3248-47ca-a301-d5f39daf5f9c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:02.626663 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2950fcb0-3248-47ca-a301-d5f39daf5f9c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:02.633109 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2950fcb0-3248-47ca-a301-d5f39daf5f9c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:02.633561 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2950fcb0-3248-47ca-a301-d5f39daf5f9c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:02.634327 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2950fcb0-3248-47ca-a301-d5f39daf5f9c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:02.634760 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2950fcb0-3248-47ca-a301-d5f39daf5f9c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:02.699513 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2950fcb0-3248-47ca-a301-d5f39daf5f9c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:02.707576 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2950fcb0-3248-47ca-a301-d5f39daf5f9c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.088606 Apr 06 16:58:02.708152 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1252/2502] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:02 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:02.761655 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8a0c7b95-e5f6-40e8-a9f6-8404405a8949 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:02.762238 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8a0c7b95-e5f6-40e8-a9f6-8404405a8949 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:02.769122 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a0c7b95-e5f6-40e8-a9f6-8404405a8949 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:02.769573 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a0c7b95-e5f6-40e8-a9f6-8404405a8949 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:02.770338 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a0c7b95-e5f6-40e8-a9f6-8404405a8949 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:02.770891 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a0c7b95-e5f6-40e8-a9f6-8404405a8949 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:02.908035 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8a0c7b95-e5f6-40e8-a9f6-8404405a8949 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:02.916214 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8a0c7b95-e5f6-40e8-a9f6-8404405a8949 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.158576 Apr 06 16:58:02.916806 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1251/2503] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:02 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:03.492160 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e4d2c15d-d9ac-4dc9-b784-c5ffdf675d7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:03.493029 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e4d2c15d-d9ac-4dc9-b784-c5ffdf675d7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:03.501974 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4d2c15d-d9ac-4dc9-b784-c5ffdf675d7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:03.502430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4d2c15d-d9ac-4dc9-b784-c5ffdf675d7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:03.503206 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4d2c15d-d9ac-4dc9-b784-c5ffdf675d7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:03.503645 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4d2c15d-d9ac-4dc9-b784-c5ffdf675d7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:03.650478 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e4d2c15d-d9ac-4dc9-b784-c5ffdf675d7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:03.658990 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e4d2c15d-d9ac-4dc9-b784-c5ffdf675d7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:03.660472 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e4d2c15d-d9ac-4dc9-b784-c5ffdf675d7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:03.661679 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e4d2c15d-d9ac-4dc9-b784-c5ffdf675d7e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.175978 Apr 06 16:58:03.662270 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1253/2504] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:03 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:03.726190 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-573ec5ac-74b5-4734-b0d5-df0839f969bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:03.726799 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-573ec5ac-74b5-4734-b0d5-df0839f969bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:03.733854 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-573ec5ac-74b5-4734-b0d5-df0839f969bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:03.734306 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-573ec5ac-74b5-4734-b0d5-df0839f969bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:03.735846 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-573ec5ac-74b5-4734-b0d5-df0839f969bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:03.736308 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-573ec5ac-74b5-4734-b0d5-df0839f969bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:03.812199 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-573ec5ac-74b5-4734-b0d5-df0839f969bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:03.825853 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-573ec5ac-74b5-4734-b0d5-df0839f969bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.103682 Apr 06 16:58:03.826868 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1252/2505] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:03 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:03.934305 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-364abe74-bec0-41ca-abed-3068e2eaf9dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:03.934914 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-364abe74-bec0-41ca-abed-3068e2eaf9dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:03.941540 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-364abe74-bec0-41ca-abed-3068e2eaf9dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:03.941988 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-364abe74-bec0-41ca-abed-3068e2eaf9dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:03.942763 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-364abe74-bec0-41ca-abed-3068e2eaf9dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:03.943193 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-364abe74-bec0-41ca-abed-3068e2eaf9dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:04.078876 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-364abe74-bec0-41ca-abed-3068e2eaf9dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:04.087329 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-364abe74-bec0-41ca-abed-3068e2eaf9dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.157039 Apr 06 16:58:04.087909 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1254/2506] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:03 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:04.680060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-65400f46-58d1-4e98-9280-efc9f579ebab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:04.680676 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-65400f46-58d1-4e98-9280-efc9f579ebab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:04.687223 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65400f46-58d1-4e98-9280-efc9f579ebab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:04.687672 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65400f46-58d1-4e98-9280-efc9f579ebab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:04.688442 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65400f46-58d1-4e98-9280-efc9f579ebab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:04.688889 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65400f46-58d1-4e98-9280-efc9f579ebab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:04.829645 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-65400f46-58d1-4e98-9280-efc9f579ebab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:04.838539 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-65400f46-58d1-4e98-9280-efc9f579ebab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:04.840057 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-65400f46-58d1-4e98-9280-efc9f579ebab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:04.841327 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-65400f46-58d1-4e98-9280-efc9f579ebab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.165237 Apr 06 16:58:04.841881 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1253/2507] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:04 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:04.843658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9e9ee5ef-5bad-477c-bb3b-45b92dc5bff7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:04.844266 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9e9ee5ef-5bad-477c-bb3b-45b92dc5bff7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:04.851079 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e9ee5ef-5bad-477c-bb3b-45b92dc5bff7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:04.851518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e9ee5ef-5bad-477c-bb3b-45b92dc5bff7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:04.852276 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e9ee5ef-5bad-477c-bb3b-45b92dc5bff7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:04.852731 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9e9ee5ef-5bad-477c-bb3b-45b92dc5bff7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:04.918635 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9e9ee5ef-5bad-477c-bb3b-45b92dc5bff7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:04.927252 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9e9ee5ef-5bad-477c-bb3b-45b92dc5bff7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.087689 Apr 06 16:58:04.927824 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1255/2508] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:04 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:05.105482 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-88fe4625-8b9a-4bd2-91d3-bc6a3fd120d9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:05.106306 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-88fe4625-8b9a-4bd2-91d3-bc6a3fd120d9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:05.113535 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88fe4625-8b9a-4bd2-91d3-bc6a3fd120d9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:05.113981 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88fe4625-8b9a-4bd2-91d3-bc6a3fd120d9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:05.114787 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88fe4625-8b9a-4bd2-91d3-bc6a3fd120d9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:05.115243 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88fe4625-8b9a-4bd2-91d3-bc6a3fd120d9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:05.256554 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-88fe4625-8b9a-4bd2-91d3-bc6a3fd120d9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:05.268404 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-88fe4625-8b9a-4bd2-91d3-bc6a3fd120d9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.167384 Apr 06 16:58:05.269054 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1254/2509] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:05 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:05.861072 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-80a68df9-c130-41c8-ab3f-394807ad7ace tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:05.861711 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-80a68df9-c130-41c8-ab3f-394807ad7ace tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:05.868495 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80a68df9-c130-41c8-ab3f-394807ad7ace tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:05.868975 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80a68df9-c130-41c8-ab3f-394807ad7ace tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:05.869741 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80a68df9-c130-41c8-ab3f-394807ad7ace tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:05.870171 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80a68df9-c130-41c8-ab3f-394807ad7ace tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:05.945199 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ff4226da-9694-404b-a332-ae7850d558d6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:05.945834 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ff4226da-9694-404b-a332-ae7850d558d6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:05.952872 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff4226da-9694-404b-a332-ae7850d558d6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:05.953628 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff4226da-9694-404b-a332-ae7850d558d6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:05.955933 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff4226da-9694-404b-a332-ae7850d558d6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:05.956369 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff4226da-9694-404b-a332-ae7850d558d6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:06.011392 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-80a68df9-c130-41c8-ab3f-394807ad7ace tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:06.022160 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-80a68df9-c130-41c8-ab3f-394807ad7ace tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:06.023931 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-80a68df9-c130-41c8-ab3f-394807ad7ace tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:06.025293 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-80a68df9-c130-41c8-ab3f-394807ad7ace tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.168442 Apr 06 16:58:06.026155 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1256/2510] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:05 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:06.029843 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ff4226da-9694-404b-a332-ae7850d558d6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:06.038399 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ff4226da-9694-404b-a332-ae7850d558d6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.097365 Apr 06 16:58:06.038977 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1255/2511] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:05 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:06.286394 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-55187b41-d16e-48c4-9cc5-5bb10bccf8d2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:06.286996 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-55187b41-d16e-48c4-9cc5-5bb10bccf8d2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:06.293404 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55187b41-d16e-48c4-9cc5-5bb10bccf8d2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:06.293944 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55187b41-d16e-48c4-9cc5-5bb10bccf8d2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:06.294710 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55187b41-d16e-48c4-9cc5-5bb10bccf8d2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:06.295140 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-55187b41-d16e-48c4-9cc5-5bb10bccf8d2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:06.431645 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-55187b41-d16e-48c4-9cc5-5bb10bccf8d2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:06.440971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-55187b41-d16e-48c4-9cc5-5bb10bccf8d2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.158625 Apr 06 16:58:06.441559 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1257/2512] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:06 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:07.044515 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-baac9200-ad61-40b5-9821-9fd19ed4d151 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:07.045205 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-baac9200-ad61-40b5-9821-9fd19ed4d151 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:07.052432 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-baac9200-ad61-40b5-9821-9fd19ed4d151 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:07.052915 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-baac9200-ad61-40b5-9821-9fd19ed4d151 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:07.053685 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-baac9200-ad61-40b5-9821-9fd19ed4d151 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:07.054116 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-baac9200-ad61-40b5-9821-9fd19ed4d151 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:07.055481 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-463cb8a4-77cd-45f5-b80f-cde60ed67247 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:07.056089 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-463cb8a4-77cd-45f5-b80f-cde60ed67247 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:07.062553 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-463cb8a4-77cd-45f5-b80f-cde60ed67247 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:07.062995 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-463cb8a4-77cd-45f5-b80f-cde60ed67247 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:07.063939 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-463cb8a4-77cd-45f5-b80f-cde60ed67247 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:07.064550 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-463cb8a4-77cd-45f5-b80f-cde60ed67247 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:07.129703 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-463cb8a4-77cd-45f5-b80f-cde60ed67247 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:07.140214 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-463cb8a4-77cd-45f5-b80f-cde60ed67247 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.088302 Apr 06 16:58:07.141067 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1258/2513] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:07 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:07.206088 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-baac9200-ad61-40b5-9821-9fd19ed4d151 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:07.214854 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-baac9200-ad61-40b5-9821-9fd19ed4d151 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:07.216348 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-baac9200-ad61-40b5-9821-9fd19ed4d151 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:07.217545 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-baac9200-ad61-40b5-9821-9fd19ed4d151 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.177034 Apr 06 16:58:07.218106 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1256/2514] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:07 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:07.459072 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-569fde47-b3bb-4ed0-ba0f-daa4b1d12028 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:07.459670 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-569fde47-b3bb-4ed0-ba0f-daa4b1d12028 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:07.466589 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-569fde47-b3bb-4ed0-ba0f-daa4b1d12028 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:07.467030 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-569fde47-b3bb-4ed0-ba0f-daa4b1d12028 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:07.467790 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-569fde47-b3bb-4ed0-ba0f-daa4b1d12028 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:07.468219 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-569fde47-b3bb-4ed0-ba0f-daa4b1d12028 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:07.612459 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-569fde47-b3bb-4ed0-ba0f-daa4b1d12028 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:07.621189 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-569fde47-b3bb-4ed0-ba0f-daa4b1d12028 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.166376 Apr 06 16:58:07.621791 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1259/2515] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:07 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:08.161496 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-804b41d8-36fb-4646-a5ac-79f52629f563 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:08.162337 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-804b41d8-36fb-4646-a5ac-79f52629f563 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:08.168865 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-804b41d8-36fb-4646-a5ac-79f52629f563 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:08.169319 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-804b41d8-36fb-4646-a5ac-79f52629f563 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:08.170118 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-804b41d8-36fb-4646-a5ac-79f52629f563 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:08.170563 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-804b41d8-36fb-4646-a5ac-79f52629f563 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:08.237000 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-812e8c05-c9d4-4672-ac62-3af760a0cb0b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:08.237615 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-812e8c05-c9d4-4672-ac62-3af760a0cb0b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:08.239277 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-804b41d8-36fb-4646-a5ac-79f52629f563 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:08.244424 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-812e8c05-c9d4-4672-ac62-3af760a0cb0b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:08.244914 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-812e8c05-c9d4-4672-ac62-3af760a0cb0b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:08.245738 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-812e8c05-c9d4-4672-ac62-3af760a0cb0b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:08.246174 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-812e8c05-c9d4-4672-ac62-3af760a0cb0b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:08.247439 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-804b41d8-36fb-4646-a5ac-79f52629f563 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.090702 Apr 06 16:58:08.247991 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1257/2516] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:08 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:08.385200 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-812e8c05-c9d4-4672-ac62-3af760a0cb0b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:08.394388 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-812e8c05-c9d4-4672-ac62-3af760a0cb0b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:08.395895 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-812e8c05-c9d4-4672-ac62-3af760a0cb0b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:08.397122 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-812e8c05-c9d4-4672-ac62-3af760a0cb0b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.164519 Apr 06 16:58:08.397729 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1260/2517] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:08 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:08.638861 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8fcdb04d-8b2c-4df4-af00-59a21aa9d9b0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:08.639473 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8fcdb04d-8b2c-4df4-af00-59a21aa9d9b0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:08.645778 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fcdb04d-8b2c-4df4-af00-59a21aa9d9b0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:08.646225 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fcdb04d-8b2c-4df4-af00-59a21aa9d9b0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:08.647002 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fcdb04d-8b2c-4df4-af00-59a21aa9d9b0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:08.647436 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fcdb04d-8b2c-4df4-af00-59a21aa9d9b0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:08.806485 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8fcdb04d-8b2c-4df4-af00-59a21aa9d9b0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:08.816275 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8fcdb04d-8b2c-4df4-af00-59a21aa9d9b0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.181275 Apr 06 16:58:08.816897 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1258/2518] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:08 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:09.267203 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a855f009-ee12-4c28-a994-3e14d51928f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:09.267927 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a855f009-ee12-4c28-a994-3e14d51928f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:09.275256 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a855f009-ee12-4c28-a994-3e14d51928f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:09.275704 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a855f009-ee12-4c28-a994-3e14d51928f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:09.276475 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a855f009-ee12-4c28-a994-3e14d51928f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:09.276952 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a855f009-ee12-4c28-a994-3e14d51928f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:09.350786 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a855f009-ee12-4c28-a994-3e14d51928f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:09.360607 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a855f009-ee12-4c28-a994-3e14d51928f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.099309 Apr 06 16:58:09.361403 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1261/2519] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:09 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:09.419710 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1bc9d087-3180-4619-9cee-4bb8d2be2cf3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:09.420330 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1bc9d087-3180-4619-9cee-4bb8d2be2cf3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:09.427363 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1bc9d087-3180-4619-9cee-4bb8d2be2cf3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:09.427841 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1bc9d087-3180-4619-9cee-4bb8d2be2cf3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:09.428621 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1bc9d087-3180-4619-9cee-4bb8d2be2cf3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:09.429085 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1bc9d087-3180-4619-9cee-4bb8d2be2cf3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:09.574264 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1bc9d087-3180-4619-9cee-4bb8d2be2cf3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:09.582712 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1bc9d087-3180-4619-9cee-4bb8d2be2cf3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:09.584201 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1bc9d087-3180-4619-9cee-4bb8d2be2cf3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:09.585378 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1bc9d087-3180-4619-9cee-4bb8d2be2cf3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.169661 Apr 06 16:58:09.585948 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1259/2520] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:09 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:09.837746 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-90223053-77ed-4c85-b98e-bc228d117168 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:09.838386 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-90223053-77ed-4c85-b98e-bc228d117168 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:09.845670 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90223053-77ed-4c85-b98e-bc228d117168 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:09.846123 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90223053-77ed-4c85-b98e-bc228d117168 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:09.846895 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90223053-77ed-4c85-b98e-bc228d117168 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:09.847346 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90223053-77ed-4c85-b98e-bc228d117168 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:09.995759 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-90223053-77ed-4c85-b98e-bc228d117168 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:10.008535 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-90223053-77ed-4c85-b98e-bc228d117168 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.176277 Apr 06 16:58:10.009633 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1262/2521] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:09 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:10.378551 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3e2bac4a-f4e9-4a72-88cd-dcc76cf95bac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:10.379162 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3e2bac4a-f4e9-4a72-88cd-dcc76cf95bac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:10.385985 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e2bac4a-f4e9-4a72-88cd-dcc76cf95bac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:10.386437 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e2bac4a-f4e9-4a72-88cd-dcc76cf95bac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:10.387210 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e2bac4a-f4e9-4a72-88cd-dcc76cf95bac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:10.387644 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e2bac4a-f4e9-4a72-88cd-dcc76cf95bac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:10.447861 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3e2bac4a-f4e9-4a72-88cd-dcc76cf95bac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:10.456024 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3e2bac4a-f4e9-4a72-88cd-dcc76cf95bac tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.081645 Apr 06 16:58:10.456596 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1260/2522] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:10 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:10.604953 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-71e58146-595b-4291-9a6e-68f21eeff058 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:10.605524 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-71e58146-595b-4291-9a6e-68f21eeff058 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:10.612636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71e58146-595b-4291-9a6e-68f21eeff058 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:10.613122 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71e58146-595b-4291-9a6e-68f21eeff058 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:10.613889 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71e58146-595b-4291-9a6e-68f21eeff058 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:10.614317 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-71e58146-595b-4291-9a6e-68f21eeff058 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:10.759937 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-71e58146-595b-4291-9a6e-68f21eeff058 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:10.769311 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-71e58146-595b-4291-9a6e-68f21eeff058 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:10.770790 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-71e58146-595b-4291-9a6e-68f21eeff058 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:10.771943 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-71e58146-595b-4291-9a6e-68f21eeff058 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.171436 Apr 06 16:58:10.772502 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1263/2523] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:10 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:11.033823 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c56d5e90-b009-4e29-ad04-0474cdd3e0e4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:11.034433 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c56d5e90-b009-4e29-ad04-0474cdd3e0e4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:11.041101 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c56d5e90-b009-4e29-ad04-0474cdd3e0e4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:11.041557 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c56d5e90-b009-4e29-ad04-0474cdd3e0e4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:11.042329 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c56d5e90-b009-4e29-ad04-0474cdd3e0e4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:11.042761 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c56d5e90-b009-4e29-ad04-0474cdd3e0e4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:11.197577 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c56d5e90-b009-4e29-ad04-0474cdd3e0e4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:11.206318 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c56d5e90-b009-4e29-ad04-0474cdd3e0e4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.178035 Apr 06 16:58:11.207028 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1261/2524] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:11 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:11.473749 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-83938ea9-787a-4b8c-9922-0cbeefb1e570 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:11.474250 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-83938ea9-787a-4b8c-9922-0cbeefb1e570 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:11.481170 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83938ea9-787a-4b8c-9922-0cbeefb1e570 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:11.481618 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83938ea9-787a-4b8c-9922-0cbeefb1e570 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:11.482364 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83938ea9-787a-4b8c-9922-0cbeefb1e570 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:11.482820 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83938ea9-787a-4b8c-9922-0cbeefb1e570 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:11.550910 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-83938ea9-787a-4b8c-9922-0cbeefb1e570 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:11.559628 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-83938ea9-787a-4b8c-9922-0cbeefb1e570 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.089977 Apr 06 16:58:11.560214 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1264/2525] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:11 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:11.794264 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-77dd1810-6691-4cd1-910b-833682d1820a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:11.795148 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-77dd1810-6691-4cd1-910b-833682d1820a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:11.804107 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-77dd1810-6691-4cd1-910b-833682d1820a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:11.804581 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-77dd1810-6691-4cd1-910b-833682d1820a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:11.808721 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-77dd1810-6691-4cd1-910b-833682d1820a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:11.808721 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-77dd1810-6691-4cd1-910b-833682d1820a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:11.960395 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-77dd1810-6691-4cd1-910b-833682d1820a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:11.972735 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-77dd1810-6691-4cd1-910b-833682d1820a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:11.974218 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-77dd1810-6691-4cd1-910b-833682d1820a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:11.975372 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-77dd1810-6691-4cd1-910b-833682d1820a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.188144 Apr 06 16:58:11.975966 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1262/2526] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:11 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:12.224327 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b081640a-2a51-41ac-aafc-f75ea0116c1b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:12.224970 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b081640a-2a51-41ac-aafc-f75ea0116c1b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:12.232038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b081640a-2a51-41ac-aafc-f75ea0116c1b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:12.232477 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b081640a-2a51-41ac-aafc-f75ea0116c1b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:12.233259 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b081640a-2a51-41ac-aafc-f75ea0116c1b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:12.233691 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b081640a-2a51-41ac-aafc-f75ea0116c1b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:12.376332 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b081640a-2a51-41ac-aafc-f75ea0116c1b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:12.385103 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b081640a-2a51-41ac-aafc-f75ea0116c1b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.164799 Apr 06 16:58:12.385680 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1265/2527] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:12 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:12.578059 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8cfd5452-1069-4ede-a898-77e556077028 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:12.578570 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8cfd5452-1069-4ede-a898-77e556077028 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:12.589886 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cfd5452-1069-4ede-a898-77e556077028 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:12.590457 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cfd5452-1069-4ede-a898-77e556077028 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:12.592118 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cfd5452-1069-4ede-a898-77e556077028 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:12.593201 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cfd5452-1069-4ede-a898-77e556077028 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:12.666975 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8cfd5452-1069-4ede-a898-77e556077028 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:12.675532 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8cfd5452-1069-4ede-a898-77e556077028 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.101488 Apr 06 16:58:12.676138 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1263/2528] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:12 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:12.997948 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d6b7fb00-9bf6-41f3-8850-f762b5d874e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:12.998551 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d6b7fb00-9bf6-41f3-8850-f762b5d874e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:13.005578 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6b7fb00-9bf6-41f3-8850-f762b5d874e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:13.006030 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6b7fb00-9bf6-41f3-8850-f762b5d874e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:13.006826 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6b7fb00-9bf6-41f3-8850-f762b5d874e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:13.007259 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d6b7fb00-9bf6-41f3-8850-f762b5d874e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:13.143786 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d6b7fb00-9bf6-41f3-8850-f762b5d874e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:13.152676 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d6b7fb00-9bf6-41f3-8850-f762b5d874e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:13.154214 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d6b7fb00-9bf6-41f3-8850-f762b5d874e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:13.155363 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d6b7fb00-9bf6-41f3-8850-f762b5d874e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.161497 Apr 06 16:58:13.155926 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1266/2529] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:12 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:13.402697 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-28f91d93-d69a-495b-9c7e-117d26ba04e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:13.403256 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-28f91d93-d69a-495b-9c7e-117d26ba04e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:13.410338 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28f91d93-d69a-495b-9c7e-117d26ba04e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:13.410787 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28f91d93-d69a-495b-9c7e-117d26ba04e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:13.411566 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28f91d93-d69a-495b-9c7e-117d26ba04e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:13.412030 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28f91d93-d69a-495b-9c7e-117d26ba04e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:13.559119 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-28f91d93-d69a-495b-9c7e-117d26ba04e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:13.572301 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-28f91d93-d69a-495b-9c7e-117d26ba04e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.173261 Apr 06 16:58:13.573217 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1264/2530] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:13 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:13.693617 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-80dec5e8-b9f8-4c62-a758-35b078b86769 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:13.694209 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-80dec5e8-b9f8-4c62-a758-35b078b86769 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:13.700718 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80dec5e8-b9f8-4c62-a758-35b078b86769 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:13.701158 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80dec5e8-b9f8-4c62-a758-35b078b86769 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:13.704266 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80dec5e8-b9f8-4c62-a758-35b078b86769 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:13.704266 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-80dec5e8-b9f8-4c62-a758-35b078b86769 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:13.769979 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-80dec5e8-b9f8-4c62-a758-35b078b86769 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:13.778596 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-80dec5e8-b9f8-4c62-a758-35b078b86769 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.088942 Apr 06 16:58:13.779186 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1267/2531] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:13 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:14.177450 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cb6062aa-a8d9-458f-9265-2097328da380 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:14.178148 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cb6062aa-a8d9-458f-9265-2097328da380 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:14.184735 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb6062aa-a8d9-458f-9265-2097328da380 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:14.185165 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb6062aa-a8d9-458f-9265-2097328da380 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:14.185967 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb6062aa-a8d9-458f-9265-2097328da380 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:14.186403 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb6062aa-a8d9-458f-9265-2097328da380 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:14.330678 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cb6062aa-a8d9-458f-9265-2097328da380 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:14.339649 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cb6062aa-a8d9-458f-9265-2097328da380 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:14.341192 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cb6062aa-a8d9-458f-9265-2097328da380 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:14.342463 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cb6062aa-a8d9-458f-9265-2097328da380 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.169734 Apr 06 16:58:14.342993 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1265/2532] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:14 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:14.592105 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-01b68a82-24f0-4314-967e-417a1df84627 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:14.592610 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-01b68a82-24f0-4314-967e-417a1df84627 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:14.600786 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01b68a82-24f0-4314-967e-417a1df84627 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:14.601296 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01b68a82-24f0-4314-967e-417a1df84627 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:14.602621 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01b68a82-24f0-4314-967e-417a1df84627 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:14.603202 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01b68a82-24f0-4314-967e-417a1df84627 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:14.747167 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-01b68a82-24f0-4314-967e-417a1df84627 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:14.755845 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-01b68a82-24f0-4314-967e-417a1df84627 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.167783 Apr 06 16:58:14.755845 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1268/2533] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:14 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:14.797989 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e0792c83-31d0-4711-b5f9-817e8e57b039 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:14.798777 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e0792c83-31d0-4711-b5f9-817e8e57b039 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:14.807002 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0792c83-31d0-4711-b5f9-817e8e57b039 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:14.807421 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0792c83-31d0-4711-b5f9-817e8e57b039 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:14.808229 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0792c83-31d0-4711-b5f9-817e8e57b039 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:14.808665 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0792c83-31d0-4711-b5f9-817e8e57b039 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:14.879304 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e0792c83-31d0-4711-b5f9-817e8e57b039 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:14.889763 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e0792c83-31d0-4711-b5f9-817e8e57b039 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.097852 Apr 06 16:58:14.890356 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1266/2534] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:14 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:15.361732 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-20495f43-c354-43d9-ace9-28d408bf7f90 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:15.362341 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-20495f43-c354-43d9-ace9-28d408bf7f90 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:15.369223 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20495f43-c354-43d9-ace9-28d408bf7f90 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:15.369674 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20495f43-c354-43d9-ace9-28d408bf7f90 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:15.370437 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20495f43-c354-43d9-ace9-28d408bf7f90 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:15.370871 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-20495f43-c354-43d9-ace9-28d408bf7f90 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:15.504838 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-20495f43-c354-43d9-ace9-28d408bf7f90 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:15.513783 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-20495f43-c354-43d9-ace9-28d408bf7f90 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:15.515284 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-20495f43-c354-43d9-ace9-28d408bf7f90 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:15.516865 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-20495f43-c354-43d9-ace9-28d408bf7f90 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.158832 Apr 06 16:58:15.517431 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1269/2535] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:15 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:15.774109 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-74a98f81-2b89-4e7e-b083-019cb649283a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:15.774719 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-74a98f81-2b89-4e7e-b083-019cb649283a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:15.781262 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74a98f81-2b89-4e7e-b083-019cb649283a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:15.781712 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74a98f81-2b89-4e7e-b083-019cb649283a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:15.782470 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74a98f81-2b89-4e7e-b083-019cb649283a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:15.782903 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74a98f81-2b89-4e7e-b083-019cb649283a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:15.907077 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6f2f8fb5-9caa-4e7d-9b81-f5b01433e243 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:15.907706 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6f2f8fb5-9caa-4e7d-9b81-f5b01433e243 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:15.915065 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f2f8fb5-9caa-4e7d-9b81-f5b01433e243 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:15.915478 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f2f8fb5-9caa-4e7d-9b81-f5b01433e243 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:15.916235 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f2f8fb5-9caa-4e7d-9b81-f5b01433e243 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:15.916807 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f2f8fb5-9caa-4e7d-9b81-f5b01433e243 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:15.927541 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-74a98f81-2b89-4e7e-b083-019cb649283a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:15.936057 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-74a98f81-2b89-4e7e-b083-019cb649283a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.166185 Apr 06 16:58:15.936742 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1267/2536] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:15 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:15.981478 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6f2f8fb5-9caa-4e7d-9b81-f5b01433e243 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:15.989807 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6f2f8fb5-9caa-4e7d-9b81-f5b01433e243 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086621 Apr 06 16:58:15.990385 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1270/2537] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:15 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:16.538016 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4e6dcd27-c46d-4233-bd45-ed949d3cd840 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:16.538617 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4e6dcd27-c46d-4233-bd45-ed949d3cd840 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:16.545097 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e6dcd27-c46d-4233-bd45-ed949d3cd840 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:16.545550 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e6dcd27-c46d-4233-bd45-ed949d3cd840 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:16.546303 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e6dcd27-c46d-4233-bd45-ed949d3cd840 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:16.546736 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e6dcd27-c46d-4233-bd45-ed949d3cd840 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:16.700062 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4e6dcd27-c46d-4233-bd45-ed949d3cd840 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:16.709054 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4e6dcd27-c46d-4233-bd45-ed949d3cd840 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:16.710549 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4e6dcd27-c46d-4233-bd45-ed949d3cd840 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:16.711712 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4e6dcd27-c46d-4233-bd45-ed949d3cd840 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.178723 Apr 06 16:58:16.712272 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1268/2538] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:16 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:16.953375 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5455c164-be0c-4647-a9f6-7d0f460907e2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:16.953944 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5455c164-be0c-4647-a9f6-7d0f460907e2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:16.961466 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5455c164-be0c-4647-a9f6-7d0f460907e2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:16.961910 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5455c164-be0c-4647-a9f6-7d0f460907e2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:16.962672 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5455c164-be0c-4647-a9f6-7d0f460907e2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:16.963100 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5455c164-be0c-4647-a9f6-7d0f460907e2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:17.008258 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0a1265b5-a7e9-4961-a597-e06abec3e2e9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:17.009024 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0a1265b5-a7e9-4961-a597-e06abec3e2e9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:17.017172 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a1265b5-a7e9-4961-a597-e06abec3e2e9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:17.017622 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a1265b5-a7e9-4961-a597-e06abec3e2e9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:17.018418 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a1265b5-a7e9-4961-a597-e06abec3e2e9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:17.018848 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a1265b5-a7e9-4961-a597-e06abec3e2e9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:17.081067 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0a1265b5-a7e9-4961-a597-e06abec3e2e9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:17.089817 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0a1265b5-a7e9-4961-a597-e06abec3e2e9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.085780 Apr 06 16:58:17.090420 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1269/2539] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:17 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:17.120070 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5455c164-be0c-4647-a9f6-7d0f460907e2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:17.128541 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5455c164-be0c-4647-a9f6-7d0f460907e2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.179100 Apr 06 16:58:17.129175 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1271/2540] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:16 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:17.731115 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cabd9065-5eea-43ab-8c4c-c2c4ed0467ce tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:17.731725 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cabd9065-5eea-43ab-8c4c-c2c4ed0467ce tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:17.738382 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cabd9065-5eea-43ab-8c4c-c2c4ed0467ce tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:17.739274 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cabd9065-5eea-43ab-8c4c-c2c4ed0467ce tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:17.740077 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cabd9065-5eea-43ab-8c4c-c2c4ed0467ce tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:17.740516 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cabd9065-5eea-43ab-8c4c-c2c4ed0467ce tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:17.880489 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cabd9065-5eea-43ab-8c4c-c2c4ed0467ce tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:17.892034 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cabd9065-5eea-43ab-8c4c-c2c4ed0467ce tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:17.893786 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cabd9065-5eea-43ab-8c4c-c2c4ed0467ce tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:17.894986 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cabd9065-5eea-43ab-8c4c-c2c4ed0467ce tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.168258 Apr 06 16:58:17.895987 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1270/2541] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:17 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:18.111825 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-962a9af1-8582-4fd2-9cdd-1aff8add50ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:18.112439 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-962a9af1-8582-4fd2-9cdd-1aff8add50ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:18.119650 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-962a9af1-8582-4fd2-9cdd-1aff8add50ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:18.120107 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-962a9af1-8582-4fd2-9cdd-1aff8add50ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:18.120933 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-962a9af1-8582-4fd2-9cdd-1aff8add50ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:18.121367 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-962a9af1-8582-4fd2-9cdd-1aff8add50ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:18.147502 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e28aaeae-1533-4139-8a6c-ea67a806443f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:18.148115 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e28aaeae-1533-4139-8a6c-ea67a806443f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:18.155063 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e28aaeae-1533-4139-8a6c-ea67a806443f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:18.155419 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e28aaeae-1533-4139-8a6c-ea67a806443f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:18.156206 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e28aaeae-1533-4139-8a6c-ea67a806443f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:18.156643 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e28aaeae-1533-4139-8a6c-ea67a806443f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:18.185853 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-962a9af1-8582-4fd2-9cdd-1aff8add50ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:18.195033 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-962a9af1-8582-4fd2-9cdd-1aff8add50ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.087147 Apr 06 16:58:18.195620 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1272/2542] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:18 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:18.297559 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e28aaeae-1533-4139-8a6c-ea67a806443f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:18.306596 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e28aaeae-1533-4139-8a6c-ea67a806443f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.163275 Apr 06 16:58:18.307170 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1271/2543] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:18 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:18.914560 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-938ff359-3d66-4af9-91da-9fc136118767 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:18.915190 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-938ff359-3d66-4af9-91da-9fc136118767 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:18.922356 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-938ff359-3d66-4af9-91da-9fc136118767 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:18.922839 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-938ff359-3d66-4af9-91da-9fc136118767 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:18.923627 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-938ff359-3d66-4af9-91da-9fc136118767 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:18.924064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-938ff359-3d66-4af9-91da-9fc136118767 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:19.072186 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-938ff359-3d66-4af9-91da-9fc136118767 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:19.081764 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-938ff359-3d66-4af9-91da-9fc136118767 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:19.083461 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-938ff359-3d66-4af9-91da-9fc136118767 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:19.084720 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-938ff359-3d66-4af9-91da-9fc136118767 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.174536 Apr 06 16:58:19.085324 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1273/2544] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:18 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:19.212050 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ccdfef80-6d89-4824-a6b6-b5f3fd8718c7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:19.212637 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ccdfef80-6d89-4824-a6b6-b5f3fd8718c7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:19.219617 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccdfef80-6d89-4824-a6b6-b5f3fd8718c7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:19.220071 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccdfef80-6d89-4824-a6b6-b5f3fd8718c7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:19.220913 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccdfef80-6d89-4824-a6b6-b5f3fd8718c7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:19.221348 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccdfef80-6d89-4824-a6b6-b5f3fd8718c7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:19.284043 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ccdfef80-6d89-4824-a6b6-b5f3fd8718c7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:19.293002 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ccdfef80-6d89-4824-a6b6-b5f3fd8718c7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.085005 Apr 06 16:58:19.293603 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1272/2545] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:19 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:19.324307 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-58b50609-4b33-4fc9-a7f2-e5162dd72251 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:19.324947 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-58b50609-4b33-4fc9-a7f2-e5162dd72251 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:19.332229 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58b50609-4b33-4fc9-a7f2-e5162dd72251 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:19.332742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58b50609-4b33-4fc9-a7f2-e5162dd72251 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:19.333944 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58b50609-4b33-4fc9-a7f2-e5162dd72251 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:19.334396 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58b50609-4b33-4fc9-a7f2-e5162dd72251 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:19.481946 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-58b50609-4b33-4fc9-a7f2-e5162dd72251 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:19.490475 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-58b50609-4b33-4fc9-a7f2-e5162dd72251 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.170106 Apr 06 16:58:19.494240 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1274/2546] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:19 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:20.104429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f559084b-fafa-45e7-aac6-6003ff910b70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:20.105114 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f559084b-fafa-45e7-aac6-6003ff910b70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:20.111978 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f559084b-fafa-45e7-aac6-6003ff910b70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:20.112431 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f559084b-fafa-45e7-aac6-6003ff910b70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:20.113317 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f559084b-fafa-45e7-aac6-6003ff910b70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:20.113805 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f559084b-fafa-45e7-aac6-6003ff910b70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:20.261678 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f559084b-fafa-45e7-aac6-6003ff910b70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:20.270415 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f559084b-fafa-45e7-aac6-6003ff910b70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:20.272077 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f559084b-fafa-45e7-aac6-6003ff910b70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:20.273289 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f559084b-fafa-45e7-aac6-6003ff910b70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.173342 Apr 06 16:58:20.273862 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1273/2547] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:20 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:20.311202 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6b529d57-3bc6-4719-965f-eb54468fe60c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:20.311725 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6b529d57-3bc6-4719-965f-eb54468fe60c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:20.318808 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b529d57-3bc6-4719-965f-eb54468fe60c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:20.319241 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b529d57-3bc6-4719-965f-eb54468fe60c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:20.320016 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b529d57-3bc6-4719-965f-eb54468fe60c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:20.320443 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b529d57-3bc6-4719-965f-eb54468fe60c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:20.385681 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6b529d57-3bc6-4719-965f-eb54468fe60c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:20.394682 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6b529d57-3bc6-4719-965f-eb54468fe60c tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.087476 Apr 06 16:58:20.395264 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1275/2548] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:20 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:20.508441 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f6c58de4-ad28-4d98-82fa-c9f17df09d21 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:20.509076 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f6c58de4-ad28-4d98-82fa-c9f17df09d21 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:20.515564 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f6c58de4-ad28-4d98-82fa-c9f17df09d21 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:20.516008 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f6c58de4-ad28-4d98-82fa-c9f17df09d21 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:20.516804 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f6c58de4-ad28-4d98-82fa-c9f17df09d21 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:20.517240 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f6c58de4-ad28-4d98-82fa-c9f17df09d21 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:20.657694 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f6c58de4-ad28-4d98-82fa-c9f17df09d21 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:20.669281 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f6c58de4-ad28-4d98-82fa-c9f17df09d21 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.164938 Apr 06 16:58:20.669880 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1274/2549] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:20 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:21.292538 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f8d5f484-6c4e-47d2-a844-bb038f8f2379 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:21.293075 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f8d5f484-6c4e-47d2-a844-bb038f8f2379 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:21.299852 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8d5f484-6c4e-47d2-a844-bb038f8f2379 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:21.300300 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8d5f484-6c4e-47d2-a844-bb038f8f2379 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:21.301127 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8d5f484-6c4e-47d2-a844-bb038f8f2379 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:21.301837 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f8d5f484-6c4e-47d2-a844-bb038f8f2379 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:21.411716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-db2902c9-cc49-4cd2-97d6-c48cc2ea5b37 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:21.412375 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-db2902c9-cc49-4cd2-97d6-c48cc2ea5b37 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:21.418941 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db2902c9-cc49-4cd2-97d6-c48cc2ea5b37 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:21.419357 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db2902c9-cc49-4cd2-97d6-c48cc2ea5b37 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:21.420370 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db2902c9-cc49-4cd2-97d6-c48cc2ea5b37 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:21.420862 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db2902c9-cc49-4cd2-97d6-c48cc2ea5b37 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:21.453056 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f8d5f484-6c4e-47d2-a844-bb038f8f2379 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:21.462992 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f8d5f484-6c4e-47d2-a844-bb038f8f2379 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:21.464658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f8d5f484-6c4e-47d2-a844-bb038f8f2379 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:21.466147 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f8d5f484-6c4e-47d2-a844-bb038f8f2379 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.177796 Apr 06 16:58:21.466751 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1276/2550] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:21 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:21.488097 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-db2902c9-cc49-4cd2-97d6-c48cc2ea5b37 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:21.496550 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-db2902c9-cc49-4cd2-97d6-c48cc2ea5b37 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.088855 Apr 06 16:58:21.497212 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1275/2551] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:21 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:21.687801 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-81d78cf0-4f45-4ff8-a7f4-e6a3ba9259cc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:21.688408 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-81d78cf0-4f45-4ff8-a7f4-e6a3ba9259cc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:21.695372 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81d78cf0-4f45-4ff8-a7f4-e6a3ba9259cc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:21.695832 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81d78cf0-4f45-4ff8-a7f4-e6a3ba9259cc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:21.696608 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81d78cf0-4f45-4ff8-a7f4-e6a3ba9259cc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:21.697075 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81d78cf0-4f45-4ff8-a7f4-e6a3ba9259cc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:21.844367 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-81d78cf0-4f45-4ff8-a7f4-e6a3ba9259cc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:21.853506 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-81d78cf0-4f45-4ff8-a7f4-e6a3ba9259cc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.169581 Apr 06 16:58:21.854103 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1277/2552] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:21 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:22.486085 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-81373ea5-c1f5-44b6-9ce9-97856aeddadf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:22.486706 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-81373ea5-c1f5-44b6-9ce9-97856aeddadf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:22.493459 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81373ea5-c1f5-44b6-9ce9-97856aeddadf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:22.493931 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81373ea5-c1f5-44b6-9ce9-97856aeddadf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:22.494722 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81373ea5-c1f5-44b6-9ce9-97856aeddadf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:22.495149 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81373ea5-c1f5-44b6-9ce9-97856aeddadf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:22.514398 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-04e3320f-9163-472b-9c36-61fa22bb41d5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:22.515060 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-04e3320f-9163-472b-9c36-61fa22bb41d5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:22.522362 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04e3320f-9163-472b-9c36-61fa22bb41d5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:22.522793 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04e3320f-9163-472b-9c36-61fa22bb41d5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:22.523641 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04e3320f-9163-472b-9c36-61fa22bb41d5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:22.524118 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-04e3320f-9163-472b-9c36-61fa22bb41d5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:22.589876 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-04e3320f-9163-472b-9c36-61fa22bb41d5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:22.600343 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-04e3320f-9163-472b-9c36-61fa22bb41d5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.090128 Apr 06 16:58:22.601001 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1278/2553] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:22 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:22.811996 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-81373ea5-c1f5-44b6-9ce9-97856aeddadf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:22.821367 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-81373ea5-c1f5-44b6-9ce9-97856aeddadf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:22.823777 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-81373ea5-c1f5-44b6-9ce9-97856aeddadf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:22.825719 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-81373ea5-c1f5-44b6-9ce9-97856aeddadf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.343707 Apr 06 16:58:22.826585 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1276/2554] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:22 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:22.870905 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f4566b88-2bc1-40c0-9780-597b0cf0e7ed tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:22.871504 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f4566b88-2bc1-40c0-9780-597b0cf0e7ed tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:22.879055 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4566b88-2bc1-40c0-9780-597b0cf0e7ed tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:22.879589 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4566b88-2bc1-40c0-9780-597b0cf0e7ed tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:22.880870 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4566b88-2bc1-40c0-9780-597b0cf0e7ed tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:22.881584 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f4566b88-2bc1-40c0-9780-597b0cf0e7ed tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:23.036269 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f4566b88-2bc1-40c0-9780-597b0cf0e7ed tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:23.052961 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f4566b88-2bc1-40c0-9780-597b0cf0e7ed tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.185718 Apr 06 16:58:23.053522 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1279/2555] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:22 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:23.622457 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-99a2613c-d541-43a9-a5e6-09956cb3bee9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:23.623386 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-99a2613c-d541-43a9-a5e6-09956cb3bee9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:23.634033 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99a2613c-d541-43a9-a5e6-09956cb3bee9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:23.634783 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99a2613c-d541-43a9-a5e6-09956cb3bee9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:23.636043 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99a2613c-d541-43a9-a5e6-09956cb3bee9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:23.636776 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99a2613c-d541-43a9-a5e6-09956cb3bee9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:23.703669 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-99a2613c-d541-43a9-a5e6-09956cb3bee9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:23.712601 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-99a2613c-d541-43a9-a5e6-09956cb3bee9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.096677 Apr 06 16:58:23.713208 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1277/2556] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:23 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:23.851115 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0f68a769-0ede-49fa-9e8a-ad8d02e624bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:23.852075 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0f68a769-0ede-49fa-9e8a-ad8d02e624bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:23.862963 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f68a769-0ede-49fa-9e8a-ad8d02e624bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:23.863688 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f68a769-0ede-49fa-9e8a-ad8d02e624bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:23.865076 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f68a769-0ede-49fa-9e8a-ad8d02e624bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:23.865632 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f68a769-0ede-49fa-9e8a-ad8d02e624bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:24.004243 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0f68a769-0ede-49fa-9e8a-ad8d02e624bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:24.013649 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0f68a769-0ede-49fa-9e8a-ad8d02e624bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:24.015128 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0f68a769-0ede-49fa-9e8a-ad8d02e624bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:24.016274 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0f68a769-0ede-49fa-9e8a-ad8d02e624bc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.172159 Apr 06 16:58:24.016872 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1280/2557] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:23 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:24.072102 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e1d64cbe-cc34-4cc7-8887-dee99c7907cc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:24.072717 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e1d64cbe-cc34-4cc7-8887-dee99c7907cc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:24.079058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1d64cbe-cc34-4cc7-8887-dee99c7907cc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:24.079499 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1d64cbe-cc34-4cc7-8887-dee99c7907cc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:24.080258 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1d64cbe-cc34-4cc7-8887-dee99c7907cc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:24.080711 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1d64cbe-cc34-4cc7-8887-dee99c7907cc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:24.236856 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e1d64cbe-cc34-4cc7-8887-dee99c7907cc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:24.246913 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e1d64cbe-cc34-4cc7-8887-dee99c7907cc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.179494 Apr 06 16:58:24.247700 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1278/2558] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:24 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:24.734650 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3b3be60b-324b-4804-80bd-307adac2d404 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:24.735370 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3b3be60b-324b-4804-80bd-307adac2d404 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:24.742804 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b3be60b-324b-4804-80bd-307adac2d404 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:24.743354 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b3be60b-324b-4804-80bd-307adac2d404 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:24.744223 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b3be60b-324b-4804-80bd-307adac2d404 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:24.744741 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b3be60b-324b-4804-80bd-307adac2d404 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:24.812345 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3b3be60b-324b-4804-80bd-307adac2d404 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:24.826600 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3b3be60b-324b-4804-80bd-307adac2d404 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.099143 Apr 06 16:58:24.827203 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1281/2559] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:24 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:25.038017 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1691d6c7-614a-4840-8d2a-9ff8650335f0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:25.038623 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1691d6c7-614a-4840-8d2a-9ff8650335f0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:25.045875 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1691d6c7-614a-4840-8d2a-9ff8650335f0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:25.046366 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1691d6c7-614a-4840-8d2a-9ff8650335f0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:25.047144 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1691d6c7-614a-4840-8d2a-9ff8650335f0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:25.047591 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1691d6c7-614a-4840-8d2a-9ff8650335f0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:25.198032 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1691d6c7-614a-4840-8d2a-9ff8650335f0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:25.207203 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1691d6c7-614a-4840-8d2a-9ff8650335f0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:25.208749 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1691d6c7-614a-4840-8d2a-9ff8650335f0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:25.210008 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1691d6c7-614a-4840-8d2a-9ff8650335f0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.177899 Apr 06 16:58:25.210556 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1279/2560] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:25 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:25.271080 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bb93f58d-5c0f-44cf-b57d-bc5008f073e7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:25.272009 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bb93f58d-5c0f-44cf-b57d-bc5008f073e7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:25.279307 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb93f58d-5c0f-44cf-b57d-bc5008f073e7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:25.279765 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb93f58d-5c0f-44cf-b57d-bc5008f073e7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:25.280516 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb93f58d-5c0f-44cf-b57d-bc5008f073e7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:25.280999 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bb93f58d-5c0f-44cf-b57d-bc5008f073e7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:25.443101 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-bb93f58d-5c0f-44cf-b57d-bc5008f073e7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:25.451882 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bb93f58d-5c0f-44cf-b57d-bc5008f073e7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.187535 Apr 06 16:58:25.452456 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1282/2561] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:25 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:25.850430 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a2df1ab2-3ff9-4a9d-8469-6a3308518ae3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:25.852254 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a2df1ab2-3ff9-4a9d-8469-6a3308518ae3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:25.863976 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2df1ab2-3ff9-4a9d-8469-6a3308518ae3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:25.864776 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2df1ab2-3ff9-4a9d-8469-6a3308518ae3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:25.866271 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2df1ab2-3ff9-4a9d-8469-6a3308518ae3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:25.866990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2df1ab2-3ff9-4a9d-8469-6a3308518ae3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:25.881679 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 16:58:25.882007 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 16:58:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c (ip 10.222.0.64) !!! Apr 06 16:58:25.938768 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a2df1ab2-3ff9-4a9d-8469-6a3308518ae3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:25.947423 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a2df1ab2-3ff9-4a9d-8469-6a3308518ae3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.104130 Apr 06 16:58:25.947983 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1280/2562] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:25 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:26.230965 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ff46399c-0d11-41c9-a9bf-ab8fdaad1d6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:26.232260 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ff46399c-0d11-41c9-a9bf-ab8fdaad1d6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:26.239371 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff46399c-0d11-41c9-a9bf-ab8fdaad1d6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:26.239837 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff46399c-0d11-41c9-a9bf-ab8fdaad1d6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:26.240644 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff46399c-0d11-41c9-a9bf-ab8fdaad1d6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:26.241131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff46399c-0d11-41c9-a9bf-ab8fdaad1d6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:26.382263 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ff46399c-0d11-41c9-a9bf-ab8fdaad1d6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:26.391369 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ff46399c-0d11-41c9-a9bf-ab8fdaad1d6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:26.392891 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ff46399c-0d11-41c9-a9bf-ab8fdaad1d6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:26.394095 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ff46399c-0d11-41c9-a9bf-ab8fdaad1d6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.167549 Apr 06 16:58:26.394653 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1283/2563] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:26 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:58:26.473229 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9c29bbe1-4a31-4a67-a18a-2e5733835279 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:26.474281 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9c29bbe1-4a31-4a67-a18a-2e5733835279 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:26.482432 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c29bbe1-4a31-4a67-a18a-2e5733835279 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:26.482852 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c29bbe1-4a31-4a67-a18a-2e5733835279 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:26.483649 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c29bbe1-4a31-4a67-a18a-2e5733835279 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:26.484088 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c29bbe1-4a31-4a67-a18a-2e5733835279 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:26.631055 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9c29bbe1-4a31-4a67-a18a-2e5733835279 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:26.642815 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9c29bbe1-4a31-4a67-a18a-2e5733835279 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.175880 Apr 06 16:58:26.643585 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1281/2564] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:26 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:26.966487 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-06fd296f-5232-471f-aaf2-248871550533 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:26.967204 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-06fd296f-5232-471f-aaf2-248871550533 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:26.974044 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06fd296f-5232-471f-aaf2-248871550533 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:26.974492 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06fd296f-5232-471f-aaf2-248871550533 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:26.975393 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06fd296f-5232-471f-aaf2-248871550533 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:26.976120 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06fd296f-5232-471f-aaf2-248871550533 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:27.059716 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-06fd296f-5232-471f-aaf2-248871550533 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:27.070043 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-06fd296f-5232-471f-aaf2-248871550533 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.107679 Apr 06 16:58:27.070984 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1284/2565] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:26 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:27.415781 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7fddeba2-38d0-46bc-8057-99fd25a35e55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:27.417277 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7fddeba2-38d0-46bc-8057-99fd25a35e55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:27.426275 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fddeba2-38d0-46bc-8057-99fd25a35e55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:27.426967 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fddeba2-38d0-46bc-8057-99fd25a35e55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:27.427863 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fddeba2-38d0-46bc-8057-99fd25a35e55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:27.428423 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fddeba2-38d0-46bc-8057-99fd25a35e55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:27.589591 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7fddeba2-38d0-46bc-8057-99fd25a35e55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:27.602611 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7fddeba2-38d0-46bc-8057-99fd25a35e55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:27.605580 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7fddeba2-38d0-46bc-8057-99fd25a35e55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:27.607538 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7fddeba2-38d0-46bc-8057-99fd25a35e55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.197035 Apr 06 16:58:27.608412 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1282/2566] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:27 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:27.662636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eeb5157f-8208-4fa7-a308-428c04395fde tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:27.663484 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eeb5157f-8208-4fa7-a308-428c04395fde tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:27.669879 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eeb5157f-8208-4fa7-a308-428c04395fde tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:27.670331 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eeb5157f-8208-4fa7-a308-428c04395fde tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:27.671096 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eeb5157f-8208-4fa7-a308-428c04395fde tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:27.671531 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eeb5157f-8208-4fa7-a308-428c04395fde tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:27.820865 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-eeb5157f-8208-4fa7-a308-428c04395fde tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:27.828672 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eeb5157f-8208-4fa7-a308-428c04395fde tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.170560 Apr 06 16:58:27.829265 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1285/2567] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:27 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:28.090898 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5d953c10-24e5-4c7c-9aa9-99aa054b2dd5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:28.091513 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5d953c10-24e5-4c7c-9aa9-99aa054b2dd5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:28.098498 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d953c10-24e5-4c7c-9aa9-99aa054b2dd5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:28.099009 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d953c10-24e5-4c7c-9aa9-99aa054b2dd5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:28.099815 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d953c10-24e5-4c7c-9aa9-99aa054b2dd5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:28.100296 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d953c10-24e5-4c7c-9aa9-99aa054b2dd5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:28.167709 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5d953c10-24e5-4c7c-9aa9-99aa054b2dd5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:28.175791 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5d953c10-24e5-4c7c-9aa9-99aa054b2dd5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.088923 Apr 06 16:58:28.176381 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1283/2568] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:28 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:28.634744 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-28e7db00-7df7-4f56-94df-5c23560ff592 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:28.635488 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-28e7db00-7df7-4f56-94df-5c23560ff592 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:28.643370 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28e7db00-7df7-4f56-94df-5c23560ff592 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:28.643929 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28e7db00-7df7-4f56-94df-5c23560ff592 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:28.644915 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28e7db00-7df7-4f56-94df-5c23560ff592 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:28.645455 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-28e7db00-7df7-4f56-94df-5c23560ff592 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:28.796011 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-28e7db00-7df7-4f56-94df-5c23560ff592 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:28.804745 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-28e7db00-7df7-4f56-94df-5c23560ff592 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:28.806219 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-28e7db00-7df7-4f56-94df-5c23560ff592 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:28.807397 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-28e7db00-7df7-4f56-94df-5c23560ff592 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.178978 Apr 06 16:58:28.807946 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1286/2569] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:28 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:28.846853 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fd6c25fe-b2c7-4adb-9572-7b5b2d424a11 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:28.847491 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fd6c25fe-b2c7-4adb-9572-7b5b2d424a11 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:28.854799 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd6c25fe-b2c7-4adb-9572-7b5b2d424a11 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:28.855253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd6c25fe-b2c7-4adb-9572-7b5b2d424a11 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:28.856023 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd6c25fe-b2c7-4adb-9572-7b5b2d424a11 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:28.856454 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd6c25fe-b2c7-4adb-9572-7b5b2d424a11 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:28.996103 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fd6c25fe-b2c7-4adb-9572-7b5b2d424a11 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:29.004006 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fd6c25fe-b2c7-4adb-9572-7b5b2d424a11 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.161047 Apr 06 16:58:29.004609 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1284/2570] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:28 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:29.196916 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e0ede02c-f4e7-40a8-b28c-6a6d1e23c5eb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:29.197460 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e0ede02c-f4e7-40a8-b28c-6a6d1e23c5eb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:29.204196 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0ede02c-f4e7-40a8-b28c-6a6d1e23c5eb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:29.204672 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0ede02c-f4e7-40a8-b28c-6a6d1e23c5eb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:29.205496 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0ede02c-f4e7-40a8-b28c-6a6d1e23c5eb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:29.205948 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e0ede02c-f4e7-40a8-b28c-6a6d1e23c5eb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:29.278461 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e0ede02c-f4e7-40a8-b28c-6a6d1e23c5eb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:29.288531 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e0ede02c-f4e7-40a8-b28c-6a6d1e23c5eb tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.097398 Apr 06 16:58:29.289223 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1287/2571] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:29 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:29.829565 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3a69187b-8607-410c-a99d-0f7eff007f2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:29.830999 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3a69187b-8607-410c-a99d-0f7eff007f2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:29.838335 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a69187b-8607-410c-a99d-0f7eff007f2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:29.838787 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a69187b-8607-410c-a99d-0f7eff007f2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:29.839555 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a69187b-8607-410c-a99d-0f7eff007f2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:29.839990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a69187b-8607-410c-a99d-0f7eff007f2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:29.990198 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3a69187b-8607-410c-a99d-0f7eff007f2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:30.003288 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3a69187b-8607-410c-a99d-0f7eff007f2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:30.005668 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3a69187b-8607-410c-a99d-0f7eff007f2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:30.007347 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3a69187b-8607-410c-a99d-0f7eff007f2d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.183734 Apr 06 16:58:30.007986 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1285/2572] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:29 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:30.023284 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8ff729cc-d570-4f2c-9fd4-9c4c1ef8c8dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:30.024383 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8ff729cc-d570-4f2c-9fd4-9c4c1ef8c8dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:30.031424 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ff729cc-d570-4f2c-9fd4-9c4c1ef8c8dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:30.031873 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ff729cc-d570-4f2c-9fd4-9c4c1ef8c8dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:30.032631 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ff729cc-d570-4f2c-9fd4-9c4c1ef8c8dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:30.033098 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8ff729cc-d570-4f2c-9fd4-9c4c1ef8c8dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:30.167600 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8ff729cc-d570-4f2c-9fd4-9c4c1ef8c8dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:30.175934 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8ff729cc-d570-4f2c-9fd4-9c4c1ef8c8dc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.157691 Apr 06 16:58:30.176513 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1288/2573] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:30 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:30.315419 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7f9f604e-4f86-4d72-a334-4ed75fa71a24 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:30.317291 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7f9f604e-4f86-4d72-a334-4ed75fa71a24 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:30.327705 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f9f604e-4f86-4d72-a334-4ed75fa71a24 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:30.328453 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f9f604e-4f86-4d72-a334-4ed75fa71a24 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:30.330133 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f9f604e-4f86-4d72-a334-4ed75fa71a24 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:30.331458 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f9f604e-4f86-4d72-a334-4ed75fa71a24 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:30.393287 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7f9f604e-4f86-4d72-a334-4ed75fa71a24 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:30.401853 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7f9f604e-4f86-4d72-a334-4ed75fa71a24 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.093359 Apr 06 16:58:30.402445 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1286/2574] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:30 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:31.030765 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-413939af-8060-4edd-baf6-e55ab7dff78f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:31.031742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-413939af-8060-4edd-baf6-e55ab7dff78f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:31.042978 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-413939af-8060-4edd-baf6-e55ab7dff78f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:31.043768 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-413939af-8060-4edd-baf6-e55ab7dff78f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:31.045101 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-413939af-8060-4edd-baf6-e55ab7dff78f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:31.045820 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-413939af-8060-4edd-baf6-e55ab7dff78f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:31.193756 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-865fe329-f957-46ef-9ce1-b3b3d63de8aa tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:31.195581 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-865fe329-f957-46ef-9ce1-b3b3d63de8aa tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:31.201012 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-413939af-8060-4edd-baf6-e55ab7dff78f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:31.202402 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-865fe329-f957-46ef-9ce1-b3b3d63de8aa tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:31.202877 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-865fe329-f957-46ef-9ce1-b3b3d63de8aa tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:31.203593 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-865fe329-f957-46ef-9ce1-b3b3d63de8aa tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:31.204018 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-865fe329-f957-46ef-9ce1-b3b3d63de8aa tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:31.211458 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-413939af-8060-4edd-baf6-e55ab7dff78f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:31.213038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-413939af-8060-4edd-baf6-e55ab7dff78f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:31.214182 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-413939af-8060-4edd-baf6-e55ab7dff78f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.190056 Apr 06 16:58:31.214708 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1289/2575] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:31 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:31.352578 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-865fe329-f957-46ef-9ce1-b3b3d63de8aa tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:31.361305 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-865fe329-f957-46ef-9ce1-b3b3d63de8aa tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.171395 Apr 06 16:58:31.361900 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1287/2576] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:31 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:58:31.423476 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-590f58e2-c3a2-402e-9397-0b4504346173 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:31.424499 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-590f58e2-c3a2-402e-9397-0b4504346173 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:31.435069 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-590f58e2-c3a2-402e-9397-0b4504346173 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:31.435805 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-590f58e2-c3a2-402e-9397-0b4504346173 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:31.437082 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-590f58e2-c3a2-402e-9397-0b4504346173 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:31.437741 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-590f58e2-c3a2-402e-9397-0b4504346173 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:31.517784 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-590f58e2-c3a2-402e-9397-0b4504346173 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:31.530207 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-590f58e2-c3a2-402e-9397-0b4504346173 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.112969 Apr 06 16:58:31.530991 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1290/2577] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:31 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:32.237893 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-de1dd556-b48a-4bf5-8fdd-e97527366329 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:32.238872 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-de1dd556-b48a-4bf5-8fdd-e97527366329 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:32.249641 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de1dd556-b48a-4bf5-8fdd-e97527366329 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:32.250396 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de1dd556-b48a-4bf5-8fdd-e97527366329 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:32.251831 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de1dd556-b48a-4bf5-8fdd-e97527366329 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:32.252563 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de1dd556-b48a-4bf5-8fdd-e97527366329 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:32.379238 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-36a0349f-a65d-428b-b851-71f569d79c4c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:32.379841 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-36a0349f-a65d-428b-b851-71f569d79c4c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:32.387136 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36a0349f-a65d-428b-b851-71f569d79c4c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:32.387585 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36a0349f-a65d-428b-b851-71f569d79c4c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:32.388355 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36a0349f-a65d-428b-b851-71f569d79c4c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:32.388821 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36a0349f-a65d-428b-b851-71f569d79c4c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:32.404347 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-de1dd556-b48a-4bf5-8fdd-e97527366329 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:32.412767 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-de1dd556-b48a-4bf5-8fdd-e97527366329 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:32.414422 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-de1dd556-b48a-4bf5-8fdd-e97527366329 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:32.415609 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-de1dd556-b48a-4bf5-8fdd-e97527366329 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.184497 Apr 06 16:58:32.416380 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1288/2578] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:32 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:32.525720 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-36a0349f-a65d-428b-b851-71f569d79c4c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:32.538172 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-36a0349f-a65d-428b-b851-71f569d79c4c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.162577 Apr 06 16:58:32.539119 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1291/2579] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:32 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:32.555266 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-915939e7-d3d5-44ac-a4d5-d0ed0c33223a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:32.555926 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-915939e7-d3d5-44ac-a4d5-d0ed0c33223a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:32.562586 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-915939e7-d3d5-44ac-a4d5-d0ed0c33223a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:32.563296 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-915939e7-d3d5-44ac-a4d5-d0ed0c33223a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:32.564644 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-915939e7-d3d5-44ac-a4d5-d0ed0c33223a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:32.565474 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-915939e7-d3d5-44ac-a4d5-d0ed0c33223a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:32.635909 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-915939e7-d3d5-44ac-a4d5-d0ed0c33223a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:32.644785 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-915939e7-d3d5-44ac-a4d5-d0ed0c33223a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.096226 Apr 06 16:58:32.645385 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1289/2580] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:32 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:33.434792 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-81eef863-f761-427b-a4b7-ed6735921250 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:33.435456 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-81eef863-f761-427b-a4b7-ed6735921250 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:33.445606 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81eef863-f761-427b-a4b7-ed6735921250 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:33.446072 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81eef863-f761-427b-a4b7-ed6735921250 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:33.447250 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81eef863-f761-427b-a4b7-ed6735921250 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:33.447755 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81eef863-f761-427b-a4b7-ed6735921250 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:33.562190 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bcc61b22-93a2-4099-924d-234be5600429 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:33.562787 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bcc61b22-93a2-4099-924d-234be5600429 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:33.569512 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcc61b22-93a2-4099-924d-234be5600429 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:33.569963 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcc61b22-93a2-4099-924d-234be5600429 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:33.570734 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcc61b22-93a2-4099-924d-234be5600429 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:33.571163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcc61b22-93a2-4099-924d-234be5600429 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:33.592824 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-81eef863-f761-427b-a4b7-ed6735921250 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:33.601513 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-81eef863-f761-427b-a4b7-ed6735921250 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:33.603012 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-81eef863-f761-427b-a4b7-ed6735921250 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:33.604201 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-81eef863-f761-427b-a4b7-ed6735921250 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.173746 Apr 06 16:58:33.605192 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1292/2581] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:33 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:33.662052 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c27fa23c-4f79-4b03-89e4-1fd34286c808 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:33.662658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c27fa23c-4f79-4b03-89e4-1fd34286c808 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:33.669619 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c27fa23c-4f79-4b03-89e4-1fd34286c808 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:33.670058 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c27fa23c-4f79-4b03-89e4-1fd34286c808 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:33.670826 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c27fa23c-4f79-4b03-89e4-1fd34286c808 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:33.671237 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c27fa23c-4f79-4b03-89e4-1fd34286c808 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:33.712059 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-bcc61b22-93a2-4099-924d-234be5600429 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:33.720542 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bcc61b22-93a2-4099-924d-234be5600429 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.162230 Apr 06 16:58:33.721194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1290/2582] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:33 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:33.735759 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c27fa23c-4f79-4b03-89e4-1fd34286c808 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:33.744525 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c27fa23c-4f79-4b03-89e4-1fd34286c808 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086211 Apr 06 16:58:33.745135 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1293/2583] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:33 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:34.626786 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7eee994f-051c-4526-a9d8-82fb056fc6fc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:34.627722 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7eee994f-051c-4526-a9d8-82fb056fc6fc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:34.637821 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7eee994f-051c-4526-a9d8-82fb056fc6fc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:34.638269 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7eee994f-051c-4526-a9d8-82fb056fc6fc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:34.639030 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7eee994f-051c-4526-a9d8-82fb056fc6fc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:34.639457 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7eee994f-051c-4526-a9d8-82fb056fc6fc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:34.739206 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-27b49b20-6598-4fbf-a6c1-4bc740ee8c9a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:34.739828 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-27b49b20-6598-4fbf-a6c1-4bc740ee8c9a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:34.746588 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27b49b20-6598-4fbf-a6c1-4bc740ee8c9a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:34.747026 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27b49b20-6598-4fbf-a6c1-4bc740ee8c9a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:34.747747 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27b49b20-6598-4fbf-a6c1-4bc740ee8c9a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:34.748389 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27b49b20-6598-4fbf-a6c1-4bc740ee8c9a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:34.780478 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7eee994f-051c-4526-a9d8-82fb056fc6fc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:34.793804 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7eee994f-051c-4526-a9d8-82fb056fc6fc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:34.795294 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7eee994f-051c-4526-a9d8-82fb056fc6fc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:34.796461 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7eee994f-051c-4526-a9d8-82fb056fc6fc tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.176479 Apr 06 16:58:34.797048 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1291/2584] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:34 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:34.801429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4c54cf5f-255a-4a3d-9591-8c7be3531a55 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:34.802016 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4c54cf5f-255a-4a3d-9591-8c7be3531a55 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:34.810081 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c54cf5f-255a-4a3d-9591-8c7be3531a55 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:34.810559 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c54cf5f-255a-4a3d-9591-8c7be3531a55 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:34.811334 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c54cf5f-255a-4a3d-9591-8c7be3531a55 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:34.811890 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c54cf5f-255a-4a3d-9591-8c7be3531a55 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:34.877051 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4c54cf5f-255a-4a3d-9591-8c7be3531a55 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:34.885393 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4c54cf5f-255a-4a3d-9591-8c7be3531a55 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086928 Apr 06 16:58:34.886042 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1292/2585] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:34 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:34.893522 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-27b49b20-6598-4fbf-a6c1-4bc740ee8c9a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:34.901991 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-27b49b20-6598-4fbf-a6c1-4bc740ee8c9a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.167313 Apr 06 16:58:34.902567 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1294/2586] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:34 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:35.815876 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-60ba04b3-4be8-4f76-ac1f-9f8d19be4461 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:35.816615 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-60ba04b3-4be8-4f76-ac1f-9f8d19be4461 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:35.823811 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60ba04b3-4be8-4f76-ac1f-9f8d19be4461 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:35.824319 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60ba04b3-4be8-4f76-ac1f-9f8d19be4461 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:35.825156 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60ba04b3-4be8-4f76-ac1f-9f8d19be4461 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:35.825592 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60ba04b3-4be8-4f76-ac1f-9f8d19be4461 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:35.902563 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-14635a48-dcd1-4003-97a1-89c85358c2f6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:35.903261 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-14635a48-dcd1-4003-97a1-89c85358c2f6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:35.909952 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14635a48-dcd1-4003-97a1-89c85358c2f6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:35.910471 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14635a48-dcd1-4003-97a1-89c85358c2f6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:35.911688 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14635a48-dcd1-4003-97a1-89c85358c2f6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:35.911813 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14635a48-dcd1-4003-97a1-89c85358c2f6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:35.965334 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-60ba04b3-4be8-4f76-ac1f-9f8d19be4461 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:35.974174 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-14635a48-dcd1-4003-97a1-89c85358c2f6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:35.974990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-60ba04b3-4be8-4f76-ac1f-9f8d19be4461 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:35.976508 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-60ba04b3-4be8-4f76-ac1f-9f8d19be4461 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:35.977692 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-60ba04b3-4be8-4f76-ac1f-9f8d19be4461 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.165980 Apr 06 16:58:35.978236 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1293/2587] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:35 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:35.982863 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-14635a48-dcd1-4003-97a1-89c85358c2f6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.084337 Apr 06 16:58:35.983586 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1295/2588] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:35 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:35.983735 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cb05425f-3362-4ffa-9071-226d3073a263 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:35.984062 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cb05425f-3362-4ffa-9071-226d3073a263 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:35.990223 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb05425f-3362-4ffa-9071-226d3073a263 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:35.990693 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb05425f-3362-4ffa-9071-226d3073a263 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:35.991438 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb05425f-3362-4ffa-9071-226d3073a263 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:35.991869 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb05425f-3362-4ffa-9071-226d3073a263 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:36.131517 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cb05425f-3362-4ffa-9071-226d3073a263 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:36.140695 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cb05425f-3362-4ffa-9071-226d3073a263 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.161295 Apr 06 16:58:36.141273 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1294/2589] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:35 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:37.000195 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6f8ddaea-149d-44e7-9e94-72379c533d8a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:37.000925 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6f8ddaea-149d-44e7-9e94-72379c533d8a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:37.001065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b3bf8c03-269c-4efd-b1e3-3b8220937995 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:37.001601 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b3bf8c03-269c-4efd-b1e3-3b8220937995 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:37.008080 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f8ddaea-149d-44e7-9e94-72379c533d8a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:37.008557 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3bf8c03-269c-4efd-b1e3-3b8220937995 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:37.008797 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f8ddaea-149d-44e7-9e94-72379c533d8a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:37.009108 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3bf8c03-269c-4efd-b1e3-3b8220937995 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:37.009433 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f8ddaea-149d-44e7-9e94-72379c533d8a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:37.009991 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3bf8c03-269c-4efd-b1e3-3b8220937995 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:37.010384 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f8ddaea-149d-44e7-9e94-72379c533d8a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:37.010556 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3bf8c03-269c-4efd-b1e3-3b8220937995 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:37.074778 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b3bf8c03-269c-4efd-b1e3-3b8220937995 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:37.083136 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b3bf8c03-269c-4efd-b1e3-3b8220937995 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086533 Apr 06 16:58:37.083801 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1295/2590] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:36 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:37.151618 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6f8ddaea-149d-44e7-9e94-72379c533d8a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:37.160784 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6f8ddaea-149d-44e7-9e94-72379c533d8a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:37.162152 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2eb1a131-421c-496b-a97e-f087ca7b4641 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:37.162283 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6f8ddaea-149d-44e7-9e94-72379c533d8a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:37.162772 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2eb1a131-421c-496b-a97e-f087ca7b4641 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:37.163392 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6f8ddaea-149d-44e7-9e94-72379c533d8a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.167699 Apr 06 16:58:37.163966 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1296/2591] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:36 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:37.170263 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2eb1a131-421c-496b-a97e-f087ca7b4641 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:37.170908 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2eb1a131-421c-496b-a97e-f087ca7b4641 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:37.172017 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2eb1a131-421c-496b-a97e-f087ca7b4641 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:37.172639 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2eb1a131-421c-496b-a97e-f087ca7b4641 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:37.315272 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2eb1a131-421c-496b-a97e-f087ca7b4641 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:37.323765 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2eb1a131-421c-496b-a97e-f087ca7b4641 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.165418 Apr 06 16:58:37.324309 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1296/2592] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:37 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:38.144336 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 16:58:38.145020 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 16:58:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 16:58:38.185118 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-625ff29b-3dab-45d2-a740-5b48b17d15da tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:38.185752 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-625ff29b-3dab-45d2-a740-5b48b17d15da tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:38.192121 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-625ff29b-3dab-45d2-a740-5b48b17d15da tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:38.192571 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-625ff29b-3dab-45d2-a740-5b48b17d15da tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:38.193388 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-625ff29b-3dab-45d2-a740-5b48b17d15da tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:38.193821 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-625ff29b-3dab-45d2-a740-5b48b17d15da tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:38.207943 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-02256c56-f135-4c54-a770-b6e0b7d6eae6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:38.209210 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-02256c56-f135-4c54-a770-b6e0b7d6eae6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:38.214614 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02256c56-f135-4c54-a770-b6e0b7d6eae6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:38.215071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02256c56-f135-4c54-a770-b6e0b7d6eae6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:38.215835 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02256c56-f135-4c54-a770-b6e0b7d6eae6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:38.216270 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02256c56-f135-4c54-a770-b6e0b7d6eae6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:38.276741 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-02256c56-f135-4c54-a770-b6e0b7d6eae6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:38.285283 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-02256c56-f135-4c54-a770-b6e0b7d6eae6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.187337 Apr 06 16:58:38.285870 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1297/2593] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:38 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:38.329493 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-625ff29b-3dab-45d2-a740-5b48b17d15da tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:38.338145 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-625ff29b-3dab-45d2-a740-5b48b17d15da tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:38.339814 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-625ff29b-3dab-45d2-a740-5b48b17d15da tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:38.341031 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-625ff29b-3dab-45d2-a740-5b48b17d15da tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.160168 Apr 06 16:58:38.341337 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ccfa6c75-7268-4250-90f7-ff09f4142fe3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:38.341874 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1297/2594] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:38 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:38.342015 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ccfa6c75-7268-4250-90f7-ff09f4142fe3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:38.348119 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccfa6c75-7268-4250-90f7-ff09f4142fe3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:38.348563 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccfa6c75-7268-4250-90f7-ff09f4142fe3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:38.349349 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccfa6c75-7268-4250-90f7-ff09f4142fe3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:38.349786 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ccfa6c75-7268-4250-90f7-ff09f4142fe3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:38.492119 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ccfa6c75-7268-4250-90f7-ff09f4142fe3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:38.500654 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ccfa6c75-7268-4250-90f7-ff09f4142fe3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.163425 Apr 06 16:58:38.501245 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1298/2595] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:38 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:58:39.309264 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-784575a6-4cd3-47a2-a57d-7db85e2af4e5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:39.309264 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-784575a6-4cd3-47a2-a57d-7db85e2af4e5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:39.314456 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-784575a6-4cd3-47a2-a57d-7db85e2af4e5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:39.314913 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-784575a6-4cd3-47a2-a57d-7db85e2af4e5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:39.315688 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-784575a6-4cd3-47a2-a57d-7db85e2af4e5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:39.316120 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-784575a6-4cd3-47a2-a57d-7db85e2af4e5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:39.359945 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-18326279-94a7-43dc-8744-e7a4a65f5d55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:39.360580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-18326279-94a7-43dc-8744-e7a4a65f5d55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:39.367336 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18326279-94a7-43dc-8744-e7a4a65f5d55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:39.367782 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18326279-94a7-43dc-8744-e7a4a65f5d55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:39.368566 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18326279-94a7-43dc-8744-e7a4a65f5d55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:39.369030 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18326279-94a7-43dc-8744-e7a4a65f5d55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:39.380151 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-784575a6-4cd3-47a2-a57d-7db85e2af4e5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:39.389388 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-784575a6-4cd3-47a2-a57d-7db85e2af4e5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.089445 Apr 06 16:58:39.389989 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1298/2596] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:39 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:39.521527 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-18326279-94a7-43dc-8744-e7a4a65f5d55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:39.528945 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e224f1e5-d17b-4b06-ac1a-27933114e6e8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:39.529576 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e224f1e5-d17b-4b06-ac1a-27933114e6e8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:39.531134 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-18326279-94a7-43dc-8744-e7a4a65f5d55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:39.532836 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-18326279-94a7-43dc-8744-e7a4a65f5d55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:39.534368 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-18326279-94a7-43dc-8744-e7a4a65f5d55 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.178351 Apr 06 16:58:39.535162 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1299/2597] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:39 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:39.536112 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e224f1e5-d17b-4b06-ac1a-27933114e6e8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:39.536576 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e224f1e5-d17b-4b06-ac1a-27933114e6e8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:39.537386 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e224f1e5-d17b-4b06-ac1a-27933114e6e8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:39.537819 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e224f1e5-d17b-4b06-ac1a-27933114e6e8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:39.681064 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e224f1e5-d17b-4b06-ac1a-27933114e6e8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:39.692735 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e224f1e5-d17b-4b06-ac1a-27933114e6e8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.172983 Apr 06 16:58:39.693080 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1299/2598] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:39 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:40.411203 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-221f91d3-6d18-4c88-980f-1b9a96c7625e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:40.412251 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-221f91d3-6d18-4c88-980f-1b9a96c7625e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:40.421136 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-221f91d3-6d18-4c88-980f-1b9a96c7625e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:40.421588 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-221f91d3-6d18-4c88-980f-1b9a96c7625e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:40.422350 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-221f91d3-6d18-4c88-980f-1b9a96c7625e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:40.422783 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-221f91d3-6d18-4c88-980f-1b9a96c7625e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:40.489825 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-221f91d3-6d18-4c88-980f-1b9a96c7625e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:40.498591 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-221f91d3-6d18-4c88-980f-1b9a96c7625e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.094019 Apr 06 16:58:40.499227 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1300/2599] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:40 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:40.556668 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-994ff186-d045-41ed-bb05-2070c4bcaa20 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:40.557701 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-994ff186-d045-41ed-bb05-2070c4bcaa20 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:40.568605 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-994ff186-d045-41ed-bb05-2070c4bcaa20 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:40.569418 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-994ff186-d045-41ed-bb05-2070c4bcaa20 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:40.570710 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-994ff186-d045-41ed-bb05-2070c4bcaa20 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:40.571458 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-994ff186-d045-41ed-bb05-2070c4bcaa20 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:40.713641 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6b265a77-449d-49d4-a0bf-3a03c2c01adb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:40.714252 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6b265a77-449d-49d4-a0bf-3a03c2c01adb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:40.720569 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b265a77-449d-49d4-a0bf-3a03c2c01adb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:40.721049 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b265a77-449d-49d4-a0bf-3a03c2c01adb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:40.721811 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b265a77-449d-49d4-a0bf-3a03c2c01adb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:40.722240 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b265a77-449d-49d4-a0bf-3a03c2c01adb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:40.731492 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-994ff186-d045-41ed-bb05-2070c4bcaa20 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:40.740102 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-994ff186-d045-41ed-bb05-2070c4bcaa20 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:40.741609 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-994ff186-d045-41ed-bb05-2070c4bcaa20 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:40.742760 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-994ff186-d045-41ed-bb05-2070c4bcaa20 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.192737 Apr 06 16:58:40.743308 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1300/2600] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:40 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:40.862960 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6b265a77-449d-49d4-a0bf-3a03c2c01adb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:40.871598 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6b265a77-449d-49d4-a0bf-3a03c2c01adb tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.163611 Apr 06 16:58:40.872205 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1301/2601] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:40 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:41.520298 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2e24bac6-c224-42c0-9ad7-d71e85b2975e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:41.521347 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2e24bac6-c224-42c0-9ad7-d71e85b2975e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:41.529765 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e24bac6-c224-42c0-9ad7-d71e85b2975e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:41.530220 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e24bac6-c224-42c0-9ad7-d71e85b2975e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:41.530991 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e24bac6-c224-42c0-9ad7-d71e85b2975e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:41.531431 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e24bac6-c224-42c0-9ad7-d71e85b2975e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:41.607351 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2e24bac6-c224-42c0-9ad7-d71e85b2975e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:41.615562 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2e24bac6-c224-42c0-9ad7-d71e85b2975e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.101757 Apr 06 16:58:41.616121 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1301/2602] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:41 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:41.765328 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-83788a7e-6069-4685-b530-1f4b80d011c6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:41.766253 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-83788a7e-6069-4685-b530-1f4b80d011c6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:41.776568 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83788a7e-6069-4685-b530-1f4b80d011c6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:41.777045 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83788a7e-6069-4685-b530-1f4b80d011c6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:41.777807 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83788a7e-6069-4685-b530-1f4b80d011c6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:41.778234 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83788a7e-6069-4685-b530-1f4b80d011c6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:41.889388 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3712a7c6-a41a-4658-b073-4a10f7623c1e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:41.890002 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3712a7c6-a41a-4658-b073-4a10f7623c1e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:41.896351 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3712a7c6-a41a-4658-b073-4a10f7623c1e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:41.896930 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3712a7c6-a41a-4658-b073-4a10f7623c1e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:41.897767 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3712a7c6-a41a-4658-b073-4a10f7623c1e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:41.898185 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3712a7c6-a41a-4658-b073-4a10f7623c1e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:41.929663 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-83788a7e-6069-4685-b530-1f4b80d011c6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:41.939804 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-83788a7e-6069-4685-b530-1f4b80d011c6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:41.941366 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-83788a7e-6069-4685-b530-1f4b80d011c6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:41.942536 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-83788a7e-6069-4685-b530-1f4b80d011c6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.183751 Apr 06 16:58:41.943106 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1302/2603] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:41 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:42.042300 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3712a7c6-a41a-4658-b073-4a10f7623c1e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:42.050955 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3712a7c6-a41a-4658-b073-4a10f7623c1e tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.165880 Apr 06 16:58:42.051537 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1302/2604] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:41 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:42.636611 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4ae4442e-16aa-44a9-a572-1eb28012f37d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:42.637253 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4ae4442e-16aa-44a9-a572-1eb28012f37d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:42.643720 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ae4442e-16aa-44a9-a572-1eb28012f37d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:42.644152 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ae4442e-16aa-44a9-a572-1eb28012f37d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:42.644949 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ae4442e-16aa-44a9-a572-1eb28012f37d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:42.645379 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ae4442e-16aa-44a9-a572-1eb28012f37d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:42.708204 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4ae4442e-16aa-44a9-a572-1eb28012f37d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:42.717672 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4ae4442e-16aa-44a9-a572-1eb28012f37d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.087369 Apr 06 16:58:42.718216 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1303/2605] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:42 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:42.965034 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9c0ac2de-46aa-4fea-83c7-6d1a592f37ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:42.965917 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9c0ac2de-46aa-4fea-83c7-6d1a592f37ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:42.972542 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c0ac2de-46aa-4fea-83c7-6d1a592f37ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:42.973073 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c0ac2de-46aa-4fea-83c7-6d1a592f37ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:42.973878 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c0ac2de-46aa-4fea-83c7-6d1a592f37ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:42.974317 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c0ac2de-46aa-4fea-83c7-6d1a592f37ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:43.068583 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4cb65d04-8f88-4b33-b7da-c1bd6af02b11 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:43.069054 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4cb65d04-8f88-4b33-b7da-c1bd6af02b11 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:43.077112 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cb65d04-8f88-4b33-b7da-c1bd6af02b11 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:43.077563 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cb65d04-8f88-4b33-b7da-c1bd6af02b11 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:43.078331 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cb65d04-8f88-4b33-b7da-c1bd6af02b11 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:43.078759 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4cb65d04-8f88-4b33-b7da-c1bd6af02b11 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:43.123310 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9c0ac2de-46aa-4fea-83c7-6d1a592f37ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:43.131702 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9c0ac2de-46aa-4fea-83c7-6d1a592f37ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:43.133229 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9c0ac2de-46aa-4fea-83c7-6d1a592f37ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:43.134382 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9c0ac2de-46aa-4fea-83c7-6d1a592f37ca tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.175723 Apr 06 16:58:43.134927 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1303/2606] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:42 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:43.223032 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4cb65d04-8f88-4b33-b7da-c1bd6af02b11 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:43.231790 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4cb65d04-8f88-4b33-b7da-c1bd6af02b11 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.167603 Apr 06 16:58:43.232373 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1304/2607] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:43 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:43.739509 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3d0ddcd4-df78-445b-9fd3-de36cf1b9fa5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:43.740562 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3d0ddcd4-df78-445b-9fd3-de36cf1b9fa5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:43.750246 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d0ddcd4-df78-445b-9fd3-de36cf1b9fa5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:43.750847 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d0ddcd4-df78-445b-9fd3-de36cf1b9fa5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:43.751860 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d0ddcd4-df78-445b-9fd3-de36cf1b9fa5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:43.752429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d0ddcd4-df78-445b-9fd3-de36cf1b9fa5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:43.824822 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3d0ddcd4-df78-445b-9fd3-de36cf1b9fa5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:43.833163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3d0ddcd4-df78-445b-9fd3-de36cf1b9fa5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.100305 Apr 06 16:58:43.833723 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1304/2608] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:43 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:44.156332 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-59cf4477-aebf-4645-b43c-eb621e5d1071 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:44.157266 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-59cf4477-aebf-4645-b43c-eb621e5d1071 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:44.166594 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59cf4477-aebf-4645-b43c-eb621e5d1071 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:44.167044 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59cf4477-aebf-4645-b43c-eb621e5d1071 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:44.167805 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59cf4477-aebf-4645-b43c-eb621e5d1071 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:44.168242 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59cf4477-aebf-4645-b43c-eb621e5d1071 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:44.249891 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0a2411bf-9460-45ef-b5ef-6f4a118c9473 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:44.250530 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0a2411bf-9460-45ef-b5ef-6f4a118c9473 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:44.257118 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a2411bf-9460-45ef-b5ef-6f4a118c9473 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:44.257716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a2411bf-9460-45ef-b5ef-6f4a118c9473 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:44.258580 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a2411bf-9460-45ef-b5ef-6f4a118c9473 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:44.259128 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a2411bf-9460-45ef-b5ef-6f4a118c9473 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:44.324421 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-59cf4477-aebf-4645-b43c-eb621e5d1071 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:44.333073 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-59cf4477-aebf-4645-b43c-eb621e5d1071 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:44.334559 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-59cf4477-aebf-4645-b43c-eb621e5d1071 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:44.335726 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-59cf4477-aebf-4645-b43c-eb621e5d1071 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.185028 Apr 06 16:58:44.336290 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1305/2609] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:44 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:44.401302 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0a2411bf-9460-45ef-b5ef-6f4a118c9473 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:44.414043 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0a2411bf-9460-45ef-b5ef-6f4a118c9473 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.167889 Apr 06 16:58:44.414722 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1305/2610] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:44 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:44.855352 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-686d0bfd-fead-48f9-8611-4ebd3287e067 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:44.855960 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-686d0bfd-fead-48f9-8611-4ebd3287e067 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:44.863306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-686d0bfd-fead-48f9-8611-4ebd3287e067 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:44.863829 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-686d0bfd-fead-48f9-8611-4ebd3287e067 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:44.864726 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-686d0bfd-fead-48f9-8611-4ebd3287e067 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:44.865234 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-686d0bfd-fead-48f9-8611-4ebd3287e067 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:44.932492 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-686d0bfd-fead-48f9-8611-4ebd3287e067 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:44.941325 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-686d0bfd-fead-48f9-8611-4ebd3287e067 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.092926 Apr 06 16:58:44.941905 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1306/2611] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:44 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:45.355555 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-353e5e59-9431-4858-88f9-bb75981af3cd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:45.356172 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-353e5e59-9431-4858-88f9-bb75981af3cd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:45.362982 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-353e5e59-9431-4858-88f9-bb75981af3cd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:45.363439 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-353e5e59-9431-4858-88f9-bb75981af3cd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:45.364204 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-353e5e59-9431-4858-88f9-bb75981af3cd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:45.364637 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-353e5e59-9431-4858-88f9-bb75981af3cd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:45.431771 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e08800c1-2927-46f0-8370-e29f93eaef9f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:45.432629 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e08800c1-2927-46f0-8370-e29f93eaef9f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:45.439584 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e08800c1-2927-46f0-8370-e29f93eaef9f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:45.440036 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e08800c1-2927-46f0-8370-e29f93eaef9f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:45.440960 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e08800c1-2927-46f0-8370-e29f93eaef9f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:45.441396 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e08800c1-2927-46f0-8370-e29f93eaef9f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:45.511845 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-353e5e59-9431-4858-88f9-bb75981af3cd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:45.520876 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-353e5e59-9431-4858-88f9-bb75981af3cd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:45.522375 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-353e5e59-9431-4858-88f9-bb75981af3cd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:45.523544 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-353e5e59-9431-4858-88f9-bb75981af3cd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.172579 Apr 06 16:58:45.524096 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1306/2612] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:45 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:45.580542 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e08800c1-2927-46f0-8370-e29f93eaef9f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:45.589425 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e08800c1-2927-46f0-8370-e29f93eaef9f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.161413 Apr 06 16:58:45.589911 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1307/2613] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:45 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:45.961796 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b4bc6a8a-9fc7-41d3-b96f-bf872fd266a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:45.962876 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b4bc6a8a-9fc7-41d3-b96f-bf872fd266a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:45.969697 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4bc6a8a-9fc7-41d3-b96f-bf872fd266a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:45.970174 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4bc6a8a-9fc7-41d3-b96f-bf872fd266a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:45.970942 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4bc6a8a-9fc7-41d3-b96f-bf872fd266a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:45.971373 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4bc6a8a-9fc7-41d3-b96f-bf872fd266a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:46.039649 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b4bc6a8a-9fc7-41d3-b96f-bf872fd266a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:46.048809 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b4bc6a8a-9fc7-41d3-b96f-bf872fd266a9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.093206 Apr 06 16:58:46.049396 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1307/2614] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:45 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:46.545707 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-02237c9e-8037-4f5c-84be-ca545908ef84 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:46.546462 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-02237c9e-8037-4f5c-84be-ca545908ef84 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:46.554631 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02237c9e-8037-4f5c-84be-ca545908ef84 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:46.555182 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02237c9e-8037-4f5c-84be-ca545908ef84 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:46.556111 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02237c9e-8037-4f5c-84be-ca545908ef84 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:46.556642 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-02237c9e-8037-4f5c-84be-ca545908ef84 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:46.608100 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5e8bc97a-37b3-4b44-9955-f93f2de566c1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:46.608748 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5e8bc97a-37b3-4b44-9955-f93f2de566c1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:46.615079 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e8bc97a-37b3-4b44-9955-f93f2de566c1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:46.615521 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e8bc97a-37b3-4b44-9955-f93f2de566c1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:46.616276 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e8bc97a-37b3-4b44-9955-f93f2de566c1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:46.616716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e8bc97a-37b3-4b44-9955-f93f2de566c1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:46.702823 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-02237c9e-8037-4f5c-84be-ca545908ef84 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:46.711344 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-02237c9e-8037-4f5c-84be-ca545908ef84 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:46.712912 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-02237c9e-8037-4f5c-84be-ca545908ef84 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:46.714367 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-02237c9e-8037-4f5c-84be-ca545908ef84 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.174100 Apr 06 16:58:46.714977 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1308/2615] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:46 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:46.750277 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5e8bc97a-37b3-4b44-9955-f93f2de566c1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:46.758367 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5e8bc97a-37b3-4b44-9955-f93f2de566c1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.155162 Apr 06 16:58:46.758928 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1308/2616] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:46 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:58:47.070343 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e563944-5ec2-4ef4-8e8d-e3d5f46090f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:47.071343 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1e563944-5ec2-4ef4-8e8d-e3d5f46090f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:47.078424 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e563944-5ec2-4ef4-8e8d-e3d5f46090f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:47.078877 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e563944-5ec2-4ef4-8e8d-e3d5f46090f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:47.079641 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e563944-5ec2-4ef4-8e8d-e3d5f46090f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:47.080078 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e563944-5ec2-4ef4-8e8d-e3d5f46090f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:47.149564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e563944-5ec2-4ef4-8e8d-e3d5f46090f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:47.158294 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1e563944-5ec2-4ef4-8e8d-e3d5f46090f3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.094500 Apr 06 16:58:47.158802 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1309/2617] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:47 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:47.776072 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7494fda8-30eb-49f9-9ab5-5f37c2b997b2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:47.776737 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7494fda8-30eb-49f9-9ab5-5f37c2b997b2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:47.783229 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7494fda8-30eb-49f9-9ab5-5f37c2b997b2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:47.783683 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7494fda8-30eb-49f9-9ab5-5f37c2b997b2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:47.784442 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7494fda8-30eb-49f9-9ab5-5f37c2b997b2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:47.784924 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7494fda8-30eb-49f9-9ab5-5f37c2b997b2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:47.864370 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9b585720-4797-4f80-b92b-d7a53847a3e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:47.865024 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9b585720-4797-4f80-b92b-d7a53847a3e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:47.871231 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b585720-4797-4f80-b92b-d7a53847a3e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:47.871681 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b585720-4797-4f80-b92b-d7a53847a3e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:47.872455 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b585720-4797-4f80-b92b-d7a53847a3e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:47.872931 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b585720-4797-4f80-b92b-d7a53847a3e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:47.918769 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7494fda8-30eb-49f9-9ab5-5f37c2b997b2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:47.926714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7494fda8-30eb-49f9-9ab5-5f37c2b997b2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.154571 Apr 06 16:58:47.927292 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1310/2618] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:47 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:48.006409 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9b585720-4797-4f80-b92b-d7a53847a3e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:48.015009 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9b585720-4797-4f80-b92b-d7a53847a3e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:48.016495 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9b585720-4797-4f80-b92b-d7a53847a3e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:48.017692 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9b585720-4797-4f80-b92b-d7a53847a3e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.286901 Apr 06 16:58:48.018267 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1309/2619] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:47 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:48.180493 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-de73c6de-8a15-4987-986a-842202cdf6b8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:48.181335 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-de73c6de-8a15-4987-986a-842202cdf6b8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:48.188460 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de73c6de-8a15-4987-986a-842202cdf6b8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:48.189020 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de73c6de-8a15-4987-986a-842202cdf6b8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:48.189787 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de73c6de-8a15-4987-986a-842202cdf6b8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:48.190223 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-de73c6de-8a15-4987-986a-842202cdf6b8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:48.250162 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-de73c6de-8a15-4987-986a-842202cdf6b8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:48.259116 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-de73c6de-8a15-4987-986a-842202cdf6b8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.083766 Apr 06 16:58:48.259582 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1311/2620] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:48 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:48.945203 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b35ac6c4-370d-4ded-bb0a-308a321fcb96 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:48.945828 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b35ac6c4-370d-4ded-bb0a-308a321fcb96 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:48.953414 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b35ac6c4-370d-4ded-bb0a-308a321fcb96 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:48.953867 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b35ac6c4-370d-4ded-bb0a-308a321fcb96 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:48.954634 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b35ac6c4-370d-4ded-bb0a-308a321fcb96 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:48.955067 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b35ac6c4-370d-4ded-bb0a-308a321fcb96 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:49.035636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-40682652-cd58-4f16-bf2b-0549cfb3aa70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:49.036282 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-40682652-cd58-4f16-bf2b-0549cfb3aa70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:49.043394 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40682652-cd58-4f16-bf2b-0549cfb3aa70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:49.043837 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40682652-cd58-4f16-bf2b-0549cfb3aa70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:49.044611 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40682652-cd58-4f16-bf2b-0549cfb3aa70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:49.045107 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40682652-cd58-4f16-bf2b-0549cfb3aa70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:49.109129 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b35ac6c4-370d-4ded-bb0a-308a321fcb96 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:49.117116 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b35ac6c4-370d-4ded-bb0a-308a321fcb96 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.175886 Apr 06 16:58:49.117687 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1310/2621] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:48 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:49.185608 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-40682652-cd58-4f16-bf2b-0549cfb3aa70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:49.198463 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-40682652-cd58-4f16-bf2b-0549cfb3aa70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:49.200730 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-40682652-cd58-4f16-bf2b-0549cfb3aa70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:49.202594 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-40682652-cd58-4f16-bf2b-0549cfb3aa70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.170790 Apr 06 16:58:49.203460 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1312/2622] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:49 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:49.284653 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3a795562-e4a6-4762-89f3-7c5dd6263a64 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:49.285544 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3a795562-e4a6-4762-89f3-7c5dd6263a64 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:49.293536 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a795562-e4a6-4762-89f3-7c5dd6263a64 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:49.293990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a795562-e4a6-4762-89f3-7c5dd6263a64 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:49.294749 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a795562-e4a6-4762-89f3-7c5dd6263a64 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:49.295176 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a795562-e4a6-4762-89f3-7c5dd6263a64 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:49.356566 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3a795562-e4a6-4762-89f3-7c5dd6263a64 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:49.364670 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3a795562-e4a6-4762-89f3-7c5dd6263a64 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086527 Apr 06 16:58:49.365249 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1311/2623] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:49 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:50.137712 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7654468b-d176-4723-bced-8edf428c11b3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:50.138360 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7654468b-d176-4723-bced-8edf428c11b3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:50.145668 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7654468b-d176-4723-bced-8edf428c11b3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:50.146192 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7654468b-d176-4723-bced-8edf428c11b3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:50.147024 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7654468b-d176-4723-bced-8edf428c11b3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:50.147508 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7654468b-d176-4723-bced-8edf428c11b3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:50.225255 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-32796611-4999-4818-b21d-b8a02a1f1c50 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:50.225853 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-32796611-4999-4818-b21d-b8a02a1f1c50 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:50.233047 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32796611-4999-4818-b21d-b8a02a1f1c50 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:50.233508 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32796611-4999-4818-b21d-b8a02a1f1c50 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:50.234286 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32796611-4999-4818-b21d-b8a02a1f1c50 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:50.234721 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32796611-4999-4818-b21d-b8a02a1f1c50 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:50.292590 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7654468b-d176-4723-bced-8edf428c11b3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:50.300672 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7654468b-d176-4723-bced-8edf428c11b3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.169075 Apr 06 16:58:50.301873 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1313/2624] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:50 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:50.386827 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-32796611-4999-4818-b21d-b8a02a1f1c50 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:50.388792 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0c2b83ad-9f17-4892-9b7e-45c8a377aed8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:50.389507 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0c2b83ad-9f17-4892-9b7e-45c8a377aed8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:50.395512 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-32796611-4999-4818-b21d-b8a02a1f1c50 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:50.395704 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c2b83ad-9f17-4892-9b7e-45c8a377aed8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:50.396119 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c2b83ad-9f17-4892-9b7e-45c8a377aed8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:50.396920 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c2b83ad-9f17-4892-9b7e-45c8a377aed8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:50.397037 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-32796611-4999-4818-b21d-b8a02a1f1c50 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:50.397353 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c2b83ad-9f17-4892-9b7e-45c8a377aed8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:50.398167 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-32796611-4999-4818-b21d-b8a02a1f1c50 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.176926 Apr 06 16:58:50.398721 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1312/2625] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:50 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:50.461547 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0c2b83ad-9f17-4892-9b7e-45c8a377aed8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:50.473008 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0c2b83ad-9f17-4892-9b7e-45c8a377aed8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.088888 Apr 06 16:58:50.473846 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1314/2626] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:50 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:51.320851 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-67718987-4a38-45bc-bc9c-4c14c254ad4f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:51.321660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-67718987-4a38-45bc-bc9c-4c14c254ad4f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:51.330960 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67718987-4a38-45bc-bc9c-4c14c254ad4f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:51.331676 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67718987-4a38-45bc-bc9c-4c14c254ad4f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:51.332644 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67718987-4a38-45bc-bc9c-4c14c254ad4f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:51.333701 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67718987-4a38-45bc-bc9c-4c14c254ad4f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:51.417920 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c00a2888-38f2-47d2-a44f-11feb2ae60c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:51.418560 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c00a2888-38f2-47d2-a44f-11feb2ae60c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:51.425378 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c00a2888-38f2-47d2-a44f-11feb2ae60c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:51.425859 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c00a2888-38f2-47d2-a44f-11feb2ae60c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:51.426634 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c00a2888-38f2-47d2-a44f-11feb2ae60c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:51.427075 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c00a2888-38f2-47d2-a44f-11feb2ae60c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:51.481590 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-67718987-4a38-45bc-bc9c-4c14c254ad4f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:51.489980 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-67718987-4a38-45bc-bc9c-4c14c254ad4f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.175050 Apr 06 16:58:51.491022 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1313/2627] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:51 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:51.496878 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7354c3bf-2bdd-4ff1-9f4e-b60ad00e9216 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:51.498010 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7354c3bf-2bdd-4ff1-9f4e-b60ad00e9216 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:51.504652 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7354c3bf-2bdd-4ff1-9f4e-b60ad00e9216 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:51.505132 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7354c3bf-2bdd-4ff1-9f4e-b60ad00e9216 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:51.505904 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7354c3bf-2bdd-4ff1-9f4e-b60ad00e9216 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:51.506338 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7354c3bf-2bdd-4ff1-9f4e-b60ad00e9216 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:51.566433 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7354c3bf-2bdd-4ff1-9f4e-b60ad00e9216 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:51.571137 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c00a2888-38f2-47d2-a44f-11feb2ae60c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:51.575032 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7354c3bf-2bdd-4ff1-9f4e-b60ad00e9216 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.083125 Apr 06 16:58:51.575686 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1314/2628] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:51 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:51.579990 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c00a2888-38f2-47d2-a44f-11feb2ae60c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:51.581498 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c00a2888-38f2-47d2-a44f-11feb2ae60c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:51.582633 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c00a2888-38f2-47d2-a44f-11feb2ae60c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.168986 Apr 06 16:58:51.583179 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1315/2629] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:51 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:52.512244 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f3c90a3d-ce20-4ac5-9199-e7c685d77a95 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:52.513156 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f3c90a3d-ce20-4ac5-9199-e7c685d77a95 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:52.520148 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3c90a3d-ce20-4ac5-9199-e7c685d77a95 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:52.520596 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3c90a3d-ce20-4ac5-9199-e7c685d77a95 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:52.521403 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3c90a3d-ce20-4ac5-9199-e7c685d77a95 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:52.521837 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3c90a3d-ce20-4ac5-9199-e7c685d77a95 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:52.591448 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f681d6c5-67a8-4197-8cc4-1311c7eedd84 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:52.592056 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f681d6c5-67a8-4197-8cc4-1311c7eedd84 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:52.598520 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f681d6c5-67a8-4197-8cc4-1311c7eedd84 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:52.598974 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f681d6c5-67a8-4197-8cc4-1311c7eedd84 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:52.599744 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f681d6c5-67a8-4197-8cc4-1311c7eedd84 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:52.600176 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f681d6c5-67a8-4197-8cc4-1311c7eedd84 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:52.660577 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f681d6c5-67a8-4197-8cc4-1311c7eedd84 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:52.664980 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f3c90a3d-ce20-4ac5-9199-e7c685d77a95 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:52.668592 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f681d6c5-67a8-4197-8cc4-1311c7eedd84 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.081103 Apr 06 16:58:52.669196 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1316/2630] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:52 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:52.673394 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f3c90a3d-ce20-4ac5-9199-e7c685d77a95 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.166892 Apr 06 16:58:52.673639 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e441442e-fffe-476f-bcf2-629981482a7d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:52.674123 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1315/2631] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:52 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:52.674265 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e441442e-fffe-476f-bcf2-629981482a7d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:52.679850 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e441442e-fffe-476f-bcf2-629981482a7d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:52.680293 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e441442e-fffe-476f-bcf2-629981482a7d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:52.681073 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e441442e-fffe-476f-bcf2-629981482a7d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:52.681520 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e441442e-fffe-476f-bcf2-629981482a7d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:52.825438 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e441442e-fffe-476f-bcf2-629981482a7d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:52.838675 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e441442e-fffe-476f-bcf2-629981482a7d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:52.840293 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e441442e-fffe-476f-bcf2-629981482a7d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:52.841539 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e441442e-fffe-476f-bcf2-629981482a7d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.171340 Apr 06 16:58:52.842042 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1317/2632] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:52 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:53.688990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a4b0c2c7-6051-438f-9c48-9697f3d92478 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:53.689929 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a4b0c2c7-6051-438f-9c48-9697f3d92478 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:53.694285 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1a63d2bb-1b2c-42c1-b91d-c38ebf5c3163 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:53.695330 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1a63d2bb-1b2c-42c1-b91d-c38ebf5c3163 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:53.700613 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4b0c2c7-6051-438f-9c48-9697f3d92478 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:53.701424 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4b0c2c7-6051-438f-9c48-9697f3d92478 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:53.703010 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4b0c2c7-6051-438f-9c48-9697f3d92478 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:53.703932 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4b0c2c7-6051-438f-9c48-9697f3d92478 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:53.706035 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a63d2bb-1b2c-42c1-b91d-c38ebf5c3163 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:53.706778 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a63d2bb-1b2c-42c1-b91d-c38ebf5c3163 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:53.708041 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a63d2bb-1b2c-42c1-b91d-c38ebf5c3163 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:53.708780 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1a63d2bb-1b2c-42c1-b91d-c38ebf5c3163 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:53.767934 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a4b0c2c7-6051-438f-9c48-9697f3d92478 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:53.776093 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a4b0c2c7-6051-438f-9c48-9697f3d92478 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.093815 Apr 06 16:58:53.776784 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1316/2633] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:53 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:53.843350 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1a63d2bb-1b2c-42c1-b91d-c38ebf5c3163 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:53.851257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1a63d2bb-1b2c-42c1-b91d-c38ebf5c3163 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.163339 Apr 06 16:58:53.851829 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1318/2634] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:53 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:53.860091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ccd5ece6-ea45-4144-be0e-999feccb4286 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:53.860737 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ccd5ece6-ea45-4144-be0e-999feccb4286 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:53.866826 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccd5ece6-ea45-4144-be0e-999feccb4286 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:53.867276 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccd5ece6-ea45-4144-be0e-999feccb4286 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:53.868039 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccd5ece6-ea45-4144-be0e-999feccb4286 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:53.868474 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccd5ece6-ea45-4144-be0e-999feccb4286 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:54.005819 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ccd5ece6-ea45-4144-be0e-999feccb4286 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:54.015072 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ccd5ece6-ea45-4144-be0e-999feccb4286 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:54.016536 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ccd5ece6-ea45-4144-be0e-999feccb4286 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:54.017718 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ccd5ece6-ea45-4144-be0e-999feccb4286 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.161701 Apr 06 16:58:54.018269 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1317/2635] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:53 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:54.797363 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2dee9e5c-6a99-44d5-94a6-3256a71798be tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:54.798165 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2dee9e5c-6a99-44d5-94a6-3256a71798be tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:54.806775 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2dee9e5c-6a99-44d5-94a6-3256a71798be tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:54.807360 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2dee9e5c-6a99-44d5-94a6-3256a71798be tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:54.808356 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2dee9e5c-6a99-44d5-94a6-3256a71798be tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:54.809364 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2dee9e5c-6a99-44d5-94a6-3256a71798be tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:54.869618 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5077efcd-ef91-4479-8a9c-146a447d2644 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:54.870514 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5077efcd-ef91-4479-8a9c-146a447d2644 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:54.877421 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5077efcd-ef91-4479-8a9c-146a447d2644 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:54.877869 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5077efcd-ef91-4479-8a9c-146a447d2644 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:54.878644 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5077efcd-ef91-4479-8a9c-146a447d2644 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:54.879077 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5077efcd-ef91-4479-8a9c-146a447d2644 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:54.879499 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2dee9e5c-6a99-44d5-94a6-3256a71798be tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:54.888381 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2dee9e5c-6a99-44d5-94a6-3256a71798be tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.097085 Apr 06 16:58:54.889411 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1319/2636] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:54 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:55.038494 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5077efcd-ef91-4479-8a9c-146a447d2644 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:55.041935 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-38d579ce-5403-422d-9244-6e43ce0903d4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:55.042535 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-38d579ce-5403-422d-9244-6e43ce0903d4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:55.046993 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5077efcd-ef91-4479-8a9c-146a447d2644 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.181293 Apr 06 16:58:55.047651 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1318/2637] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:54 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:55.048988 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38d579ce-5403-422d-9244-6e43ce0903d4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:55.049469 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38d579ce-5403-422d-9244-6e43ce0903d4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:55.050372 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38d579ce-5403-422d-9244-6e43ce0903d4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:55.050798 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-38d579ce-5403-422d-9244-6e43ce0903d4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:55.191302 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-38d579ce-5403-422d-9244-6e43ce0903d4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:55.204676 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-38d579ce-5403-422d-9244-6e43ce0903d4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:55.207025 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-38d579ce-5403-422d-9244-6e43ce0903d4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:55.208762 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-38d579ce-5403-422d-9244-6e43ce0903d4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.170552 Apr 06 16:58:55.209551 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1320/2638] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:55 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:58:55.908823 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-31d54882-8b1c-46ca-840d-b4824203828e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:55.909478 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-31d54882-8b1c-46ca-840d-b4824203828e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:55.916084 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31d54882-8b1c-46ca-840d-b4824203828e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:55.916540 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31d54882-8b1c-46ca-840d-b4824203828e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:55.917337 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31d54882-8b1c-46ca-840d-b4824203828e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:55.917776 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31d54882-8b1c-46ca-840d-b4824203828e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:55.987442 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-31d54882-8b1c-46ca-840d-b4824203828e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:55.999089 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-31d54882-8b1c-46ca-840d-b4824203828e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.094338 Apr 06 16:58:55.999660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1319/2639] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:55 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:56.067726 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-98eec663-7f03-4fe7-88f8-2d72da3d9b15 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:56.068671 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-98eec663-7f03-4fe7-88f8-2d72da3d9b15 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:56.078705 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98eec663-7f03-4fe7-88f8-2d72da3d9b15 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:56.079753 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98eec663-7f03-4fe7-88f8-2d72da3d9b15 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:56.080514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98eec663-7f03-4fe7-88f8-2d72da3d9b15 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:56.080970 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98eec663-7f03-4fe7-88f8-2d72da3d9b15 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:56.217520 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-98eec663-7f03-4fe7-88f8-2d72da3d9b15 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:56.225541 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-98eec663-7f03-4fe7-88f8-2d72da3d9b15 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.164227 Apr 06 16:58:56.226084 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1321/2640] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:56 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:56.231582 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7b4a2ebb-1bf4-446a-9406-81cba875b488 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:56.232173 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7b4a2ebb-1bf4-446a-9406-81cba875b488 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:56.238119 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b4a2ebb-1bf4-446a-9406-81cba875b488 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:56.238566 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b4a2ebb-1bf4-446a-9406-81cba875b488 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:56.239328 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b4a2ebb-1bf4-446a-9406-81cba875b488 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:56.239759 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b4a2ebb-1bf4-446a-9406-81cba875b488 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:56.385497 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7b4a2ebb-1bf4-446a-9406-81cba875b488 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:56.398055 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7b4a2ebb-1bf4-446a-9406-81cba875b488 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:56.400297 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7b4a2ebb-1bf4-446a-9406-81cba875b488 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:56.402076 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7b4a2ebb-1bf4-446a-9406-81cba875b488 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.176147 Apr 06 16:58:56.403034 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1320/2641] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:56 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:57.020026 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f80ee35d-81d0-4814-9d26-ff7b3d2cefaa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:57.021111 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f80ee35d-81d0-4814-9d26-ff7b3d2cefaa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:57.031349 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f80ee35d-81d0-4814-9d26-ff7b3d2cefaa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:57.032080 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f80ee35d-81d0-4814-9d26-ff7b3d2cefaa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:57.033385 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f80ee35d-81d0-4814-9d26-ff7b3d2cefaa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:57.034092 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f80ee35d-81d0-4814-9d26-ff7b3d2cefaa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:57.100327 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f80ee35d-81d0-4814-9d26-ff7b3d2cefaa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:57.108998 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f80ee35d-81d0-4814-9d26-ff7b3d2cefaa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.095383 Apr 06 16:58:57.109555 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1322/2642] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:57 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:57.248594 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b94a4b97-ffda-41c7-af59-a637fe4465df tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:57.249224 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b94a4b97-ffda-41c7-af59-a637fe4465df tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:57.256257 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b94a4b97-ffda-41c7-af59-a637fe4465df tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:57.256725 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b94a4b97-ffda-41c7-af59-a637fe4465df tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:57.257553 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b94a4b97-ffda-41c7-af59-a637fe4465df tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:57.258007 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b94a4b97-ffda-41c7-af59-a637fe4465df tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:57.407197 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b94a4b97-ffda-41c7-af59-a637fe4465df tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:57.417776 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b94a4b97-ffda-41c7-af59-a637fe4465df tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.175347 Apr 06 16:58:57.418257 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1321/2643] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:57 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:57.421035 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dceab314-2da1-427e-b62e-039553fcdf9b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:57.421638 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dceab314-2da1-427e-b62e-039553fcdf9b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:57.428009 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dceab314-2da1-427e-b62e-039553fcdf9b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:57.428485 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dceab314-2da1-427e-b62e-039553fcdf9b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:57.429277 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dceab314-2da1-427e-b62e-039553fcdf9b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:57.429698 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dceab314-2da1-427e-b62e-039553fcdf9b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:57.571985 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-dceab314-2da1-427e-b62e-039553fcdf9b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:57.581109 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-dceab314-2da1-427e-b62e-039553fcdf9b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:57.582580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-dceab314-2da1-427e-b62e-039553fcdf9b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:57.583718 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dceab314-2da1-427e-b62e-039553fcdf9b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.166687 Apr 06 16:58:57.584257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1323/2644] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:57 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:58:58.125762 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a2a20ace-702f-47c9-94dd-47bcd2c038df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:58.126429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a2a20ace-702f-47c9-94dd-47bcd2c038df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:58.133020 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2a20ace-702f-47c9-94dd-47bcd2c038df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:58.133466 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2a20ace-702f-47c9-94dd-47bcd2c038df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:58.134238 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2a20ace-702f-47c9-94dd-47bcd2c038df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:58.134675 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2a20ace-702f-47c9-94dd-47bcd2c038df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:58.199713 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a2a20ace-702f-47c9-94dd-47bcd2c038df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:58.207697 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a2a20ace-702f-47c9-94dd-47bcd2c038df tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086094 Apr 06 16:58:58.208261 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1322/2645] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:58 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:58.441055 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9726669d-6ebf-43c5-92a3-064b7ccb5646 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:58.441987 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9726669d-6ebf-43c5-92a3-064b7ccb5646 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:58.452027 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9726669d-6ebf-43c5-92a3-064b7ccb5646 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:58.452471 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9726669d-6ebf-43c5-92a3-064b7ccb5646 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:58.453266 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9726669d-6ebf-43c5-92a3-064b7ccb5646 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:58.453697 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9726669d-6ebf-43c5-92a3-064b7ccb5646 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:58.602216 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9726669d-6ebf-43c5-92a3-064b7ccb5646 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:58.610502 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4a8df29a-aa8f-4e31-a8e5-1805565fda45 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:58.611097 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4a8df29a-aa8f-4e31-a8e5-1805565fda45 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:58.612663 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9726669d-6ebf-43c5-92a3-064b7ccb5646 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.179566 Apr 06 16:58:58.613306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1324/2646] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:58 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:58.617741 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a8df29a-aa8f-4e31-a8e5-1805565fda45 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:58.618161 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a8df29a-aa8f-4e31-a8e5-1805565fda45 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:58.618932 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a8df29a-aa8f-4e31-a8e5-1805565fda45 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:58.619365 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a8df29a-aa8f-4e31-a8e5-1805565fda45 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:58.769804 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4a8df29a-aa8f-4e31-a8e5-1805565fda45 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:58.781080 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4a8df29a-aa8f-4e31-a8e5-1805565fda45 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:58.782602 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4a8df29a-aa8f-4e31-a8e5-1805565fda45 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:58.783783 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4a8df29a-aa8f-4e31-a8e5-1805565fda45 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.177258 Apr 06 16:58:58.784340 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1323/2647] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:58 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:58:59.229024 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3f51bc6f-ed63-40a6-86b5-4cc5aa81bb1b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:59.230430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3f51bc6f-ed63-40a6-86b5-4cc5aa81bb1b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:59.237352 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f51bc6f-ed63-40a6-86b5-4cc5aa81bb1b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:59.237801 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f51bc6f-ed63-40a6-86b5-4cc5aa81bb1b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:59.238566 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f51bc6f-ed63-40a6-86b5-4cc5aa81bb1b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:59.239000 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f51bc6f-ed63-40a6-86b5-4cc5aa81bb1b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:59.306468 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3f51bc6f-ed63-40a6-86b5-4cc5aa81bb1b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:59.314954 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3f51bc6f-ed63-40a6-86b5-4cc5aa81bb1b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.092680 Apr 06 16:58:59.315535 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1325/2648] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:59 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:59.634420 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a0c40f7a-42da-46ad-84a5-caa5396346d0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:59.635351 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a0c40f7a-42da-46ad-84a5-caa5396346d0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:59.646442 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0c40f7a-42da-46ad-84a5-caa5396346d0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:59.647190 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0c40f7a-42da-46ad-84a5-caa5396346d0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:59.648441 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0c40f7a-42da-46ad-84a5-caa5396346d0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:59.649215 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0c40f7a-42da-46ad-84a5-caa5396346d0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:59.799476 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a0c40f7a-42da-46ad-84a5-caa5396346d0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:59.804916 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9ab94e15-9b84-4d47-a8eb-3bb910bcc244 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:58:59.805500 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9ab94e15-9b84-4d47-a8eb-3bb910bcc244 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:58:59.811197 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a0c40f7a-42da-46ad-84a5-caa5396346d0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.183090 Apr 06 16:58:59.812194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1324/2649] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:58:59 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:58:59.815434 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ab94e15-9b84-4d47-a8eb-3bb910bcc244 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:59.816050 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ab94e15-9b84-4d47-a8eb-3bb910bcc244 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:59.817244 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ab94e15-9b84-4d47-a8eb-3bb910bcc244 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:58:59.817861 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ab94e15-9b84-4d47-a8eb-3bb910bcc244 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:58:59.965724 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9ab94e15-9b84-4d47-a8eb-3bb910bcc244 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:59.975030 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9ab94e15-9b84-4d47-a8eb-3bb910bcc244 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:59.976544 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9ab94e15-9b84-4d47-a8eb-3bb910bcc244 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:58:59.977798 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9ab94e15-9b84-4d47-a8eb-3bb910bcc244 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.178588 Apr 06 16:58:59.978361 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1326/2650] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:58:59 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:00.336430 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-883eb16b-c6c4-4a88-8dd3-2b3c347dda45 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:00.337489 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-883eb16b-c6c4-4a88-8dd3-2b3c347dda45 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:00.345677 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-883eb16b-c6c4-4a88-8dd3-2b3c347dda45 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:00.346123 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-883eb16b-c6c4-4a88-8dd3-2b3c347dda45 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:00.346885 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-883eb16b-c6c4-4a88-8dd3-2b3c347dda45 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:00.347310 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-883eb16b-c6c4-4a88-8dd3-2b3c347dda45 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:00.415120 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-883eb16b-c6c4-4a88-8dd3-2b3c347dda45 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:00.423761 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-883eb16b-c6c4-4a88-8dd3-2b3c347dda45 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.094036 Apr 06 16:59:00.424355 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1325/2651] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:00 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:00.836796 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c23d7154-65b0-47d9-be3c-c85fb390c728 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:00.837748 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c23d7154-65b0-47d9-be3c-c85fb390c728 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:00.848910 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c23d7154-65b0-47d9-be3c-c85fb390c728 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:00.849646 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c23d7154-65b0-47d9-be3c-c85fb390c728 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:00.850879 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c23d7154-65b0-47d9-be3c-c85fb390c728 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:00.851585 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c23d7154-65b0-47d9-be3c-c85fb390c728 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:00.993097 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c23d7154-65b0-47d9-be3c-c85fb390c728 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:00.998716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c4c9db2b-6ea9-44a0-8ad5-835da2df141c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:00.999328 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c4c9db2b-6ea9-44a0-8ad5-835da2df141c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:01.001776 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c23d7154-65b0-47d9-be3c-c85fb390c728 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.171449 Apr 06 16:59:01.002476 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1327/2652] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:00 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:01.006273 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4c9db2b-6ea9-44a0-8ad5-835da2df141c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:01.006722 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4c9db2b-6ea9-44a0-8ad5-835da2df141c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:01.007495 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4c9db2b-6ea9-44a0-8ad5-835da2df141c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:01.007924 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4c9db2b-6ea9-44a0-8ad5-835da2df141c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:01.151053 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c4c9db2b-6ea9-44a0-8ad5-835da2df141c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:01.160007 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c4c9db2b-6ea9-44a0-8ad5-835da2df141c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:01.161546 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c4c9db2b-6ea9-44a0-8ad5-835da2df141c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:01.162716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c4c9db2b-6ea9-44a0-8ad5-835da2df141c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.168222 Apr 06 16:59:01.163273 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1326/2653] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:00 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:01.440883 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-36bc0bbd-b696-42c7-8dec-04e3e2b6adc2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:01.441721 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-36bc0bbd-b696-42c7-8dec-04e3e2b6adc2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:01.447819 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36bc0bbd-b696-42c7-8dec-04e3e2b6adc2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:01.448505 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36bc0bbd-b696-42c7-8dec-04e3e2b6adc2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:01.449428 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36bc0bbd-b696-42c7-8dec-04e3e2b6adc2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:01.450100 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-36bc0bbd-b696-42c7-8dec-04e3e2b6adc2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:01.516579 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-36bc0bbd-b696-42c7-8dec-04e3e2b6adc2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:01.524713 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-36bc0bbd-b696-42c7-8dec-04e3e2b6adc2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.087666 Apr 06 16:59:01.526189 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1328/2654] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:01 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:02.022996 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ce0be1a0-5bf6-4cc6-9e1e-89055f006bce tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:02.023901 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ce0be1a0-5bf6-4cc6-9e1e-89055f006bce tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:02.034287 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce0be1a0-5bf6-4cc6-9e1e-89055f006bce tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:02.034966 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce0be1a0-5bf6-4cc6-9e1e-89055f006bce tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:02.036130 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce0be1a0-5bf6-4cc6-9e1e-89055f006bce tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:02.036946 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce0be1a0-5bf6-4cc6-9e1e-89055f006bce tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:02.184759 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a8111ad4-7d0a-454f-ba08-9fe40bc9993b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:02.185383 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a8111ad4-7d0a-454f-ba08-9fe40bc9993b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:02.194599 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8111ad4-7d0a-454f-ba08-9fe40bc9993b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:02.195052 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8111ad4-7d0a-454f-ba08-9fe40bc9993b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:02.196152 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8111ad4-7d0a-454f-ba08-9fe40bc9993b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:02.196775 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a8111ad4-7d0a-454f-ba08-9fe40bc9993b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:02.200873 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ce0be1a0-5bf6-4cc6-9e1e-89055f006bce tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:02.208900 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ce0be1a0-5bf6-4cc6-9e1e-89055f006bce tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.192034 Apr 06 16:59:02.209589 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1327/2655] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:02 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:02.334061 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a8111ad4-7d0a-454f-ba08-9fe40bc9993b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:02.348259 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a8111ad4-7d0a-454f-ba08-9fe40bc9993b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:02.350728 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a8111ad4-7d0a-454f-ba08-9fe40bc9993b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:02.352481 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a8111ad4-7d0a-454f-ba08-9fe40bc9993b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.173931 Apr 06 16:59:02.353248 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1329/2656] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:02 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:02.544955 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6ac73da6-cae3-4aa0-b73d-a92a16954305 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:02.545641 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6ac73da6-cae3-4aa0-b73d-a92a16954305 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:02.553524 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ac73da6-cae3-4aa0-b73d-a92a16954305 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:02.554090 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ac73da6-cae3-4aa0-b73d-a92a16954305 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:02.555047 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ac73da6-cae3-4aa0-b73d-a92a16954305 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:02.555594 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ac73da6-cae3-4aa0-b73d-a92a16954305 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:02.617038 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6ac73da6-cae3-4aa0-b73d-a92a16954305 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:02.625899 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6ac73da6-cae3-4aa0-b73d-a92a16954305 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.085952 Apr 06 16:59:02.626469 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1328/2657] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:02 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:03.163249 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 16:59:03.163541 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 16:59:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 16:59:03.231035 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f83b4d58-b030-4560-a234-773a17947c51 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:03.232286 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f83b4d58-b030-4560-a234-773a17947c51 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:03.243352 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f83b4d58-b030-4560-a234-773a17947c51 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:03.244092 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f83b4d58-b030-4560-a234-773a17947c51 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:03.245377 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f83b4d58-b030-4560-a234-773a17947c51 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:03.246084 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f83b4d58-b030-4560-a234-773a17947c51 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:03.371718 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3ddf4424-cf53-4b66-a516-e943e78c6149 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:03.372586 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3ddf4424-cf53-4b66-a516-e943e78c6149 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:03.379240 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ddf4424-cf53-4b66-a516-e943e78c6149 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:03.379663 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ddf4424-cf53-4b66-a516-e943e78c6149 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:03.380448 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ddf4424-cf53-4b66-a516-e943e78c6149 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:03.380922 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ddf4424-cf53-4b66-a516-e943e78c6149 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:03.386046 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f83b4d58-b030-4560-a234-773a17947c51 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:03.394338 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f83b4d58-b030-4560-a234-773a17947c51 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.170139 Apr 06 16:59:03.395127 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1330/2658] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:03 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:03.521056 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3ddf4424-cf53-4b66-a516-e943e78c6149 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:03.529857 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3ddf4424-cf53-4b66-a516-e943e78c6149 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:03.531350 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3ddf4424-cf53-4b66-a516-e943e78c6149 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:03.532523 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3ddf4424-cf53-4b66-a516-e943e78c6149 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.164919 Apr 06 16:59:03.533103 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1329/2659] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:03 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:03.647688 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a6bbedf6-8089-4bef-be76-4a7c434facdd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:03.648656 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a6bbedf6-8089-4bef-be76-4a7c434facdd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:03.659002 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6bbedf6-8089-4bef-be76-4a7c434facdd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:03.659731 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6bbedf6-8089-4bef-be76-4a7c434facdd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:03.661052 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6bbedf6-8089-4bef-be76-4a7c434facdd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:03.661775 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a6bbedf6-8089-4bef-be76-4a7c434facdd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:03.725855 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a6bbedf6-8089-4bef-be76-4a7c434facdd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:03.734444 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a6bbedf6-8089-4bef-be76-4a7c434facdd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.093313 Apr 06 16:59:03.735026 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1331/2660] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:03 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:04.415428 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-78d99d41-c858-4535-a884-2986d3ba5a53 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:04.416073 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-78d99d41-c858-4535-a884-2986d3ba5a53 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:04.424005 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78d99d41-c858-4535-a884-2986d3ba5a53 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:04.424453 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78d99d41-c858-4535-a884-2986d3ba5a53 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:04.425259 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78d99d41-c858-4535-a884-2986d3ba5a53 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:04.425692 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78d99d41-c858-4535-a884-2986d3ba5a53 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:04.551175 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-721c17fd-7e8f-481f-afe1-c3d587b5b295 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:04.551842 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-721c17fd-7e8f-481f-afe1-c3d587b5b295 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:04.558581 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-721c17fd-7e8f-481f-afe1-c3d587b5b295 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:04.559155 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-721c17fd-7e8f-481f-afe1-c3d587b5b295 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:04.560022 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-721c17fd-7e8f-481f-afe1-c3d587b5b295 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:04.560460 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-721c17fd-7e8f-481f-afe1-c3d587b5b295 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:04.567998 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-78d99d41-c858-4535-a884-2986d3ba5a53 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:04.576430 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-78d99d41-c858-4535-a884-2986d3ba5a53 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.167423 Apr 06 16:59:04.577016 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1330/2661] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:04 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:04.699145 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-721c17fd-7e8f-481f-afe1-c3d587b5b295 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:04.708128 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-721c17fd-7e8f-481f-afe1-c3d587b5b295 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:04.709698 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-721c17fd-7e8f-481f-afe1-c3d587b5b295 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:04.710888 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-721c17fd-7e8f-481f-afe1-c3d587b5b295 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.163693 Apr 06 16:59:04.711450 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1332/2662] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:04 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:04.761839 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5801fe86-7a77-4792-b40d-028d835003f0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:04.762632 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5801fe86-7a77-4792-b40d-028d835003f0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:04.771939 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5801fe86-7a77-4792-b40d-028d835003f0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:04.772528 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5801fe86-7a77-4792-b40d-028d835003f0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:04.773799 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5801fe86-7a77-4792-b40d-028d835003f0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:04.774385 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5801fe86-7a77-4792-b40d-028d835003f0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:04.835449 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5801fe86-7a77-4792-b40d-028d835003f0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:04.843397 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5801fe86-7a77-4792-b40d-028d835003f0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.087898 Apr 06 16:59:04.843966 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1331/2663] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:04 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:05.598243 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-327b7272-ea0a-47a2-8a89-763bc4ed8a95 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:05.599143 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-327b7272-ea0a-47a2-8a89-763bc4ed8a95 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:05.610067 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-327b7272-ea0a-47a2-8a89-763bc4ed8a95 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:05.610796 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-327b7272-ea0a-47a2-8a89-763bc4ed8a95 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:05.612037 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-327b7272-ea0a-47a2-8a89-763bc4ed8a95 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:05.612782 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-327b7272-ea0a-47a2-8a89-763bc4ed8a95 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:05.729319 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e0a8efc2-dd85-4b8c-9008-a06cbcc6e081 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:05.730320 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e0a8efc2-dd85-4b8c-9008-a06cbcc6e081 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:05.737223 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0a8efc2-dd85-4b8c-9008-a06cbcc6e081 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:05.737672 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0a8efc2-dd85-4b8c-9008-a06cbcc6e081 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:05.738506 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0a8efc2-dd85-4b8c-9008-a06cbcc6e081 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:05.738918 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0a8efc2-dd85-4b8c-9008-a06cbcc6e081 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:05.754592 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-327b7272-ea0a-47a2-8a89-763bc4ed8a95 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:05.762592 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-327b7272-ea0a-47a2-8a89-763bc4ed8a95 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.170840 Apr 06 16:59:05.763197 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1333/2664] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:05 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:05.862150 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-47cdc391-5667-41f4-bb7c-98981c3e3884 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:05.863076 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-47cdc391-5667-41f4-bb7c-98981c3e3884 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:05.869537 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47cdc391-5667-41f4-bb7c-98981c3e3884 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:05.869989 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47cdc391-5667-41f4-bb7c-98981c3e3884 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:05.870958 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47cdc391-5667-41f4-bb7c-98981c3e3884 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:05.871395 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47cdc391-5667-41f4-bb7c-98981c3e3884 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:05.889856 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e0a8efc2-dd85-4b8c-9008-a06cbcc6e081 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:05.898330 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e0a8efc2-dd85-4b8c-9008-a06cbcc6e081 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:05.899820 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e0a8efc2-dd85-4b8c-9008-a06cbcc6e081 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:05.901138 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e0a8efc2-dd85-4b8c-9008-a06cbcc6e081 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.175873 Apr 06 16:59:05.901701 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1332/2665] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:05 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:05.935531 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-47cdc391-5667-41f4-bb7c-98981c3e3884 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:05.943420 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-47cdc391-5667-41f4-bb7c-98981c3e3884 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.085424 Apr 06 16:59:05.943973 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1334/2666] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:05 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:06.783677 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c88bf259-d035-4452-aa00-ea2529a04bc9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:06.784752 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c88bf259-d035-4452-aa00-ea2529a04bc9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:06.794720 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c88bf259-d035-4452-aa00-ea2529a04bc9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:06.795174 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c88bf259-d035-4452-aa00-ea2529a04bc9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:06.795941 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c88bf259-d035-4452-aa00-ea2529a04bc9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:06.796376 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c88bf259-d035-4452-aa00-ea2529a04bc9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:06.919598 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-30c0a99c-4628-447e-823f-94a4b5af2cbe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:06.920241 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-30c0a99c-4628-447e-823f-94a4b5af2cbe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:06.926744 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30c0a99c-4628-447e-823f-94a4b5af2cbe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:06.927194 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30c0a99c-4628-447e-823f-94a4b5af2cbe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:06.927969 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30c0a99c-4628-447e-823f-94a4b5af2cbe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:06.928405 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30c0a99c-4628-447e-823f-94a4b5af2cbe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:06.937313 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c88bf259-d035-4452-aa00-ea2529a04bc9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:06.945690 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c88bf259-d035-4452-aa00-ea2529a04bc9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.168625 Apr 06 16:59:06.946308 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1333/2667] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:06 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:06.960390 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-57c31a65-ff72-4a93-8a6c-b7f9a30184b9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:06.961179 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-57c31a65-ff72-4a93-8a6c-b7f9a30184b9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:06.967759 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57c31a65-ff72-4a93-8a6c-b7f9a30184b9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:06.968216 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57c31a65-ff72-4a93-8a6c-b7f9a30184b9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:06.969028 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57c31a65-ff72-4a93-8a6c-b7f9a30184b9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:06.969436 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57c31a65-ff72-4a93-8a6c-b7f9a30184b9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:07.028740 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-57c31a65-ff72-4a93-8a6c-b7f9a30184b9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:07.036926 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-57c31a65-ff72-4a93-8a6c-b7f9a30184b9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.080315 Apr 06 16:59:07.037436 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1334/2668] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:06 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:07.064532 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-30c0a99c-4628-447e-823f-94a4b5af2cbe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:07.075964 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-30c0a99c-4628-447e-823f-94a4b5af2cbe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:07.077492 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-30c0a99c-4628-447e-823f-94a4b5af2cbe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:07.078641 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-30c0a99c-4628-447e-823f-94a4b5af2cbe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.163021 Apr 06 16:59:07.079239 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1335/2669] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:06 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:59:07.967142 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b0733bd1-b7a9-4b0e-9097-fed735cf1282 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:07.967741 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b0733bd1-b7a9-4b0e-9097-fed735cf1282 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:07.974522 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0733bd1-b7a9-4b0e-9097-fed735cf1282 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:07.974968 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0733bd1-b7a9-4b0e-9097-fed735cf1282 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:07.975758 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0733bd1-b7a9-4b0e-9097-fed735cf1282 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:07.976191 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0733bd1-b7a9-4b0e-9097-fed735cf1282 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:08.053833 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e551fb6a-fb71-4ac2-aa06-88d7d152797d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:08.054475 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e551fb6a-fb71-4ac2-aa06-88d7d152797d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:08.061165 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e551fb6a-fb71-4ac2-aa06-88d7d152797d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:08.061952 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e551fb6a-fb71-4ac2-aa06-88d7d152797d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:08.062356 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e551fb6a-fb71-4ac2-aa06-88d7d152797d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:08.062757 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e551fb6a-fb71-4ac2-aa06-88d7d152797d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:08.115666 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b0733bd1-b7a9-4b0e-9097-fed735cf1282 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:08.122735 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e551fb6a-fb71-4ac2-aa06-88d7d152797d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:08.123842 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b0733bd1-b7a9-4b0e-9097-fed735cf1282 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.162591 Apr 06 16:59:08.125058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1335/2670] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:07 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:08.129931 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-87ccbcb4-f032-42b2-9fb7-ec41e2cb1e8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:08.130561 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-87ccbcb4-f032-42b2-9fb7-ec41e2cb1e8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:08.135440 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e551fb6a-fb71-4ac2-aa06-88d7d152797d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.085450 Apr 06 16:59:08.136020 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1336/2671] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:08 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:08.136159 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87ccbcb4-f032-42b2-9fb7-ec41e2cb1e8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:08.136605 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87ccbcb4-f032-42b2-9fb7-ec41e2cb1e8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:08.137580 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87ccbcb4-f032-42b2-9fb7-ec41e2cb1e8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:08.138290 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87ccbcb4-f032-42b2-9fb7-ec41e2cb1e8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:08.282609 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-87ccbcb4-f032-42b2-9fb7-ec41e2cb1e8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:08.291411 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-87ccbcb4-f032-42b2-9fb7-ec41e2cb1e8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:08.293005 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-87ccbcb4-f032-42b2-9fb7-ec41e2cb1e8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:08.294208 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-87ccbcb4-f032-42b2-9fb7-ec41e2cb1e8b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.168482 Apr 06 16:59:08.294735 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1336/2672] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:08 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:09.146212 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bc59372d-cc3d-42e9-891f-b46beb6c3af7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:09.147880 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bc59372d-cc3d-42e9-891f-b46beb6c3af7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:09.155132 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d7cc1516-3525-4614-9c2d-e004edf80b96 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:09.155742 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d7cc1516-3525-4614-9c2d-e004edf80b96 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:09.159539 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc59372d-cc3d-42e9-891f-b46beb6c3af7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:09.160265 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc59372d-cc3d-42e9-891f-b46beb6c3af7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:09.161632 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc59372d-cc3d-42e9-891f-b46beb6c3af7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:09.162368 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc59372d-cc3d-42e9-891f-b46beb6c3af7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:09.162494 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7cc1516-3525-4614-9c2d-e004edf80b96 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:09.162904 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7cc1516-3525-4614-9c2d-e004edf80b96 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:09.163672 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7cc1516-3525-4614-9c2d-e004edf80b96 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:09.164091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7cc1516-3525-4614-9c2d-e004edf80b96 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:09.223892 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d7cc1516-3525-4614-9c2d-e004edf80b96 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:09.232930 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d7cc1516-3525-4614-9c2d-e004edf80b96 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.083172 Apr 06 16:59:09.233522 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1337/2673] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:09 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:09.313006 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6d42a2db-4e4c-4b00-b334-7dc26fda5869 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:09.313682 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6d42a2db-4e4c-4b00-b334-7dc26fda5869 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:09.315808 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-bc59372d-cc3d-42e9-891f-b46beb6c3af7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:09.319744 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d42a2db-4e4c-4b00-b334-7dc26fda5869 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:09.320196 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d42a2db-4e4c-4b00-b334-7dc26fda5869 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:09.320999 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d42a2db-4e4c-4b00-b334-7dc26fda5869 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:09.321439 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d42a2db-4e4c-4b00-b334-7dc26fda5869 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:09.323718 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bc59372d-cc3d-42e9-891f-b46beb6c3af7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.184494 Apr 06 16:59:09.324275 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1337/2674] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:09 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:09.463132 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6d42a2db-4e4c-4b00-b334-7dc26fda5869 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:09.471815 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6d42a2db-4e4c-4b00-b334-7dc26fda5869 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:09.473308 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6d42a2db-4e4c-4b00-b334-7dc26fda5869 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:09.474481 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6d42a2db-4e4c-4b00-b334-7dc26fda5869 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.165667 Apr 06 16:59:09.475043 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1338/2675] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:09 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:10.251259 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1eb9d1ad-7ad2-4217-a607-5191242efdd7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:10.251900 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1eb9d1ad-7ad2-4217-a607-5191242efdd7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:10.258668 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1eb9d1ad-7ad2-4217-a607-5191242efdd7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:10.259115 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1eb9d1ad-7ad2-4217-a607-5191242efdd7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:10.259874 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1eb9d1ad-7ad2-4217-a607-5191242efdd7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:10.260299 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1eb9d1ad-7ad2-4217-a607-5191242efdd7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:10.320924 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1eb9d1ad-7ad2-4217-a607-5191242efdd7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:10.329803 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1eb9d1ad-7ad2-4217-a607-5191242efdd7 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.082531 Apr 06 16:59:10.330377 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1338/2676] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:10 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:10.341341 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2ac1c40f-8ba4-4360-9356-17861e7f8b0f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:10.341985 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2ac1c40f-8ba4-4360-9356-17861e7f8b0f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:10.348870 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ac1c40f-8ba4-4360-9356-17861e7f8b0f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:10.349322 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ac1c40f-8ba4-4360-9356-17861e7f8b0f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:10.350088 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ac1c40f-8ba4-4360-9356-17861e7f8b0f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:10.350515 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ac1c40f-8ba4-4360-9356-17861e7f8b0f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:10.492286 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2ac1c40f-8ba4-4360-9356-17861e7f8b0f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:10.493734 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cfe1f9c6-c019-46e0-b4e5-dcd7869503e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:10.494367 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cfe1f9c6-c019-46e0-b4e5-dcd7869503e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:10.500922 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2ac1c40f-8ba4-4360-9356-17861e7f8b0f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.163506 Apr 06 16:59:10.501240 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfe1f9c6-c019-46e0-b4e5-dcd7869503e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:10.501932 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfe1f9c6-c019-46e0-b4e5-dcd7869503e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:10.502102 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1339/2677] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:10 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:10.502430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfe1f9c6-c019-46e0-b4e5-dcd7869503e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:10.502886 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cfe1f9c6-c019-46e0-b4e5-dcd7869503e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:10.645026 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-cfe1f9c6-c019-46e0-b4e5-dcd7869503e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:10.653728 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-cfe1f9c6-c019-46e0-b4e5-dcd7869503e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:10.655327 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-cfe1f9c6-c019-46e0-b4e5-dcd7869503e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:10.656539 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cfe1f9c6-c019-46e0-b4e5-dcd7869503e7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.166692 Apr 06 16:59:10.657093 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1339/2678] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:10 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:11.350454 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4db8d330-8e4e-4029-91f4-ff67f735aa22 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:11.351093 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4db8d330-8e4e-4029-91f4-ff67f735aa22 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:11.360317 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4db8d330-8e4e-4029-91f4-ff67f735aa22 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:11.360799 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4db8d330-8e4e-4029-91f4-ff67f735aa22 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:11.361656 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4db8d330-8e4e-4029-91f4-ff67f735aa22 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:11.362195 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4db8d330-8e4e-4029-91f4-ff67f735aa22 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:11.425950 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4db8d330-8e4e-4029-91f4-ff67f735aa22 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:11.438126 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4db8d330-8e4e-4029-91f4-ff67f735aa22 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.094101 Apr 06 16:59:11.438719 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1340/2679] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:11 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:11.524285 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-61d997fc-658f-4e4b-8150-d84529f88573 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:11.525275 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-61d997fc-658f-4e4b-8150-d84529f88573 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:11.533445 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61d997fc-658f-4e4b-8150-d84529f88573 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:11.533889 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61d997fc-658f-4e4b-8150-d84529f88573 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:11.534640 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61d997fc-658f-4e4b-8150-d84529f88573 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:11.535064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61d997fc-658f-4e4b-8150-d84529f88573 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:11.675753 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d068f5ff-6f2b-4567-af74-ccf3575e4a39 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:11.676381 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d068f5ff-6f2b-4567-af74-ccf3575e4a39 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:11.682689 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d068f5ff-6f2b-4567-af74-ccf3575e4a39 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:11.683133 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d068f5ff-6f2b-4567-af74-ccf3575e4a39 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:11.683898 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d068f5ff-6f2b-4567-af74-ccf3575e4a39 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:11.684322 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d068f5ff-6f2b-4567-af74-ccf3575e4a39 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:11.686168 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-61d997fc-658f-4e4b-8150-d84529f88573 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:11.694290 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-61d997fc-658f-4e4b-8150-d84529f88573 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.176768 Apr 06 16:59:11.694857 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1340/2680] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:11 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:11.819782 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d068f5ff-6f2b-4567-af74-ccf3575e4a39 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:11.829173 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d068f5ff-6f2b-4567-af74-ccf3575e4a39 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:11.830676 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d068f5ff-6f2b-4567-af74-ccf3575e4a39 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:11.831818 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d068f5ff-6f2b-4567-af74-ccf3575e4a39 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.160128 Apr 06 16:59:11.832362 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1341/2681] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:11 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:12.459724 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4171a23a-a56c-490b-93de-3a6a9e6f17cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:12.460776 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4171a23a-a56c-490b-93de-3a6a9e6f17cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:12.471311 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4171a23a-a56c-490b-93de-3a6a9e6f17cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:12.472059 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4171a23a-a56c-490b-93de-3a6a9e6f17cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:12.473355 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4171a23a-a56c-490b-93de-3a6a9e6f17cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:12.474081 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4171a23a-a56c-490b-93de-3a6a9e6f17cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:12.540463 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4171a23a-a56c-490b-93de-3a6a9e6f17cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:12.548999 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4171a23a-a56c-490b-93de-3a6a9e6f17cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.095867 Apr 06 16:59:12.549566 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1341/2682] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:12 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:12.715959 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6422713c-3eef-4696-b19a-d553ba8fbf53 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:12.716923 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6422713c-3eef-4696-b19a-d553ba8fbf53 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:12.727930 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6422713c-3eef-4696-b19a-d553ba8fbf53 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:12.728671 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6422713c-3eef-4696-b19a-d553ba8fbf53 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:12.730312 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6422713c-3eef-4696-b19a-d553ba8fbf53 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:12.731058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6422713c-3eef-4696-b19a-d553ba8fbf53 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:12.857951 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-27e766f4-8a92-48fe-b3d5-d81976692f6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:12.858722 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-27e766f4-8a92-48fe-b3d5-d81976692f6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:12.864885 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27e766f4-8a92-48fe-b3d5-d81976692f6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:12.865335 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27e766f4-8a92-48fe-b3d5-d81976692f6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:12.866103 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27e766f4-8a92-48fe-b3d5-d81976692f6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:12.866570 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27e766f4-8a92-48fe-b3d5-d81976692f6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:12.875047 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6422713c-3eef-4696-b19a-d553ba8fbf53 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:12.883137 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6422713c-3eef-4696-b19a-d553ba8fbf53 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.173623 Apr 06 16:59:12.883708 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1342/2683] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:12 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:13.003019 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-27e766f4-8a92-48fe-b3d5-d81976692f6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:13.016028 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-27e766f4-8a92-48fe-b3d5-d81976692f6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:13.018373 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-27e766f4-8a92-48fe-b3d5-d81976692f6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:13.020000 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-27e766f4-8a92-48fe-b3d5-d81976692f6d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.166261 Apr 06 16:59:13.020728 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1342/2684] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:12 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:13.570524 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-68f373f5-069c-4cc1-a43d-9f65f2908461 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:13.571514 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-68f373f5-069c-4cc1-a43d-9f65f2908461 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:13.582118 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68f373f5-069c-4cc1-a43d-9f65f2908461 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:13.582949 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68f373f5-069c-4cc1-a43d-9f65f2908461 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:13.584134 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68f373f5-069c-4cc1-a43d-9f65f2908461 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:13.584897 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68f373f5-069c-4cc1-a43d-9f65f2908461 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:13.648070 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-68f373f5-069c-4cc1-a43d-9f65f2908461 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:13.656793 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-68f373f5-069c-4cc1-a43d-9f65f2908461 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.092763 Apr 06 16:59:13.657368 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1343/2685] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:13 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:13.905056 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-275892e9-27fc-4d7a-9eff-0710a4932166 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:13.905971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-275892e9-27fc-4d7a-9eff-0710a4932166 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:13.912722 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-275892e9-27fc-4d7a-9eff-0710a4932166 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:13.913199 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-275892e9-27fc-4d7a-9eff-0710a4932166 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:13.913959 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-275892e9-27fc-4d7a-9eff-0710a4932166 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:13.914392 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-275892e9-27fc-4d7a-9eff-0710a4932166 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:14.042300 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-46dd81fa-1ed2-4700-b747-e4ddb41e523c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:14.042913 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-46dd81fa-1ed2-4700-b747-e4ddb41e523c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:14.049613 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46dd81fa-1ed2-4700-b747-e4ddb41e523c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:14.050073 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46dd81fa-1ed2-4700-b747-e4ddb41e523c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:14.050842 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-275892e9-27fc-4d7a-9eff-0710a4932166 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:14.051014 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46dd81fa-1ed2-4700-b747-e4ddb41e523c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:14.051277 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46dd81fa-1ed2-4700-b747-e4ddb41e523c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:14.061724 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-275892e9-27fc-4d7a-9eff-0710a4932166 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.163038 Apr 06 16:59:14.062924 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1343/2686] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:13 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:14.192466 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-46dd81fa-1ed2-4700-b747-e4ddb41e523c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:14.201542 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-46dd81fa-1ed2-4700-b747-e4ddb41e523c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:14.203311 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-46dd81fa-1ed2-4700-b747-e4ddb41e523c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:14.204464 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-46dd81fa-1ed2-4700-b747-e4ddb41e523c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.166183 Apr 06 16:59:14.205028 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1344/2687] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:14 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:14.683209 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-84c059b1-ea6d-4e8c-b63b-288318ca5493 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:14.684199 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-84c059b1-ea6d-4e8c-b63b-288318ca5493 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:14.692034 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84c059b1-ea6d-4e8c-b63b-288318ca5493 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:14.692490 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84c059b1-ea6d-4e8c-b63b-288318ca5493 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:14.693316 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84c059b1-ea6d-4e8c-b63b-288318ca5493 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:14.693753 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-84c059b1-ea6d-4e8c-b63b-288318ca5493 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:14.758433 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-84c059b1-ea6d-4e8c-b63b-288318ca5493 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:14.766569 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-84c059b1-ea6d-4e8c-b63b-288318ca5493 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.089906 Apr 06 16:59:14.767153 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1344/2688] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:14 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:15.083863 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3d8e718d-d144-4027-8f8e-75778c435101 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:15.084439 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3d8e718d-d144-4027-8f8e-75778c435101 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:15.091301 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d8e718d-d144-4027-8f8e-75778c435101 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:15.091753 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d8e718d-d144-4027-8f8e-75778c435101 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:15.092542 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d8e718d-d144-4027-8f8e-75778c435101 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:15.093090 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d8e718d-d144-4027-8f8e-75778c435101 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:15.229014 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fe2ce0ef-a56f-48e8-9dbb-9ac19919d009 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:15.229657 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fe2ce0ef-a56f-48e8-9dbb-9ac19919d009 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:15.237290 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe2ce0ef-a56f-48e8-9dbb-9ac19919d009 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:15.237631 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe2ce0ef-a56f-48e8-9dbb-9ac19919d009 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:15.238399 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe2ce0ef-a56f-48e8-9dbb-9ac19919d009 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:15.239050 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe2ce0ef-a56f-48e8-9dbb-9ac19919d009 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:15.239931 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3d8e718d-d144-4027-8f8e-75778c435101 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:15.248056 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3d8e718d-d144-4027-8f8e-75778c435101 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.168258 Apr 06 16:59:15.248589 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1345/2689] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:15 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:15.382955 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fe2ce0ef-a56f-48e8-9dbb-9ac19919d009 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:15.395672 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fe2ce0ef-a56f-48e8-9dbb-9ac19919d009 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:15.397983 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fe2ce0ef-a56f-48e8-9dbb-9ac19919d009 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:15.399724 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fe2ce0ef-a56f-48e8-9dbb-9ac19919d009 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.174485 Apr 06 16:59:15.400500 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1345/2690] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:15 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:15.787903 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-25bc39e6-df53-4b91-8f23-571f263842b5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:15.788608 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-25bc39e6-df53-4b91-8f23-571f263842b5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:15.797674 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25bc39e6-df53-4b91-8f23-571f263842b5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:15.798134 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25bc39e6-df53-4b91-8f23-571f263842b5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:15.798900 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25bc39e6-df53-4b91-8f23-571f263842b5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:15.799333 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25bc39e6-df53-4b91-8f23-571f263842b5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:15.866386 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-25bc39e6-df53-4b91-8f23-571f263842b5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:15.877301 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-25bc39e6-df53-4b91-8f23-571f263842b5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.095987 Apr 06 16:59:15.877871 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1346/2691] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:15 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:16.268503 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4fc5fe06-5808-4d32-86bc-862b933dcb76 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:16.269263 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4fc5fe06-5808-4d32-86bc-862b933dcb76 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:16.277274 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4fc5fe06-5808-4d32-86bc-862b933dcb76 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:16.277805 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4fc5fe06-5808-4d32-86bc-862b933dcb76 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:16.278705 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4fc5fe06-5808-4d32-86bc-862b933dcb76 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:16.279214 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4fc5fe06-5808-4d32-86bc-862b933dcb76 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:16.419445 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e1f12ec4-837c-4c7c-b735-1a54f985bafe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:16.420038 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e1f12ec4-837c-4c7c-b735-1a54f985bafe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:16.424523 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4fc5fe06-5808-4d32-86bc-862b933dcb76 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:16.427236 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1f12ec4-837c-4c7c-b735-1a54f985bafe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:16.427687 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1f12ec4-837c-4c7c-b735-1a54f985bafe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:16.428464 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1f12ec4-837c-4c7c-b735-1a54f985bafe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:16.428930 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1f12ec4-837c-4c7c-b735-1a54f985bafe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:16.433216 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4fc5fe06-5808-4d32-86bc-862b933dcb76 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.169877 Apr 06 16:59:16.433765 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1346/2692] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:16 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:16.584743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e1f12ec4-837c-4c7c-b735-1a54f985bafe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:16.596715 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e1f12ec4-837c-4c7c-b735-1a54f985bafe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:16.598238 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e1f12ec4-837c-4c7c-b735-1a54f985bafe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:16.599407 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e1f12ec4-837c-4c7c-b735-1a54f985bafe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.184218 Apr 06 16:59:16.599978 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1347/2693] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:16 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:16.903417 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b39fc964-a1b6-4557-8a32-30ebf191dce2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:16.904402 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b39fc964-a1b6-4557-8a32-30ebf191dce2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:16.911621 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b39fc964-a1b6-4557-8a32-30ebf191dce2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:16.912063 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b39fc964-a1b6-4557-8a32-30ebf191dce2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:16.912850 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b39fc964-a1b6-4557-8a32-30ebf191dce2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:16.913276 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b39fc964-a1b6-4557-8a32-30ebf191dce2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:16.974524 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b39fc964-a1b6-4557-8a32-30ebf191dce2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:16.983026 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b39fc964-a1b6-4557-8a32-30ebf191dce2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086054 Apr 06 16:59:16.983623 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1347/2694] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:16 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:17.460732 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-07d56388-8c61-4a9d-bb6f-e59ef25523f8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:17.461721 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-07d56388-8c61-4a9d-bb6f-e59ef25523f8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:17.471066 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07d56388-8c61-4a9d-bb6f-e59ef25523f8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:17.471518 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07d56388-8c61-4a9d-bb6f-e59ef25523f8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:17.472303 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07d56388-8c61-4a9d-bb6f-e59ef25523f8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:17.472746 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07d56388-8c61-4a9d-bb6f-e59ef25523f8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:17.620803 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-07d56388-8c61-4a9d-bb6f-e59ef25523f8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:17.623967 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8a67e7a6-e3cb-40ec-ba79-2df2cf4e182f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:17.624768 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8a67e7a6-e3cb-40ec-ba79-2df2cf4e182f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:17.629086 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-07d56388-8c61-4a9d-bb6f-e59ef25523f8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.174892 Apr 06 16:59:17.629868 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1348/2695] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:17 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:17.631218 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a67e7a6-e3cb-40ec-ba79-2df2cf4e182f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:17.631658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a67e7a6-e3cb-40ec-ba79-2df2cf4e182f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:17.632410 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a67e7a6-e3cb-40ec-ba79-2df2cf4e182f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:17.632875 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8a67e7a6-e3cb-40ec-ba79-2df2cf4e182f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:17.766259 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8a67e7a6-e3cb-40ec-ba79-2df2cf4e182f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:17.782777 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8a67e7a6-e3cb-40ec-ba79-2df2cf4e182f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:17.785302 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8a67e7a6-e3cb-40ec-ba79-2df2cf4e182f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:17.786998 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8a67e7a6-e3cb-40ec-ba79-2df2cf4e182f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.166692 Apr 06 16:59:17.787727 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1348/2696] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:17 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:59:18.009293 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c9c3308a-3b8c-41c2-a4dc-85cadbaccf97 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:18.010178 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c9c3308a-3b8c-41c2-a4dc-85cadbaccf97 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:18.018421 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9c3308a-3b8c-41c2-a4dc-85cadbaccf97 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:18.018875 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9c3308a-3b8c-41c2-a4dc-85cadbaccf97 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:18.019642 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9c3308a-3b8c-41c2-a4dc-85cadbaccf97 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:18.020081 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9c3308a-3b8c-41c2-a4dc-85cadbaccf97 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:18.085428 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c9c3308a-3b8c-41c2-a4dc-85cadbaccf97 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:18.094165 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c9c3308a-3b8c-41c2-a4dc-85cadbaccf97 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.091605 Apr 06 16:59:18.094759 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1349/2697] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:18 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:18.650734 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4b8c38fe-1688-4332-9581-178932fc4007 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:18.651789 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4b8c38fe-1688-4332-9581-178932fc4007 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:18.663764 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b8c38fe-1688-4332-9581-178932fc4007 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:18.664513 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b8c38fe-1688-4332-9581-178932fc4007 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:18.665897 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b8c38fe-1688-4332-9581-178932fc4007 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:18.666620 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4b8c38fe-1688-4332-9581-178932fc4007 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:18.807857 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e4ea7005-b199-4fee-8446-e19e0373c3c3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:18.808486 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e4ea7005-b199-4fee-8446-e19e0373c3c3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:18.814921 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4b8c38fe-1688-4332-9581-178932fc4007 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:18.815333 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4ea7005-b199-4fee-8446-e19e0373c3c3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:18.815757 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4ea7005-b199-4fee-8446-e19e0373c3c3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:18.816538 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4ea7005-b199-4fee-8446-e19e0373c3c3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:18.817008 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4ea7005-b199-4fee-8446-e19e0373c3c3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:18.822802 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4b8c38fe-1688-4332-9581-178932fc4007 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.178539 Apr 06 16:59:18.823403 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1349/2698] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:18 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:18.954741 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e4ea7005-b199-4fee-8446-e19e0373c3c3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:18.968299 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e4ea7005-b199-4fee-8446-e19e0373c3c3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:18.970011 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e4ea7005-b199-4fee-8446-e19e0373c3c3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:18.971203 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e4ea7005-b199-4fee-8446-e19e0373c3c3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.167374 Apr 06 16:59:18.971832 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1350/2699] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:18 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:19.116510 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-39068a32-96a8-4fcd-8bd0-f3f493d8e679 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:19.117574 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-39068a32-96a8-4fcd-8bd0-f3f493d8e679 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:19.126604 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39068a32-96a8-4fcd-8bd0-f3f493d8e679 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:19.127050 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39068a32-96a8-4fcd-8bd0-f3f493d8e679 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:19.127816 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39068a32-96a8-4fcd-8bd0-f3f493d8e679 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:19.128250 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-39068a32-96a8-4fcd-8bd0-f3f493d8e679 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:19.195132 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-39068a32-96a8-4fcd-8bd0-f3f493d8e679 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:19.204130 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-39068a32-96a8-4fcd-8bd0-f3f493d8e679 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.094134 Apr 06 16:59:19.204707 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1350/2700] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:19 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:19.842825 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2a901374-8e7c-45ea-bb00-3930fc81fd44 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:19.843593 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2a901374-8e7c-45ea-bb00-3930fc81fd44 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:19.850454 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a901374-8e7c-45ea-bb00-3930fc81fd44 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:19.850904 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a901374-8e7c-45ea-bb00-3930fc81fd44 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:19.851676 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a901374-8e7c-45ea-bb00-3930fc81fd44 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:19.852110 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a901374-8e7c-45ea-bb00-3930fc81fd44 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:19.990779 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-10ae22f2-9248-4fa1-984f-acd48c760609 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:19.991373 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-10ae22f2-9248-4fa1-984f-acd48c760609 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:19.997946 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10ae22f2-9248-4fa1-984f-acd48c760609 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:19.998390 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10ae22f2-9248-4fa1-984f-acd48c760609 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:19.999245 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10ae22f2-9248-4fa1-984f-acd48c760609 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:19.999601 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-10ae22f2-9248-4fa1-984f-acd48c760609 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:20.001909 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2a901374-8e7c-45ea-bb00-3930fc81fd44 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:20.010508 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2a901374-8e7c-45ea-bb00-3930fc81fd44 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.173695 Apr 06 16:59:20.011107 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1351/2701] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:19 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:20.137699 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-10ae22f2-9248-4fa1-984f-acd48c760609 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:20.147686 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-10ae22f2-9248-4fa1-984f-acd48c760609 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:20.149239 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-10ae22f2-9248-4fa1-984f-acd48c760609 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:20.150400 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-10ae22f2-9248-4fa1-984f-acd48c760609 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.163562 Apr 06 16:59:20.150966 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1351/2702] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:19 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 16:59:20.222055 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c0b14049-e6b3-4b55-88e4-3622d511f09f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:20.222663 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c0b14049-e6b3-4b55-88e4-3622d511f09f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:20.229206 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0b14049-e6b3-4b55-88e4-3622d511f09f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:20.229656 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0b14049-e6b3-4b55-88e4-3622d511f09f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:20.230803 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0b14049-e6b3-4b55-88e4-3622d511f09f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:20.231240 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0b14049-e6b3-4b55-88e4-3622d511f09f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:20.290995 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c0b14049-e6b3-4b55-88e4-3622d511f09f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:20.299523 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c0b14049-e6b3-4b55-88e4-3622d511f09f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.081421 Apr 06 16:59:20.300091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1352/2703] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:20 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:21.027802 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ea06d10c-abe7-442f-8d5d-dc83b82e7ca9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:21.029570 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ea06d10c-abe7-442f-8d5d-dc83b82e7ca9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:21.039724 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea06d10c-abe7-442f-8d5d-dc83b82e7ca9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:21.040285 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea06d10c-abe7-442f-8d5d-dc83b82e7ca9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:21.041423 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea06d10c-abe7-442f-8d5d-dc83b82e7ca9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:21.042201 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea06d10c-abe7-442f-8d5d-dc83b82e7ca9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:21.170003 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2533d68f-5ebe-492c-af37-e6fba1cd80c4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:21.170663 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2533d68f-5ebe-492c-af37-e6fba1cd80c4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:21.177336 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2533d68f-5ebe-492c-af37-e6fba1cd80c4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:21.177702 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2533d68f-5ebe-492c-af37-e6fba1cd80c4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:21.178484 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2533d68f-5ebe-492c-af37-e6fba1cd80c4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:21.178921 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2533d68f-5ebe-492c-af37-e6fba1cd80c4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:21.190904 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ea06d10c-abe7-442f-8d5d-dc83b82e7ca9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:21.199547 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ea06d10c-abe7-442f-8d5d-dc83b82e7ca9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.175671 Apr 06 16:59:21.200567 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1352/2704] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:21 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:21.316832 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2533d68f-5ebe-492c-af37-e6fba1cd80c4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:21.320885 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-935ef37d-6265-4f7a-a23c-b803eed4a6ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:21.321479 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-935ef37d-6265-4f7a-a23c-b803eed4a6ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:21.325727 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2533d68f-5ebe-492c-af37-e6fba1cd80c4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:21.327371 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2533d68f-5ebe-492c-af37-e6fba1cd80c4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:21.327540 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-935ef37d-6265-4f7a-a23c-b803eed4a6ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:21.327983 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-935ef37d-6265-4f7a-a23c-b803eed4a6ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:21.328535 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2533d68f-5ebe-492c-af37-e6fba1cd80c4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.162776 Apr 06 16:59:21.328790 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-935ef37d-6265-4f7a-a23c-b803eed4a6ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:21.329414 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1353/2705] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:21 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:21.329574 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-935ef37d-6265-4f7a-a23c-b803eed4a6ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:21.398969 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-935ef37d-6265-4f7a-a23c-b803eed4a6ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:21.407256 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-935ef37d-6265-4f7a-a23c-b803eed4a6ec tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.090195 Apr 06 16:59:21.407834 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1353/2706] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:21 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:59:22.217425 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-db061de0-7e5a-483c-9669-8335fb1e928d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:22.218184 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-db061de0-7e5a-483c-9669-8335fb1e928d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:22.225148 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db061de0-7e5a-483c-9669-8335fb1e928d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:22.225599 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db061de0-7e5a-483c-9669-8335fb1e928d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:22.226357 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db061de0-7e5a-483c-9669-8335fb1e928d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:22.226790 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db061de0-7e5a-483c-9669-8335fb1e928d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:22.347754 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b55ee49e-bc16-4258-85ad-8333d44e25b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:22.348392 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b55ee49e-bc16-4258-85ad-8333d44e25b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:22.354821 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b55ee49e-bc16-4258-85ad-8333d44e25b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:22.355635 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b55ee49e-bc16-4258-85ad-8333d44e25b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:22.356412 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b55ee49e-bc16-4258-85ad-8333d44e25b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:22.356872 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b55ee49e-bc16-4258-85ad-8333d44e25b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:22.371994 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-db061de0-7e5a-483c-9669-8335fb1e928d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:22.380352 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-db061de0-7e5a-483c-9669-8335fb1e928d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.166853 Apr 06 16:59:22.380963 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1354/2707] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:22 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:22.430084 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3141dda4-cc3f-4601-a9ee-30c2ede594fa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:22.430799 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3141dda4-cc3f-4601-a9ee-30c2ede594fa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:22.437225 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3141dda4-cc3f-4601-a9ee-30c2ede594fa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:22.437615 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3141dda4-cc3f-4601-a9ee-30c2ede594fa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:22.438407 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3141dda4-cc3f-4601-a9ee-30c2ede594fa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:22.438835 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3141dda4-cc3f-4601-a9ee-30c2ede594fa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:22.494088 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b55ee49e-bc16-4258-85ad-8333d44e25b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:22.498859 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3141dda4-cc3f-4601-a9ee-30c2ede594fa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:22.505611 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b55ee49e-bc16-4258-85ad-8333d44e25b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:22.507110 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b55ee49e-bc16-4258-85ad-8333d44e25b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:22.507272 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3141dda4-cc3f-4601-a9ee-30c2ede594fa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.081188 Apr 06 16:59:22.507668 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1355/2708] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:22 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:22.508499 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b55ee49e-bc16-4258-85ad-8333d44e25b4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.164904 Apr 06 16:59:22.509224 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1354/2709] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:22 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:23.398242 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d3e7d46d-4e72-483c-923e-d36bbece08e8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:23.398894 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d3e7d46d-4e72-483c-923e-d36bbece08e8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:23.406595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3e7d46d-4e72-483c-923e-d36bbece08e8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:23.407037 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3e7d46d-4e72-483c-923e-d36bbece08e8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:23.407798 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3e7d46d-4e72-483c-923e-d36bbece08e8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:23.408222 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3e7d46d-4e72-483c-923e-d36bbece08e8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:23.526683 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fbb7406a-76e2-4ec5-9bb9-289b3f61eca9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:23.527549 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fbb7406a-76e2-4ec5-9bb9-289b3f61eca9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:23.535149 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbb7406a-76e2-4ec5-9bb9-289b3f61eca9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:23.535605 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbb7406a-76e2-4ec5-9bb9-289b3f61eca9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:23.536372 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbb7406a-76e2-4ec5-9bb9-289b3f61eca9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:23.536840 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbb7406a-76e2-4ec5-9bb9-289b3f61eca9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:23.564712 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d3e7d46d-4e72-483c-923e-d36bbece08e8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:23.572795 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d3e7d46d-4e72-483c-923e-d36bbece08e8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.178478 Apr 06 16:59:23.573389 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1356/2710] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:23 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:23.578637 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fefba7b4-ee6e-4c3f-8755-e596c015d910 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:23.579240 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fefba7b4-ee6e-4c3f-8755-e596c015d910 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:23.585343 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fefba7b4-ee6e-4c3f-8755-e596c015d910 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:23.585723 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fefba7b4-ee6e-4c3f-8755-e596c015d910 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:23.586496 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fefba7b4-ee6e-4c3f-8755-e596c015d910 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:23.586935 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fefba7b4-ee6e-4c3f-8755-e596c015d910 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:23.599470 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fbb7406a-76e2-4ec5-9bb9-289b3f61eca9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:23.609637 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fbb7406a-76e2-4ec5-9bb9-289b3f61eca9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.088094 Apr 06 16:59:23.610656 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1355/2711] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:23 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:59:23.725684 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fefba7b4-ee6e-4c3f-8755-e596c015d910 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:23.735418 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fefba7b4-ee6e-4c3f-8755-e596c015d910 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:23.736933 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fefba7b4-ee6e-4c3f-8755-e596c015d910 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:23.738093 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fefba7b4-ee6e-4c3f-8755-e596c015d910 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.163785 Apr 06 16:59:23.738655 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1357/2712] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:23 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:24.595001 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a5589193-5d27-4da8-b727-d5e83f3cdaa3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:24.595934 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a5589193-5d27-4da8-b727-d5e83f3cdaa3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:24.606921 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5589193-5d27-4da8-b727-d5e83f3cdaa3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:24.607720 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5589193-5d27-4da8-b727-d5e83f3cdaa3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:24.608894 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5589193-5d27-4da8-b727-d5e83f3cdaa3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:24.609420 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a5589193-5d27-4da8-b727-d5e83f3cdaa3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:24.630121 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bc24d41c-d362-4821-88ae-ab4c3a71baf0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:24.630800 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bc24d41c-d362-4821-88ae-ab4c3a71baf0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:24.637799 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc24d41c-d362-4821-88ae-ab4c3a71baf0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:24.638249 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc24d41c-d362-4821-88ae-ab4c3a71baf0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:24.639034 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc24d41c-d362-4821-88ae-ab4c3a71baf0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:24.639591 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc24d41c-d362-4821-88ae-ab4c3a71baf0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:24.704926 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-bc24d41c-d362-4821-88ae-ab4c3a71baf0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:24.713941 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bc24d41c-d362-4821-88ae-ab4c3a71baf0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.087759 Apr 06 16:59:24.714540 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1358/2713] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:24 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:24.757440 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-20ae126a-9dc4-48df-a12f-7d6994f81107 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:24.758092 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-20ae126a-9dc4-48df-a12f-7d6994f81107 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:24.765515 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20ae126a-9dc4-48df-a12f-7d6994f81107 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:24.766140 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20ae126a-9dc4-48df-a12f-7d6994f81107 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:24.766951 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20ae126a-9dc4-48df-a12f-7d6994f81107 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:24.767383 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20ae126a-9dc4-48df-a12f-7d6994f81107 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:24.910709 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-20ae126a-9dc4-48df-a12f-7d6994f81107 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:24.919380 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-20ae126a-9dc4-48df-a12f-7d6994f81107 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:24.920979 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-20ae126a-9dc4-48df-a12f-7d6994f81107 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:24.922491 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-20ae126a-9dc4-48df-a12f-7d6994f81107 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.169098 Apr 06 16:59:24.923065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1359/2714] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:24 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:24.927712 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a5589193-5d27-4da8-b727-d5e83f3cdaa3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:24.935873 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a5589193-5d27-4da8-b727-d5e83f3cdaa3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.347585 Apr 06 16:59:24.936511 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1356/2715] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:24 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:25.732380 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5233d46a-f5aa-49df-bc0d-fd23d66f9729 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:25.733043 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5233d46a-f5aa-49df-bc0d-fd23d66f9729 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:25.740194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5233d46a-f5aa-49df-bc0d-fd23d66f9729 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:25.740647 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5233d46a-f5aa-49df-bc0d-fd23d66f9729 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:25.741465 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5233d46a-f5aa-49df-bc0d-fd23d66f9729 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:25.741902 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5233d46a-f5aa-49df-bc0d-fd23d66f9729 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:25.805380 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5233d46a-f5aa-49df-bc0d-fd23d66f9729 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:25.813343 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5233d46a-f5aa-49df-bc0d-fd23d66f9729 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.085328 Apr 06 16:59:25.813910 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1360/2716] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:25 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:25.943497 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e58a70bd-7702-4f61-a03a-03ec12d7542d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:25.944132 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e58a70bd-7702-4f61-a03a-03ec12d7542d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:25.950881 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e58a70bd-7702-4f61-a03a-03ec12d7542d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:25.951317 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e58a70bd-7702-4f61-a03a-03ec12d7542d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:25.952145 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e58a70bd-7702-4f61-a03a-03ec12d7542d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:25.952715 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e58a70bd-7702-4f61-a03a-03ec12d7542d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:25.953659 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-789b9037-c66c-4842-8588-e0430baa30ea tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:25.954270 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-789b9037-c66c-4842-8588-e0430baa30ea tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:25.960297 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-789b9037-c66c-4842-8588-e0430baa30ea tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:25.960779 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-789b9037-c66c-4842-8588-e0430baa30ea tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:25.961582 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-789b9037-c66c-4842-8588-e0430baa30ea tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:25.962016 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-789b9037-c66c-4842-8588-e0430baa30ea tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:26.088618 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e58a70bd-7702-4f61-a03a-03ec12d7542d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:26.097289 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e58a70bd-7702-4f61-a03a-03ec12d7542d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:26.098742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e58a70bd-7702-4f61-a03a-03ec12d7542d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:26.099953 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e58a70bd-7702-4f61-a03a-03ec12d7542d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.160505 Apr 06 16:59:26.111065 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1357/2717] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:25 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:26.111243 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-789b9037-c66c-4842-8588-e0430baa30ea tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:26.111243 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-789b9037-c66c-4842-8588-e0430baa30ea tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.160785 Apr 06 16:59:26.111243 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1361/2718] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:25 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:26.834680 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ad6d6836-1675-4915-8407-e90e66a33b22 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:26.835678 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ad6d6836-1675-4915-8407-e90e66a33b22 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:26.846155 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad6d6836-1675-4915-8407-e90e66a33b22 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:26.846906 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad6d6836-1675-4915-8407-e90e66a33b22 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:26.848131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad6d6836-1675-4915-8407-e90e66a33b22 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:26.848944 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ad6d6836-1675-4915-8407-e90e66a33b22 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:26.915978 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ad6d6836-1675-4915-8407-e90e66a33b22 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:26.924569 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ad6d6836-1675-4915-8407-e90e66a33b22 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.096455 Apr 06 16:59:26.925159 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1358/2719] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:26 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:27.123333 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7cdc413b-6048-49f5-80fa-a3113169b61c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:27.124295 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7cdc413b-6048-49f5-80fa-a3113169b61c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:27.129126 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3f86a108-39a6-47b4-9772-e62bc79c8918 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:27.129738 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3f86a108-39a6-47b4-9772-e62bc79c8918 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:27.131002 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cdc413b-6048-49f5-80fa-a3113169b61c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:27.131647 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cdc413b-6048-49f5-80fa-a3113169b61c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:27.132432 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cdc413b-6048-49f5-80fa-a3113169b61c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:27.133327 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cdc413b-6048-49f5-80fa-a3113169b61c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:27.136351 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f86a108-39a6-47b4-9772-e62bc79c8918 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:27.136943 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f86a108-39a6-47b4-9772-e62bc79c8918 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:27.137712 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f86a108-39a6-47b4-9772-e62bc79c8918 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:27.138148 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3f86a108-39a6-47b4-9772-e62bc79c8918 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:27.277185 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7cdc413b-6048-49f5-80fa-a3113169b61c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:27.289797 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7cdc413b-6048-49f5-80fa-a3113169b61c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:27.291291 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7cdc413b-6048-49f5-80fa-a3113169b61c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:27.292474 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7cdc413b-6048-49f5-80fa-a3113169b61c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.175898 Apr 06 16:59:27.293113 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1362/2720] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:27 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:27.504716 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3f86a108-39a6-47b4-9772-e62bc79c8918 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:27.512565 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3f86a108-39a6-47b4-9772-e62bc79c8918 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.387278 Apr 06 16:59:27.513202 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1359/2721] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:27 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:27.950025 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a05a5d9b-ab50-40eb-a0fd-5e3335b14f27 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:27.950922 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a05a5d9b-ab50-40eb-a0fd-5e3335b14f27 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:27.961750 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a05a5d9b-ab50-40eb-a0fd-5e3335b14f27 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:27.962325 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a05a5d9b-ab50-40eb-a0fd-5e3335b14f27 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:27.963608 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a05a5d9b-ab50-40eb-a0fd-5e3335b14f27 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:27.964340 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a05a5d9b-ab50-40eb-a0fd-5e3335b14f27 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:28.040234 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a05a5d9b-ab50-40eb-a0fd-5e3335b14f27 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:28.048382 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a05a5d9b-ab50-40eb-a0fd-5e3335b14f27 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.104635 Apr 06 16:59:28.048993 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1363/2722] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:27 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:28.317245 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-75d7e972-945e-40e4-8cef-8901284c5d77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:28.318150 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-75d7e972-945e-40e4-8cef-8901284c5d77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:28.328400 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75d7e972-945e-40e4-8cef-8901284c5d77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:28.328891 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75d7e972-945e-40e4-8cef-8901284c5d77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:28.329663 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75d7e972-945e-40e4-8cef-8901284c5d77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:28.330098 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75d7e972-945e-40e4-8cef-8901284c5d77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:28.477937 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-75d7e972-945e-40e4-8cef-8901284c5d77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:28.489200 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-75d7e972-945e-40e4-8cef-8901284c5d77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:28.490669 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-75d7e972-945e-40e4-8cef-8901284c5d77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:28.491824 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-75d7e972-945e-40e4-8cef-8901284c5d77 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.181628 Apr 06 16:59:28.492377 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1360/2723] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:28 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:28.530513 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c4e6450e-7200-4994-beed-4a92b308cfba tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:28.531090 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c4e6450e-7200-4994-beed-4a92b308cfba tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:28.537831 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4e6450e-7200-4994-beed-4a92b308cfba tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:28.538272 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4e6450e-7200-4994-beed-4a92b308cfba tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:28.539070 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4e6450e-7200-4994-beed-4a92b308cfba tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:28.539520 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4e6450e-7200-4994-beed-4a92b308cfba tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:28.702694 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c4e6450e-7200-4994-beed-4a92b308cfba tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:28.714695 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c4e6450e-7200-4994-beed-4a92b308cfba tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.187891 Apr 06 16:59:28.715449 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1364/2724] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:28 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:29.068221 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-59b81d4f-208c-44c7-bc65-5852e0c273cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:29.069262 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-59b81d4f-208c-44c7-bc65-5852e0c273cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:29.078898 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59b81d4f-208c-44c7-bc65-5852e0c273cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:29.079351 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59b81d4f-208c-44c7-bc65-5852e0c273cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:29.080127 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59b81d4f-208c-44c7-bc65-5852e0c273cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:29.080561 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59b81d4f-208c-44c7-bc65-5852e0c273cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:29.153491 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-59b81d4f-208c-44c7-bc65-5852e0c273cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:29.162310 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-59b81d4f-208c-44c7-bc65-5852e0c273cf tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.099889 Apr 06 16:59:29.162896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1361/2725] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:29 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:29.514297 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-baa6e24b-f557-4889-81a0-93c5bc24e888 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:29.515025 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-baa6e24b-f557-4889-81a0-93c5bc24e888 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:29.524278 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-baa6e24b-f557-4889-81a0-93c5bc24e888 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:29.524899 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-baa6e24b-f557-4889-81a0-93c5bc24e888 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:29.526025 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-baa6e24b-f557-4889-81a0-93c5bc24e888 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:29.526575 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-baa6e24b-f557-4889-81a0-93c5bc24e888 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:29.673020 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-baa6e24b-f557-4889-81a0-93c5bc24e888 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:29.686747 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-baa6e24b-f557-4889-81a0-93c5bc24e888 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:29.688257 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-baa6e24b-f557-4889-81a0-93c5bc24e888 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:29.689456 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-baa6e24b-f557-4889-81a0-93c5bc24e888 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.181371 Apr 06 16:59:29.690021 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1365/2726] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:29 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:29.736660 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-59194dc9-e0e7-47a4-ab15-0eca965b72e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:29.737387 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-59194dc9-e0e7-47a4-ab15-0eca965b72e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:29.743811 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59194dc9-e0e7-47a4-ab15-0eca965b72e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:29.744252 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59194dc9-e0e7-47a4-ab15-0eca965b72e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:29.745148 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59194dc9-e0e7-47a4-ab15-0eca965b72e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:29.745729 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-59194dc9-e0e7-47a4-ab15-0eca965b72e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:29.905770 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-59194dc9-e0e7-47a4-ab15-0eca965b72e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:29.914170 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-59194dc9-e0e7-47a4-ab15-0eca965b72e1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.181778 Apr 06 16:59:29.914740 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1362/2727] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:29 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:30.187968 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-57f4c139-45dd-4f10-870b-e59fdb47f5de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:30.188498 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-57f4c139-45dd-4f10-870b-e59fdb47f5de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:30.195325 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57f4c139-45dd-4f10-870b-e59fdb47f5de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:30.195793 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57f4c139-45dd-4f10-870b-e59fdb47f5de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:30.196581 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57f4c139-45dd-4f10-870b-e59fdb47f5de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:30.197061 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57f4c139-45dd-4f10-870b-e59fdb47f5de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:30.268999 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-57f4c139-45dd-4f10-870b-e59fdb47f5de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:30.281720 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-57f4c139-45dd-4f10-870b-e59fdb47f5de tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.100108 Apr 06 16:59:30.282287 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1366/2728] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:30 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:30.712869 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-72003127-63db-4869-bda3-864fa7299931 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:30.713860 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-72003127-63db-4869-bda3-864fa7299931 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:30.724169 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72003127-63db-4869-bda3-864fa7299931 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:30.724979 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72003127-63db-4869-bda3-864fa7299931 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:30.726243 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72003127-63db-4869-bda3-864fa7299931 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:30.726963 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-72003127-63db-4869-bda3-864fa7299931 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:30.871310 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-72003127-63db-4869-bda3-864fa7299931 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:30.880347 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-72003127-63db-4869-bda3-864fa7299931 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:30.881870 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-72003127-63db-4869-bda3-864fa7299931 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:30.883039 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-72003127-63db-4869-bda3-864fa7299931 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.176700 Apr 06 16:59:30.883591 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1363/2729] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:30 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:30.932418 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d392e6e7-a3c8-446d-8995-5098c61c25de tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:30.933060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d392e6e7-a3c8-446d-8995-5098c61c25de tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:30.939956 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d392e6e7-a3c8-446d-8995-5098c61c25de tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:30.940406 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d392e6e7-a3c8-446d-8995-5098c61c25de tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:30.941222 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d392e6e7-a3c8-446d-8995-5098c61c25de tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:30.941657 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d392e6e7-a3c8-446d-8995-5098c61c25de tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:31.077139 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d392e6e7-a3c8-446d-8995-5098c61c25de tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:31.085471 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d392e6e7-a3c8-446d-8995-5098c61c25de tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.156951 Apr 06 16:59:31.085998 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1367/2730] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:30 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:31.299435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a60d19ee-bbc1-4f6e-bc0e-a24f3408a27f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:31.299935 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a60d19ee-bbc1-4f6e-bc0e-a24f3408a27f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:31.306428 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a60d19ee-bbc1-4f6e-bc0e-a24f3408a27f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:31.306874 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a60d19ee-bbc1-4f6e-bc0e-a24f3408a27f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:31.307633 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a60d19ee-bbc1-4f6e-bc0e-a24f3408a27f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:31.308054 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a60d19ee-bbc1-4f6e-bc0e-a24f3408a27f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:31.373058 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a60d19ee-bbc1-4f6e-bc0e-a24f3408a27f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:31.386663 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a60d19ee-bbc1-4f6e-bc0e-a24f3408a27f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.091314 Apr 06 16:59:31.387569 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1364/2731] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:31 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:31.903370 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fb6eec6a-4cb8-40bc-869f-42f7cf4115d3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:31.904046 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fb6eec6a-4cb8-40bc-869f-42f7cf4115d3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:31.910934 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb6eec6a-4cb8-40bc-869f-42f7cf4115d3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:31.911387 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb6eec6a-4cb8-40bc-869f-42f7cf4115d3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:31.912160 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb6eec6a-4cb8-40bc-869f-42f7cf4115d3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:31.912606 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb6eec6a-4cb8-40bc-869f-42f7cf4115d3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:32.050214 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fb6eec6a-4cb8-40bc-869f-42f7cf4115d3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:32.059439 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fb6eec6a-4cb8-40bc-869f-42f7cf4115d3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:32.060965 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fb6eec6a-4cb8-40bc-869f-42f7cf4115d3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:32.062123 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fb6eec6a-4cb8-40bc-869f-42f7cf4115d3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.163253 Apr 06 16:59:32.062690 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1368/2732] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:31 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:32.102941 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c6289d43-abb0-43ff-a737-4ce63daa404f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:32.103513 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c6289d43-abb0-43ff-a737-4ce63daa404f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:32.110803 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6289d43-abb0-43ff-a737-4ce63daa404f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:32.111243 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6289d43-abb0-43ff-a737-4ce63daa404f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:32.111994 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6289d43-abb0-43ff-a737-4ce63daa404f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:32.112439 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6289d43-abb0-43ff-a737-4ce63daa404f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:32.254608 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c6289d43-abb0-43ff-a737-4ce63daa404f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:32.262608 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c6289d43-abb0-43ff-a737-4ce63daa404f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.163525 Apr 06 16:59:32.263182 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1365/2733] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:32 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:32.411420 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-53626565-ae1f-447b-ac96-db6664fa32f6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:32.412242 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-53626565-ae1f-447b-ac96-db6664fa32f6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:32.421230 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53626565-ae1f-447b-ac96-db6664fa32f6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:32.421883 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53626565-ae1f-447b-ac96-db6664fa32f6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:32.422987 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53626565-ae1f-447b-ac96-db6664fa32f6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:32.423601 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53626565-ae1f-447b-ac96-db6664fa32f6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:32.495726 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-53626565-ae1f-447b-ac96-db6664fa32f6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:32.504728 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-53626565-ae1f-447b-ac96-db6664fa32f6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.099338 Apr 06 16:59:32.505415 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1369/2734] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:32 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:33.085124 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1e1c466b-4ea2-47d6-9833-7c2b2b67b3d2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:33.086119 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1e1c466b-4ea2-47d6-9833-7c2b2b67b3d2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:33.095333 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e1c466b-4ea2-47d6-9833-7c2b2b67b3d2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:33.095788 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e1c466b-4ea2-47d6-9833-7c2b2b67b3d2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:33.096585 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e1c466b-4ea2-47d6-9833-7c2b2b67b3d2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:33.097062 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1e1c466b-4ea2-47d6-9833-7c2b2b67b3d2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:33.246554 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e1c466b-4ea2-47d6-9833-7c2b2b67b3d2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:33.255777 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e1c466b-4ea2-47d6-9833-7c2b2b67b3d2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:33.257312 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1e1c466b-4ea2-47d6-9833-7c2b2b67b3d2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:33.258482 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1e1c466b-4ea2-47d6-9833-7c2b2b67b3d2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.180006 Apr 06 16:59:33.259045 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1366/2735] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:33 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:33.279385 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8da44443-e87e-4c07-98c4-12d460f7e11a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:33.279987 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8da44443-e87e-4c07-98c4-12d460f7e11a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:33.286707 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8da44443-e87e-4c07-98c4-12d460f7e11a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:33.287175 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8da44443-e87e-4c07-98c4-12d460f7e11a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:33.287927 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8da44443-e87e-4c07-98c4-12d460f7e11a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:33.288344 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8da44443-e87e-4c07-98c4-12d460f7e11a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:33.435776 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8da44443-e87e-4c07-98c4-12d460f7e11a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:33.448398 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8da44443-e87e-4c07-98c4-12d460f7e11a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.172481 Apr 06 16:59:33.449149 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1370/2736] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:33 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:59:33.531375 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-44b9e4b4-2aac-41be-8d11-cca8c0bada4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:33.532416 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-44b9e4b4-2aac-41be-8d11-cca8c0bada4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:33.542758 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44b9e4b4-2aac-41be-8d11-cca8c0bada4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:33.543509 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44b9e4b4-2aac-41be-8d11-cca8c0bada4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:33.544778 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44b9e4b4-2aac-41be-8d11-cca8c0bada4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:33.545536 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-44b9e4b4-2aac-41be-8d11-cca8c0bada4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:33.621000 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-44b9e4b4-2aac-41be-8d11-cca8c0bada4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:33.629247 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-44b9e4b4-2aac-41be-8d11-cca8c0bada4d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.104405 Apr 06 16:59:33.629786 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1367/2737] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:33 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:34.282636 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cc710c12-45cc-4a61-8d75-a08410df5453 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:34.283288 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cc710c12-45cc-4a61-8d75-a08410df5453 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:34.289847 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc710c12-45cc-4a61-8d75-a08410df5453 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:34.290295 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc710c12-45cc-4a61-8d75-a08410df5453 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:34.291096 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc710c12-45cc-4a61-8d75-a08410df5453 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:34.291523 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc710c12-45cc-4a61-8d75-a08410df5453 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:34.429216 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cc710c12-45cc-4a61-8d75-a08410df5453 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:34.438456 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cc710c12-45cc-4a61-8d75-a08410df5453 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:34.439971 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cc710c12-45cc-4a61-8d75-a08410df5453 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:34.441410 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cc710c12-45cc-4a61-8d75-a08410df5453 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.162909 Apr 06 16:59:34.441975 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1371/2738] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:34 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:34.469960 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0455d1b8-ae5a-4ca0-a9ef-c91d445c8f1c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:34.470510 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0455d1b8-ae5a-4ca0-a9ef-c91d445c8f1c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:34.477139 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0455d1b8-ae5a-4ca0-a9ef-c91d445c8f1c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:34.477581 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0455d1b8-ae5a-4ca0-a9ef-c91d445c8f1c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:34.478323 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0455d1b8-ae5a-4ca0-a9ef-c91d445c8f1c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:34.478747 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0455d1b8-ae5a-4ca0-a9ef-c91d445c8f1c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:34.619227 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0455d1b8-ae5a-4ca0-a9ef-c91d445c8f1c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:34.629153 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0455d1b8-ae5a-4ca0-a9ef-c91d445c8f1c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.164276 Apr 06 16:59:34.629711 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1368/2739] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:34 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 16:59:34.650031 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5934c19e-991a-4797-84c2-6e96288094ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:34.650637 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5934c19e-991a-4797-84c2-6e96288094ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:34.656708 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5934c19e-991a-4797-84c2-6e96288094ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:34.657176 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5934c19e-991a-4797-84c2-6e96288094ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:34.657928 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5934c19e-991a-4797-84c2-6e96288094ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:34.658354 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5934c19e-991a-4797-84c2-6e96288094ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:34.736335 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5934c19e-991a-4797-84c2-6e96288094ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:34.744860 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5934c19e-991a-4797-84c2-6e96288094ef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.098624 Apr 06 16:59:34.745432 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1372/2740] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:34 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:35.463830 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-936030a3-f810-4b4d-b478-7ff436a20163 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:35.464645 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-936030a3-f810-4b4d-b478-7ff436a20163 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:35.473106 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-936030a3-f810-4b4d-b478-7ff436a20163 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:35.473785 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-936030a3-f810-4b4d-b478-7ff436a20163 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:35.474280 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-936030a3-f810-4b4d-b478-7ff436a20163 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:35.474714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-936030a3-f810-4b4d-b478-7ff436a20163 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:35.612718 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-936030a3-f810-4b4d-b478-7ff436a20163 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:35.621689 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-936030a3-f810-4b4d-b478-7ff436a20163 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:35.623190 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-936030a3-f810-4b4d-b478-7ff436a20163 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:35.624365 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-936030a3-f810-4b4d-b478-7ff436a20163 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.166927 Apr 06 16:59:35.624996 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1369/2741] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:35 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:35.655741 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2501a713-6bdf-462b-90c4-0b77b879ed57 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:35.656413 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2501a713-6bdf-462b-90c4-0b77b879ed57 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:35.663150 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2501a713-6bdf-462b-90c4-0b77b879ed57 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:35.663606 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2501a713-6bdf-462b-90c4-0b77b879ed57 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:35.664383 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2501a713-6bdf-462b-90c4-0b77b879ed57 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:35.664864 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2501a713-6bdf-462b-90c4-0b77b879ed57 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:35.762447 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-30af16db-ab81-43bb-87ca-61929168fa47 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:35.763049 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-30af16db-ab81-43bb-87ca-61929168fa47 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:35.769355 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30af16db-ab81-43bb-87ca-61929168fa47 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:35.769796 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30af16db-ab81-43bb-87ca-61929168fa47 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:35.770580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30af16db-ab81-43bb-87ca-61929168fa47 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:35.770962 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30af16db-ab81-43bb-87ca-61929168fa47 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:35.799642 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2501a713-6bdf-462b-90c4-0b77b879ed57 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:35.807919 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2501a713-6bdf-462b-90c4-0b77b879ed57 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.158805 Apr 06 16:59:35.808499 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1373/2742] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:35 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:35.838010 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-30af16db-ab81-43bb-87ca-61929168fa47 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:35.846266 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-30af16db-ab81-43bb-87ca-61929168fa47 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.087751 Apr 06 16:59:35.846820 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1370/2743] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:35 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:36.644059 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-42c5ea42-12f8-48ad-bcac-af13779d4078 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:36.644669 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-42c5ea42-12f8-48ad-bcac-af13779d4078 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:36.651711 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42c5ea42-12f8-48ad-bcac-af13779d4078 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:36.652158 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42c5ea42-12f8-48ad-bcac-af13779d4078 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:36.652965 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42c5ea42-12f8-48ad-bcac-af13779d4078 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:36.653398 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42c5ea42-12f8-48ad-bcac-af13779d4078 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:36.825566 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-53a9fba5-3ea5-47f0-99c7-580d3e0601f5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:36.826161 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-53a9fba5-3ea5-47f0-99c7-580d3e0601f5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:36.833157 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53a9fba5-3ea5-47f0-99c7-580d3e0601f5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:36.833676 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53a9fba5-3ea5-47f0-99c7-580d3e0601f5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:36.834392 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53a9fba5-3ea5-47f0-99c7-580d3e0601f5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:36.834824 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53a9fba5-3ea5-47f0-99c7-580d3e0601f5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:36.910622 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-42c5ea42-12f8-48ad-bcac-af13779d4078 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:36.919531 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-42c5ea42-12f8-48ad-bcac-af13779d4078 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:36.921013 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-42c5ea42-12f8-48ad-bcac-af13779d4078 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:36.922731 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-42c5ea42-12f8-48ad-bcac-af13779d4078 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.283441 Apr 06 16:59:36.923298 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1374/2744] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:36 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:36.928231 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6a594d3c-099f-4e60-b064-7cc0815df620 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:36.928967 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6a594d3c-099f-4e60-b064-7cc0815df620 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:36.935178 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a594d3c-099f-4e60-b064-7cc0815df620 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:36.935604 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a594d3c-099f-4e60-b064-7cc0815df620 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:36.936375 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a594d3c-099f-4e60-b064-7cc0815df620 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:36.936868 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a594d3c-099f-4e60-b064-7cc0815df620 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:36.980130 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-53a9fba5-3ea5-47f0-99c7-580d3e0601f5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:36.988776 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-53a9fba5-3ea5-47f0-99c7-580d3e0601f5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.167054 Apr 06 16:59:36.989345 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1371/2745] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:36 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:37.012237 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6a594d3c-099f-4e60-b064-7cc0815df620 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:37.020347 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6a594d3c-099f-4e60-b064-7cc0815df620 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.095835 Apr 06 16:59:37.020956 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1375/2746] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:36 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:37.946085 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a9351615-0d5a-4afa-b04d-b5fbb1102ef5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:37.947051 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a9351615-0d5a-4afa-b04d-b5fbb1102ef5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:37.957532 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9351615-0d5a-4afa-b04d-b5fbb1102ef5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:37.957975 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9351615-0d5a-4afa-b04d-b5fbb1102ef5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:37.958730 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9351615-0d5a-4afa-b04d-b5fbb1102ef5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:37.959151 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a9351615-0d5a-4afa-b04d-b5fbb1102ef5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:38.005968 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fc2b275f-7b0f-4545-8070-d56509c654a5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:38.006613 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fc2b275f-7b0f-4545-8070-d56509c654a5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:38.013403 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc2b275f-7b0f-4545-8070-d56509c654a5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:38.013854 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc2b275f-7b0f-4545-8070-d56509c654a5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:38.014631 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc2b275f-7b0f-4545-8070-d56509c654a5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:38.015050 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc2b275f-7b0f-4545-8070-d56509c654a5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:38.106233 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a9351615-0d5a-4afa-b04d-b5fbb1102ef5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:38.115320 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a9351615-0d5a-4afa-b04d-b5fbb1102ef5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:38.116822 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a9351615-0d5a-4afa-b04d-b5fbb1102ef5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:38.117972 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a9351615-0d5a-4afa-b04d-b5fbb1102ef5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.178647 Apr 06 16:59:38.118665 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1372/2747] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:37 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:38.123150 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c56901b4-5137-4581-bd77-7306ff2356b1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:38.123823 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c56901b4-5137-4581-bd77-7306ff2356b1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:38.130085 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c56901b4-5137-4581-bd77-7306ff2356b1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:38.130530 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c56901b4-5137-4581-bd77-7306ff2356b1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:38.131287 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c56901b4-5137-4581-bd77-7306ff2356b1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:38.131716 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c56901b4-5137-4581-bd77-7306ff2356b1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:38.152817 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fc2b275f-7b0f-4545-8070-d56509c654a5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:38.161277 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fc2b275f-7b0f-4545-8070-d56509c654a5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.159218 Apr 06 16:59:38.161858 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1376/2748] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:38 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:38.194659 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c56901b4-5137-4581-bd77-7306ff2356b1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:38.202809 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c56901b4-5137-4581-bd77-7306ff2356b1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.083035 Apr 06 16:59:38.203769 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1373/2749] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:38 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:39.141260 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a8953881-c671-4994-b0d4-a80a3148131a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:39.142154 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a8953881-c671-4994-b0d4-a80a3148131a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:39.152706 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8953881-c671-4994-b0d4-a80a3148131a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:39.153465 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8953881-c671-4994-b0d4-a80a3148131a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:39.154710 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8953881-c671-4994-b0d4-a80a3148131a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:39.155420 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8953881-c671-4994-b0d4-a80a3148131a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:39.178600 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c14555b7-c360-48d9-bbe6-d0181af91434 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:39.179252 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c14555b7-c360-48d9-bbe6-d0181af91434 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:39.186002 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c14555b7-c360-48d9-bbe6-d0181af91434 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:39.186458 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c14555b7-c360-48d9-bbe6-d0181af91434 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:39.187351 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c14555b7-c360-48d9-bbe6-d0181af91434 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:39.187814 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c14555b7-c360-48d9-bbe6-d0181af91434 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:39.292612 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a8953881-c671-4994-b0d4-a80a3148131a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:39.301163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a8953881-c671-4994-b0d4-a80a3148131a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:39.302648 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a8953881-c671-4994-b0d4-a80a3148131a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:39.303816 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a8953881-c671-4994-b0d4-a80a3148131a tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.169422 Apr 06 16:59:39.304783 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1377/2750] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:39 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:39.309528 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bb3c5a4e-59d2-4ac5-b665-4a0a37fe4386 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:39.310398 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bb3c5a4e-59d2-4ac5-b665-4a0a37fe4386 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:39.316561 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb3c5a4e-59d2-4ac5-b665-4a0a37fe4386 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:39.317047 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb3c5a4e-59d2-4ac5-b665-4a0a37fe4386 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:39.317819 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb3c5a4e-59d2-4ac5-b665-4a0a37fe4386 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:39.318256 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb3c5a4e-59d2-4ac5-b665-4a0a37fe4386 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:39.338846 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c14555b7-c360-48d9-bbe6-d0181af91434 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:39.348092 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c14555b7-c360-48d9-bbe6-d0181af91434 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.172378 Apr 06 16:59:39.349089 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1374/2751] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:39 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:39.387111 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-bb3c5a4e-59d2-4ac5-b665-4a0a37fe4386 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:39.395802 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bb3c5a4e-59d2-4ac5-b665-4a0a37fe4386 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.089754 Apr 06 16:59:39.396296 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1378/2752] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:39 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:40.325958 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0c54c86b-ac21-450e-acd0-0dc36bdfd0a4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:40.326866 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0c54c86b-ac21-450e-acd0-0dc36bdfd0a4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:40.334424 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c54c86b-ac21-450e-acd0-0dc36bdfd0a4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:40.334882 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c54c86b-ac21-450e-acd0-0dc36bdfd0a4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:40.335683 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c54c86b-ac21-450e-acd0-0dc36bdfd0a4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:40.336118 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c54c86b-ac21-450e-acd0-0dc36bdfd0a4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:40.366582 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ac4a33ba-5894-4af8-be10-c15b957c7249 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:40.367192 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ac4a33ba-5894-4af8-be10-c15b957c7249 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:40.374069 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac4a33ba-5894-4af8-be10-c15b957c7249 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:40.374591 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac4a33ba-5894-4af8-be10-c15b957c7249 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:40.375407 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac4a33ba-5894-4af8-be10-c15b957c7249 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:40.375883 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac4a33ba-5894-4af8-be10-c15b957c7249 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:40.471630 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0c54c86b-ac21-450e-acd0-0dc36bdfd0a4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:40.479989 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0c54c86b-ac21-450e-acd0-0dc36bdfd0a4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:40.481828 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0c54c86b-ac21-450e-acd0-0dc36bdfd0a4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:40.483007 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0c54c86b-ac21-450e-acd0-0dc36bdfd0a4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.163570 Apr 06 16:59:40.483561 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1375/2753] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:40 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:40.488197 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-01ac2823-5f4f-426e-a2e3-4aeff7b49a64 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:40.488835 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-01ac2823-5f4f-426e-a2e3-4aeff7b49a64 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:40.494770 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01ac2823-5f4f-426e-a2e3-4aeff7b49a64 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:40.495254 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01ac2823-5f4f-426e-a2e3-4aeff7b49a64 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:40.496018 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01ac2823-5f4f-426e-a2e3-4aeff7b49a64 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:40.496448 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-01ac2823-5f4f-426e-a2e3-4aeff7b49a64 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:40.519259 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ac4a33ba-5894-4af8-be10-c15b957c7249 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:40.526957 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ac4a33ba-5894-4af8-be10-c15b957c7249 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.164243 Apr 06 16:59:40.527552 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1379/2754] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:40 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:40.562465 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-01ac2823-5f4f-426e-a2e3-4aeff7b49a64 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:40.570457 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-01ac2823-5f4f-426e-a2e3-4aeff7b49a64 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.085788 Apr 06 16:59:40.571022 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1376/2755] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:40 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:41.502794 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fd353158-904c-4aac-a908-5f5d445e185f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:41.503520 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fd353158-904c-4aac-a908-5f5d445e185f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:41.510976 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd353158-904c-4aac-a908-5f5d445e185f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:41.511482 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd353158-904c-4aac-a908-5f5d445e185f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:41.512362 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd353158-904c-4aac-a908-5f5d445e185f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:41.512884 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd353158-904c-4aac-a908-5f5d445e185f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:41.544715 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dd21d6c7-41d9-4a78-942f-2e826643733f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:41.545342 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dd21d6c7-41d9-4a78-942f-2e826643733f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:41.552567 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd21d6c7-41d9-4a78-942f-2e826643733f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:41.553083 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd21d6c7-41d9-4a78-942f-2e826643733f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:41.553859 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd21d6c7-41d9-4a78-942f-2e826643733f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:41.554296 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd21d6c7-41d9-4a78-942f-2e826643733f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:41.656618 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fd353158-904c-4aac-a908-5f5d445e185f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:41.665872 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fd353158-904c-4aac-a908-5f5d445e185f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:41.667363 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fd353158-904c-4aac-a908-5f5d445e185f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:41.668529 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fd353158-904c-4aac-a908-5f5d445e185f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.170379 Apr 06 16:59:41.669124 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1380/2756] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:41 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:41.673611 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-769a8d68-7026-4fd3-9493-b27af8b22101 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:41.674215 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-769a8d68-7026-4fd3-9493-b27af8b22101 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:41.680365 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-769a8d68-7026-4fd3-9493-b27af8b22101 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:41.680899 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-769a8d68-7026-4fd3-9493-b27af8b22101 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:41.681595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-769a8d68-7026-4fd3-9493-b27af8b22101 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:41.682025 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-769a8d68-7026-4fd3-9493-b27af8b22101 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:41.690023 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-dd21d6c7-41d9-4a78-942f-2e826643733f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:41.697888 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dd21d6c7-41d9-4a78-942f-2e826643733f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.157205 Apr 06 16:59:41.698426 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1377/2757] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:41 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:41.743883 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-769a8d68-7026-4fd3-9493-b27af8b22101 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:41.754249 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-769a8d68-7026-4fd3-9493-b27af8b22101 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.084222 Apr 06 16:59:41.754819 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1381/2758] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:41 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:42.691211 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aeb0f66f-0215-42b9-bc72-aa2404203eee tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:42.691911 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aeb0f66f-0215-42b9-bc72-aa2404203eee tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:42.699772 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aeb0f66f-0215-42b9-bc72-aa2404203eee tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:42.700330 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aeb0f66f-0215-42b9-bc72-aa2404203eee tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:42.701267 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aeb0f66f-0215-42b9-bc72-aa2404203eee tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:42.701786 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aeb0f66f-0215-42b9-bc72-aa2404203eee tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:42.716529 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2fc13caf-6126-4c34-9b73-87edccea1335 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:42.717280 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2fc13caf-6126-4c34-9b73-87edccea1335 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:42.724411 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2fc13caf-6126-4c34-9b73-87edccea1335 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:42.724911 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2fc13caf-6126-4c34-9b73-87edccea1335 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:42.725692 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2fc13caf-6126-4c34-9b73-87edccea1335 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:42.726126 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2fc13caf-6126-4c34-9b73-87edccea1335 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:42.836715 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-aeb0f66f-0215-42b9-bc72-aa2404203eee tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:42.845045 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-aeb0f66f-0215-42b9-bc72-aa2404203eee tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:42.846656 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-aeb0f66f-0215-42b9-bc72-aa2404203eee tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:42.847776 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aeb0f66f-0215-42b9-bc72-aa2404203eee tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.162831 Apr 06 16:59:42.848301 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1378/2759] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:42 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:42.852627 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-afb4844f-5818-4a5c-bfbe-143ac1dd9f03 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:42.853233 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-afb4844f-5818-4a5c-bfbe-143ac1dd9f03 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:42.859367 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-afb4844f-5818-4a5c-bfbe-143ac1dd9f03 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:42.859805 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-afb4844f-5818-4a5c-bfbe-143ac1dd9f03 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:42.860533 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2fc13caf-6126-4c34-9b73-87edccea1335 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:42.860892 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-afb4844f-5818-4a5c-bfbe-143ac1dd9f03 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:42.861383 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-afb4844f-5818-4a5c-bfbe-143ac1dd9f03 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:42.868776 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2fc13caf-6126-4c34-9b73-87edccea1335 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.156793 Apr 06 16:59:42.869321 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1382/2760] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:42 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:42.925049 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-afb4844f-5818-4a5c-bfbe-143ac1dd9f03 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:42.936079 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-afb4844f-5818-4a5c-bfbe-143ac1dd9f03 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086792 Apr 06 16:59:42.936658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1379/2761] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:42 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:43.870981 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d2f987ab-2bdd-491c-96f1-df9e085a1842 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:43.872403 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d2f987ab-2bdd-491c-96f1-df9e085a1842 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:43.883098 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2f987ab-2bdd-491c-96f1-df9e085a1842 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:43.883653 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2f987ab-2bdd-491c-96f1-df9e085a1842 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:43.884610 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2f987ab-2bdd-491c-96f1-df9e085a1842 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:43.885195 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2f987ab-2bdd-491c-96f1-df9e085a1842 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:43.887846 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7a8dc3a4-4f77-445d-a0e3-5f3812d36595 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:43.888605 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7a8dc3a4-4f77-445d-a0e3-5f3812d36595 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:43.895915 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a8dc3a4-4f77-445d-a0e3-5f3812d36595 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:43.896372 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a8dc3a4-4f77-445d-a0e3-5f3812d36595 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:43.897170 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a8dc3a4-4f77-445d-a0e3-5f3812d36595 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:43.897609 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a8dc3a4-4f77-445d-a0e3-5f3812d36595 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:44.023460 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d2f987ab-2bdd-491c-96f1-df9e085a1842 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:44.032380 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d2f987ab-2bdd-491c-96f1-df9e085a1842 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:44.034379 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d2f987ab-2bdd-491c-96f1-df9e085a1842 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:44.034686 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7a8dc3a4-4f77-445d-a0e3-5f3812d36595 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:44.035559 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d2f987ab-2bdd-491c-96f1-df9e085a1842 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.171157 Apr 06 16:59:44.036111 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1383/2762] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:43 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:44.041001 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ae5f3b0d-3ad5-42e2-a8ed-c92df986fcb8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:44.041712 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ae5f3b0d-3ad5-42e2-a8ed-c92df986fcb8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:44.044454 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7a8dc3a4-4f77-445d-a0e3-5f3812d36595 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.161407 Apr 06 16:59:44.049055 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1380/2763] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:43 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:44.049237 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae5f3b0d-3ad5-42e2-a8ed-c92df986fcb8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:44.049237 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae5f3b0d-3ad5-42e2-a8ed-c92df986fcb8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:44.049237 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae5f3b0d-3ad5-42e2-a8ed-c92df986fcb8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:44.049499 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae5f3b0d-3ad5-42e2-a8ed-c92df986fcb8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:44.107795 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ae5f3b0d-3ad5-42e2-a8ed-c92df986fcb8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:44.116356 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ae5f3b0d-3ad5-42e2-a8ed-c92df986fcb8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.078978 Apr 06 16:59:44.116985 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1384/2764] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:44 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:45.055718 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-40642dae-996e-4029-b48b-2f2ef59700fb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:45.056450 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-40642dae-996e-4029-b48b-2f2ef59700fb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:45.062115 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4eae9db9-26cb-439a-b08b-e3052467ca86 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:45.062766 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4eae9db9-26cb-439a-b08b-e3052467ca86 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:45.063580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40642dae-996e-4029-b48b-2f2ef59700fb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:45.064062 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40642dae-996e-4029-b48b-2f2ef59700fb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:45.064915 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40642dae-996e-4029-b48b-2f2ef59700fb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:45.065399 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-40642dae-996e-4029-b48b-2f2ef59700fb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:45.069195 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4eae9db9-26cb-439a-b08b-e3052467ca86 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:45.069671 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4eae9db9-26cb-439a-b08b-e3052467ca86 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:45.070696 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4eae9db9-26cb-439a-b08b-e3052467ca86 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:45.071195 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4eae9db9-26cb-439a-b08b-e3052467ca86 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:45.201742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-40642dae-996e-4029-b48b-2f2ef59700fb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:45.208621 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4eae9db9-26cb-439a-b08b-e3052467ca86 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:45.211337 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-40642dae-996e-4029-b48b-2f2ef59700fb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:45.212929 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-40642dae-996e-4029-b48b-2f2ef59700fb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:45.214094 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-40642dae-996e-4029-b48b-2f2ef59700fb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.162935 Apr 06 16:59:45.214672 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1381/2765] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:45 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:45.216999 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4eae9db9-26cb-439a-b08b-e3052467ca86 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.158890 Apr 06 16:59:45.218533 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1385/2766] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:45 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:45.219001 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4aff3ead-94da-4018-ad74-db0838a7497e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:45.219666 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4aff3ead-94da-4018-ad74-db0838a7497e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:45.226210 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4aff3ead-94da-4018-ad74-db0838a7497e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:45.226685 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4aff3ead-94da-4018-ad74-db0838a7497e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:45.227436 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4aff3ead-94da-4018-ad74-db0838a7497e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:45.227860 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4aff3ead-94da-4018-ad74-db0838a7497e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:45.297048 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4aff3ead-94da-4018-ad74-db0838a7497e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:45.305828 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4aff3ead-94da-4018-ad74-db0838a7497e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.090207 Apr 06 16:59:45.306390 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1382/2767] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:45 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:46.237688 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dec24cbe-b9f1-4dd9-940b-467398112163 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:46.239089 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dec24cbe-b9f1-4dd9-940b-467398112163 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:46.244621 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9f91eb1b-1fb3-4fbc-80f8-1860133965be tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:46.246184 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9f91eb1b-1fb3-4fbc-80f8-1860133965be tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:46.249318 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dec24cbe-b9f1-4dd9-940b-467398112163 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:46.250071 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dec24cbe-b9f1-4dd9-940b-467398112163 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:46.251380 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dec24cbe-b9f1-4dd9-940b-467398112163 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:46.252147 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dec24cbe-b9f1-4dd9-940b-467398112163 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:46.256518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f91eb1b-1fb3-4fbc-80f8-1860133965be tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:46.257132 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f91eb1b-1fb3-4fbc-80f8-1860133965be tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:46.257914 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f91eb1b-1fb3-4fbc-80f8-1860133965be tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:46.258329 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f91eb1b-1fb3-4fbc-80f8-1860133965be tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:46.388184 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-dec24cbe-b9f1-4dd9-940b-467398112163 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:46.396714 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-dec24cbe-b9f1-4dd9-940b-467398112163 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:46.398179 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-dec24cbe-b9f1-4dd9-940b-467398112163 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:46.399332 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dec24cbe-b9f1-4dd9-940b-467398112163 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.168710 Apr 06 16:59:46.400125 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1386/2768] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:46 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:46.404480 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0b4bf24b-abd7-40ea-8155-932c2852d833 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:46.405064 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0b4bf24b-abd7-40ea-8155-932c2852d833 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:46.411837 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b4bf24b-abd7-40ea-8155-932c2852d833 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:46.412273 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b4bf24b-abd7-40ea-8155-932c2852d833 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:46.413069 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b4bf24b-abd7-40ea-8155-932c2852d833 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:46.413526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b4bf24b-abd7-40ea-8155-932c2852d833 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:46.451611 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9f91eb1b-1fb3-4fbc-80f8-1860133965be tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:46.459993 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9f91eb1b-1fb3-4fbc-80f8-1860133965be tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.223640 Apr 06 16:59:46.460535 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1383/2769] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:46 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:46.473775 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0b4bf24b-abd7-40ea-8155-932c2852d833 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:46.482077 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0b4bf24b-abd7-40ea-8155-932c2852d833 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.081280 Apr 06 16:59:46.482633 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1387/2770] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:46 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:47.422760 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-acc98f0f-8d74-4fc7-8582-58aa6bff9294 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:47.424344 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-acc98f0f-8d74-4fc7-8582-58aa6bff9294 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:47.431190 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acc98f0f-8d74-4fc7-8582-58aa6bff9294 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:47.431640 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acc98f0f-8d74-4fc7-8582-58aa6bff9294 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:47.432405 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acc98f0f-8d74-4fc7-8582-58aa6bff9294 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:47.432862 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-acc98f0f-8d74-4fc7-8582-58aa6bff9294 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:47.477481 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-446a28f4-e163-47b7-a13b-487a67131b5b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:47.478096 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-446a28f4-e163-47b7-a13b-487a67131b5b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:47.485200 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-446a28f4-e163-47b7-a13b-487a67131b5b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:47.485658 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-446a28f4-e163-47b7-a13b-487a67131b5b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:47.486447 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-446a28f4-e163-47b7-a13b-487a67131b5b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:47.487172 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-446a28f4-e163-47b7-a13b-487a67131b5b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:47.573977 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-acc98f0f-8d74-4fc7-8582-58aa6bff9294 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:47.584071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-acc98f0f-8d74-4fc7-8582-58aa6bff9294 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:47.585556 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-acc98f0f-8d74-4fc7-8582-58aa6bff9294 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:47.586713 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-acc98f0f-8d74-4fc7-8582-58aa6bff9294 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.170861 Apr 06 16:59:47.587275 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1384/2771] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:47 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:47.591753 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f5edae86-9ded-4861-a510-372c95a99bb9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:47.592356 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f5edae86-9ded-4861-a510-372c95a99bb9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:47.598498 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5edae86-9ded-4861-a510-372c95a99bb9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:47.598947 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5edae86-9ded-4861-a510-372c95a99bb9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:47.599727 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5edae86-9ded-4861-a510-372c95a99bb9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:47.600193 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f5edae86-9ded-4861-a510-372c95a99bb9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:47.630282 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-446a28f4-e163-47b7-a13b-487a67131b5b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:47.640482 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-446a28f4-e163-47b7-a13b-487a67131b5b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.166581 Apr 06 16:59:47.641359 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1388/2772] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:47 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:47.669876 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f5edae86-9ded-4861-a510-372c95a99bb9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:47.678130 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f5edae86-9ded-4861-a510-372c95a99bb9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.089900 Apr 06 16:59:47.678739 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1385/2773] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:47 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:48.610260 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6acc323f-f02f-4f57-b9fe-8dad866763ed tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:48.611158 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6acc323f-f02f-4f57-b9fe-8dad866763ed tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:48.624726 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6acc323f-f02f-4f57-b9fe-8dad866763ed tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:48.625471 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6acc323f-f02f-4f57-b9fe-8dad866763ed tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:48.626739 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6acc323f-f02f-4f57-b9fe-8dad866763ed tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:48.627457 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6acc323f-f02f-4f57-b9fe-8dad866763ed tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:48.658088 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-25fe769c-4da1-42da-9eda-63b826497706 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:48.658680 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-25fe769c-4da1-42da-9eda-63b826497706 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:48.665623 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25fe769c-4da1-42da-9eda-63b826497706 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:48.666073 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25fe769c-4da1-42da-9eda-63b826497706 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:48.666848 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25fe769c-4da1-42da-9eda-63b826497706 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:48.667280 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25fe769c-4da1-42da-9eda-63b826497706 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:48.761871 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6acc323f-f02f-4f57-b9fe-8dad866763ed tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:48.770532 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6acc323f-f02f-4f57-b9fe-8dad866763ed tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:48.772009 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6acc323f-f02f-4f57-b9fe-8dad866763ed tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:48.773191 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6acc323f-f02f-4f57-b9fe-8dad866763ed tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.170084 Apr 06 16:59:48.773751 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1389/2774] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:48 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:48.778184 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a10c49ab-4d98-415e-8cca-4377b8cb165e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:48.778774 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a10c49ab-4d98-415e-8cca-4377b8cb165e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:48.785244 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a10c49ab-4d98-415e-8cca-4377b8cb165e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:48.785693 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a10c49ab-4d98-415e-8cca-4377b8cb165e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:48.786462 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a10c49ab-4d98-415e-8cca-4377b8cb165e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:48.786889 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a10c49ab-4d98-415e-8cca-4377b8cb165e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:48.801638 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-25fe769c-4da1-42da-9eda-63b826497706 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:48.809362 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-25fe769c-4da1-42da-9eda-63b826497706 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.155195 Apr 06 16:59:48.809943 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1386/2775] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:48 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:48.846670 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a10c49ab-4d98-415e-8cca-4377b8cb165e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:48.855004 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a10c49ab-4d98-415e-8cca-4377b8cb165e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.080280 Apr 06 16:59:48.855926 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1390/2776] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:48 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:49.794772 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-14a8f417-ac3a-4ff8-8c9e-0f2c5995f411 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:49.795610 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-14a8f417-ac3a-4ff8-8c9e-0f2c5995f411 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:49.804073 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14a8f417-ac3a-4ff8-8c9e-0f2c5995f411 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:49.804517 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14a8f417-ac3a-4ff8-8c9e-0f2c5995f411 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:49.805310 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14a8f417-ac3a-4ff8-8c9e-0f2c5995f411 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:49.805744 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14a8f417-ac3a-4ff8-8c9e-0f2c5995f411 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:49.826887 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a84cf968-89c2-4f79-8e68-6a6e154dcb55 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:49.827474 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a84cf968-89c2-4f79-8e68-6a6e154dcb55 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:49.834989 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a84cf968-89c2-4f79-8e68-6a6e154dcb55 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:49.835472 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a84cf968-89c2-4f79-8e68-6a6e154dcb55 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:49.836231 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a84cf968-89c2-4f79-8e68-6a6e154dcb55 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:49.836670 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a84cf968-89c2-4f79-8e68-6a6e154dcb55 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:49.940570 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-14a8f417-ac3a-4ff8-8c9e-0f2c5995f411 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:49.950181 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-14a8f417-ac3a-4ff8-8c9e-0f2c5995f411 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:49.951670 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-14a8f417-ac3a-4ff8-8c9e-0f2c5995f411 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:49.952869 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-14a8f417-ac3a-4ff8-8c9e-0f2c5995f411 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.164193 Apr 06 16:59:49.953470 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1387/2777] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:49 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:49.958218 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c2a670ba-5734-4d86-b495-5e4d3e411382 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:49.958817 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c2a670ba-5734-4d86-b495-5e4d3e411382 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:49.965427 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2a670ba-5734-4d86-b495-5e4d3e411382 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:49.965427 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2a670ba-5734-4d86-b495-5e4d3e411382 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:49.966216 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2a670ba-5734-4d86-b495-5e4d3e411382 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:49.966653 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2a670ba-5734-4d86-b495-5e4d3e411382 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:49.975971 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a84cf968-89c2-4f79-8e68-6a6e154dcb55 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:49.984489 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a84cf968-89c2-4f79-8e68-6a6e154dcb55 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.161576 Apr 06 16:59:49.985091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1391/2778] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:49 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:50.029729 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c2a670ba-5734-4d86-b495-5e4d3e411382 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:50.037913 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c2a670ba-5734-4d86-b495-5e4d3e411382 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.083510 Apr 06 16:59:50.038509 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1388/2779] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:49 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:50.971730 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-41821d23-4d5f-4336-ab0e-ea84c8e8e10f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:50.972867 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-41821d23-4d5f-4336-ab0e-ea84c8e8e10f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:50.980060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41821d23-4d5f-4336-ab0e-ea84c8e8e10f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:50.980886 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41821d23-4d5f-4336-ab0e-ea84c8e8e10f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:50.981642 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41821d23-4d5f-4336-ab0e-ea84c8e8e10f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:50.982069 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41821d23-4d5f-4336-ab0e-ea84c8e8e10f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:51.002271 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4ef389fe-2337-4ada-9d05-6cc06e444f30 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:51.002878 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4ef389fe-2337-4ada-9d05-6cc06e444f30 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:51.009420 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ef389fe-2337-4ada-9d05-6cc06e444f30 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:51.009869 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ef389fe-2337-4ada-9d05-6cc06e444f30 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:51.010640 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ef389fe-2337-4ada-9d05-6cc06e444f30 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:51.011077 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ef389fe-2337-4ada-9d05-6cc06e444f30 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:51.123317 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-41821d23-4d5f-4336-ab0e-ea84c8e8e10f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:51.132233 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-41821d23-4d5f-4336-ab0e-ea84c8e8e10f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:51.133784 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-41821d23-4d5f-4336-ab0e-ea84c8e8e10f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:51.134977 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-41821d23-4d5f-4336-ab0e-ea84c8e8e10f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.167259 Apr 06 16:59:51.135571 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1392/2780] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:50 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:51.139944 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8498142c-8c0f-403d-998e-8686cc95a661 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:51.140514 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8498142c-8c0f-403d-998e-8686cc95a661 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:51.147046 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8498142c-8c0f-403d-998e-8686cc95a661 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:51.147476 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4ef389fe-2337-4ada-9d05-6cc06e444f30 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:51.147622 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8498142c-8c0f-403d-998e-8686cc95a661 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:51.148242 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8498142c-8c0f-403d-998e-8686cc95a661 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:51.148673 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8498142c-8c0f-403d-998e-8686cc95a661 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:51.155582 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4ef389fe-2337-4ada-9d05-6cc06e444f30 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.157218 Apr 06 16:59:51.156158 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1389/2781] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:50 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:51.210850 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8498142c-8c0f-403d-998e-8686cc95a661 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:51.219084 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8498142c-8c0f-403d-998e-8686cc95a661 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.082550 Apr 06 16:59:51.219665 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1393/2782] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:51 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:52.157977 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1978365c-9b3a-42a1-8a1d-d75c51150942 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:52.158960 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1978365c-9b3a-42a1-8a1d-d75c51150942 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:52.166621 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1978365c-9b3a-42a1-8a1d-d75c51150942 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:52.167086 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1978365c-9b3a-42a1-8a1d-d75c51150942 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:52.167827 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1978365c-9b3a-42a1-8a1d-d75c51150942 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:52.168260 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1978365c-9b3a-42a1-8a1d-d75c51150942 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:52.172898 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-943743bf-d10d-42c5-b718-59fe3b2c01e3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:52.173510 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-943743bf-d10d-42c5-b718-59fe3b2c01e3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:52.180275 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-943743bf-d10d-42c5-b718-59fe3b2c01e3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:52.181890 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-943743bf-d10d-42c5-b718-59fe3b2c01e3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:52.182671 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-943743bf-d10d-42c5-b718-59fe3b2c01e3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:52.183108 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-943743bf-d10d-42c5-b718-59fe3b2c01e3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:52.303461 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1978365c-9b3a-42a1-8a1d-d75c51150942 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:52.311912 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1978365c-9b3a-42a1-8a1d-d75c51150942 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:52.313442 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1978365c-9b3a-42a1-8a1d-d75c51150942 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:52.314602 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1978365c-9b3a-42a1-8a1d-d75c51150942 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.163461 Apr 06 16:59:52.315157 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1390/2783] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:52 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:52.320005 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bbbf12e0-c283-4571-a0b0-b95339bdd4f5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:52.320452 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-943743bf-d10d-42c5-b718-59fe3b2c01e3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:52.320628 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bbbf12e0-c283-4571-a0b0-b95339bdd4f5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:52.327676 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbbf12e0-c283-4571-a0b0-b95339bdd4f5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:52.328293 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbbf12e0-c283-4571-a0b0-b95339bdd4f5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:52.329109 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbbf12e0-c283-4571-a0b0-b95339bdd4f5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:52.329520 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bbbf12e0-c283-4571-a0b0-b95339bdd4f5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:52.333343 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-943743bf-d10d-42c5-b718-59fe3b2c01e3 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.164268 Apr 06 16:59:52.333933 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1394/2784] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:52 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:52.393099 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-bbbf12e0-c283-4571-a0b0-b95339bdd4f5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:52.401284 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bbbf12e0-c283-4571-a0b0-b95339bdd4f5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.085166 Apr 06 16:59:52.401851 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1391/2785] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:52 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:53.335898 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e4a5d91d-3946-43ec-a318-92cc0c3cabf5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:53.336505 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e4a5d91d-3946-43ec-a318-92cc0c3cabf5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:53.343431 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4a5d91d-3946-43ec-a318-92cc0c3cabf5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:53.343881 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4a5d91d-3946-43ec-a318-92cc0c3cabf5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:53.344634 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4a5d91d-3946-43ec-a318-92cc0c3cabf5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:53.345161 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4a5d91d-3946-43ec-a318-92cc0c3cabf5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:53.350744 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c2f9ed13-a16d-40a2-ab9c-70448782568c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:53.351446 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c2f9ed13-a16d-40a2-ab9c-70448782568c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:53.358473 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2f9ed13-a16d-40a2-ab9c-70448782568c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:53.358988 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2f9ed13-a16d-40a2-ab9c-70448782568c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:53.359832 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2f9ed13-a16d-40a2-ab9c-70448782568c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:53.360323 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2f9ed13-a16d-40a2-ab9c-70448782568c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:53.481020 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e4a5d91d-3946-43ec-a318-92cc0c3cabf5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:53.489856 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e4a5d91d-3946-43ec-a318-92cc0c3cabf5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:53.491353 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e4a5d91d-3946-43ec-a318-92cc0c3cabf5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:53.492520 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e4a5d91d-3946-43ec-a318-92cc0c3cabf5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.161453 Apr 06 16:59:53.493107 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1395/2786] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:53 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:53.497424 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9348168f-f8a2-43ed-929d-1275fba47cf1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:53.497586 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c2f9ed13-a16d-40a2-ab9c-70448782568c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:53.498021 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9348168f-f8a2-43ed-929d-1275fba47cf1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:53.503773 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9348168f-f8a2-43ed-929d-1275fba47cf1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:53.504218 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9348168f-f8a2-43ed-929d-1275fba47cf1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:53.505005 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9348168f-f8a2-43ed-929d-1275fba47cf1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:53.505433 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9348168f-f8a2-43ed-929d-1275fba47cf1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:53.506064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c2f9ed13-a16d-40a2-ab9c-70448782568c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.159548 Apr 06 16:59:53.506637 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1392/2787] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:53 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:53.563474 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9348168f-f8a2-43ed-929d-1275fba47cf1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:53.573422 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9348168f-f8a2-43ed-929d-1275fba47cf1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.079331 Apr 06 16:59:53.573974 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1396/2788] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:53 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:54.515650 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1717ffff-3820-4794-b599-775a5ff1726e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:54.516716 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1717ffff-3820-4794-b599-775a5ff1726e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:54.527385 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8b445db9-ba71-45f7-8894-87827c9d7a76 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:54.528212 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1717ffff-3820-4794-b599-775a5ff1726e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:54.528212 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1717ffff-3820-4794-b599-775a5ff1726e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:54.528574 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8b445db9-ba71-45f7-8894-87827c9d7a76 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:54.529517 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1717ffff-3820-4794-b599-775a5ff1726e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:54.530241 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1717ffff-3820-4794-b599-775a5ff1726e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:54.537783 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b445db9-ba71-45f7-8894-87827c9d7a76 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:54.538230 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b445db9-ba71-45f7-8894-87827c9d7a76 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:54.538988 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b445db9-ba71-45f7-8894-87827c9d7a76 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:54.539416 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b445db9-ba71-45f7-8894-87827c9d7a76 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:54.670578 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1717ffff-3820-4794-b599-775a5ff1726e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:54.675049 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8b445db9-ba71-45f7-8894-87827c9d7a76 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:54.679925 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1717ffff-3820-4794-b599-775a5ff1726e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:54.681460 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1717ffff-3820-4794-b599-775a5ff1726e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:54.682622 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1717ffff-3820-4794-b599-775a5ff1726e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.173657 Apr 06 16:59:54.682990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8b445db9-ba71-45f7-8894-87827c9d7a76 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.162066 Apr 06 16:59:54.683529 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1393/2789] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:54 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:54.684039 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1397/2790] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:54 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:54.687866 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-58e5874a-70ef-4b94-b979-4c42a8e5e3d3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:54.688468 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-58e5874a-70ef-4b94-b979-4c42a8e5e3d3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:54.695006 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58e5874a-70ef-4b94-b979-4c42a8e5e3d3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:54.695447 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58e5874a-70ef-4b94-b979-4c42a8e5e3d3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:54.696213 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58e5874a-70ef-4b94-b979-4c42a8e5e3d3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:54.696645 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58e5874a-70ef-4b94-b979-4c42a8e5e3d3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:54.765183 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-58e5874a-70ef-4b94-b979-4c42a8e5e3d3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:54.774833 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-58e5874a-70ef-4b94-b979-4c42a8e5e3d3 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.090430 Apr 06 16:59:54.775406 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1394/2791] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:54 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:55.706587 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-41a29721-a6d0-4c90-8ae6-e21136a3a3fe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:55.708012 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-41a29721-a6d0-4c90-8ae6-e21136a3a3fe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:55.710161 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6cc5814f-8de7-4da4-8f56-f8a31a1b629d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:55.711421 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6cc5814f-8de7-4da4-8f56-f8a31a1b629d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:55.715475 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41a29721-a6d0-4c90-8ae6-e21136a3a3fe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:55.715918 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41a29721-a6d0-4c90-8ae6-e21136a3a3fe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:55.716721 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41a29721-a6d0-4c90-8ae6-e21136a3a3fe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:55.717179 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41a29721-a6d0-4c90-8ae6-e21136a3a3fe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:55.720831 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cc5814f-8de7-4da4-8f56-f8a31a1b629d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:55.721529 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cc5814f-8de7-4da4-8f56-f8a31a1b629d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:55.722849 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cc5814f-8de7-4da4-8f56-f8a31a1b629d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:55.723530 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cc5814f-8de7-4da4-8f56-f8a31a1b629d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:55.852993 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-41a29721-a6d0-4c90-8ae6-e21136a3a3fe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:55.859246 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6cc5814f-8de7-4da4-8f56-f8a31a1b629d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:55.861744 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-41a29721-a6d0-4c90-8ae6-e21136a3a3fe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:55.863408 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-41a29721-a6d0-4c90-8ae6-e21136a3a3fe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:55.864664 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-41a29721-a6d0-4c90-8ae6-e21136a3a3fe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.165718 Apr 06 16:59:55.865318 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1395/2792] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:55 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:55.868204 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6cc5814f-8de7-4da4-8f56-f8a31a1b629d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.169093 Apr 06 16:59:55.869780 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e229ba91-473d-4ffb-9617-b350aed09410 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:55.870432 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e229ba91-473d-4ffb-9617-b350aed09410 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:55.876755 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e229ba91-473d-4ffb-9617-b350aed09410 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:55.877197 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e229ba91-473d-4ffb-9617-b350aed09410 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:55.877785 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1398/2793] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:55 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:55.877955 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e229ba91-473d-4ffb-9617-b350aed09410 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:55.878339 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e229ba91-473d-4ffb-9617-b350aed09410 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:55.936870 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e229ba91-473d-4ffb-9617-b350aed09410 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:55.944629 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e229ba91-473d-4ffb-9617-b350aed09410 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.078322 Apr 06 16:59:55.945215 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1396/2794] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:55 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:56.884514 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f9524982-bc62-40fb-8126-1a451a555d37 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:56.885199 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f9524982-bc62-40fb-8126-1a451a555d37 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:56.887306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-df692c89-064e-4510-b9fb-88b562182931 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:56.887919 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-df692c89-064e-4510-b9fb-88b562182931 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:56.893624 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9524982-bc62-40fb-8126-1a451a555d37 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:56.894157 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9524982-bc62-40fb-8126-1a451a555d37 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:56.895157 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9524982-bc62-40fb-8126-1a451a555d37 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:56.895350 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df692c89-064e-4510-b9fb-88b562182931 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:56.895716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9524982-bc62-40fb-8126-1a451a555d37 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:56.895966 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df692c89-064e-4510-b9fb-88b562182931 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:56.896990 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df692c89-064e-4510-b9fb-88b562182931 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:56.897463 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-df692c89-064e-4510-b9fb-88b562182931 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:57.041532 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-df692c89-064e-4510-b9fb-88b562182931 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:57.049461 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-df692c89-064e-4510-b9fb-88b562182931 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.167421 Apr 06 16:59:57.050034 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1397/2795] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:56 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:57.050976 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f9524982-bc62-40fb-8126-1a451a555d37 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:57.054727 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6ab74451-5ebc-4eb2-9870-94d5bb81910b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:57.055448 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6ab74451-5ebc-4eb2-9870-94d5bb81910b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:57.059740 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f9524982-bc62-40fb-8126-1a451a555d37 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:57.061265 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f9524982-bc62-40fb-8126-1a451a555d37 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:57.061450 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ab74451-5ebc-4eb2-9870-94d5bb81910b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:57.061699 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ab74451-5ebc-4eb2-9870-94d5bb81910b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:57.062423 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f9524982-bc62-40fb-8126-1a451a555d37 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.182313 Apr 06 16:59:57.062587 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ab74451-5ebc-4eb2-9870-94d5bb81910b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:57.062858 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ab74451-5ebc-4eb2-9870-94d5bb81910b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:57.063004 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1399/2796] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:56 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:57.123538 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6ab74451-5ebc-4eb2-9870-94d5bb81910b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:57.135971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6ab74451-5ebc-4eb2-9870-94d5bb81910b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.084590 Apr 06 16:59:57.136649 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1398/2797] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:57 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:58.070899 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-545b5923-ebda-4c70-a27b-f79e937ec033 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:58.075184 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-545b5923-ebda-4c70-a27b-f79e937ec033 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:58.082891 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-545b5923-ebda-4c70-a27b-f79e937ec033 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:58.083374 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-545b5923-ebda-4c70-a27b-f79e937ec033 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:58.084104 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8dbdf4f3-2f73-4cdd-acd5-09fc0e7b8def tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:58.084637 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-545b5923-ebda-4c70-a27b-f79e937ec033 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:58.084637 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-545b5923-ebda-4c70-a27b-f79e937ec033 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:58.084870 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8dbdf4f3-2f73-4cdd-acd5-09fc0e7b8def tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:58.091517 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dbdf4f3-2f73-4cdd-acd5-09fc0e7b8def tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:58.091971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dbdf4f3-2f73-4cdd-acd5-09fc0e7b8def tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:58.092776 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dbdf4f3-2f73-4cdd-acd5-09fc0e7b8def tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:58.093228 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8dbdf4f3-2f73-4cdd-acd5-09fc0e7b8def tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:58.220724 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-545b5923-ebda-4c70-a27b-f79e937ec033 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:58.225150 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8dbdf4f3-2f73-4cdd-acd5-09fc0e7b8def tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:58.231253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-545b5923-ebda-4c70-a27b-f79e937ec033 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.166375 Apr 06 16:59:58.232304 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1400/2798] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:58 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:58.234152 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8dbdf4f3-2f73-4cdd-acd5-09fc0e7b8def tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:58.236864 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8dbdf4f3-2f73-4cdd-acd5-09fc0e7b8def tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:58.238041 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8dbdf4f3-2f73-4cdd-acd5-09fc0e7b8def tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.160048 Apr 06 16:59:58.241961 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1399/2799] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:58 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:58.242163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a4b47bc4-5734-42c3-b11b-d2380a88795e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:58.242163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a4b47bc4-5734-42c3-b11b-d2380a88795e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:58.246771 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4b47bc4-5734-42c3-b11b-d2380a88795e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:58.247220 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4b47bc4-5734-42c3-b11b-d2380a88795e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:58.247995 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4b47bc4-5734-42c3-b11b-d2380a88795e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:58.248429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4b47bc4-5734-42c3-b11b-d2380a88795e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:58.309952 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a4b47bc4-5734-42c3-b11b-d2380a88795e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:58.320042 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a4b47bc4-5734-42c3-b11b-d2380a88795e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.085536 Apr 06 16:59:58.320630 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1401/2800] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:58 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:59.256713 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-86ef95dd-0542-434f-916d-ee000fe0fcc8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:59.257633 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-86ef95dd-0542-434f-916d-ee000fe0fcc8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:59.260918 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3846bbb4-aac6-4af6-8068-2b39f7d5f397 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:59.261916 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3846bbb4-aac6-4af6-8068-2b39f7d5f397 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:59.268429 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86ef95dd-0542-434f-916d-ee000fe0fcc8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:59.269252 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86ef95dd-0542-434f-916d-ee000fe0fcc8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:59.270202 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86ef95dd-0542-434f-916d-ee000fe0fcc8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:59.270621 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86ef95dd-0542-434f-916d-ee000fe0fcc8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:59.271543 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3846bbb4-aac6-4af6-8068-2b39f7d5f397 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:59.271989 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3846bbb4-aac6-4af6-8068-2b39f7d5f397 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:59.272742 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3846bbb4-aac6-4af6-8068-2b39f7d5f397 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:59.273196 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3846bbb4-aac6-4af6-8068-2b39f7d5f397 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:59.413902 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-86ef95dd-0542-434f-916d-ee000fe0fcc8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:59.417511 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3846bbb4-aac6-4af6-8068-2b39f7d5f397 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:59.422059 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-86ef95dd-0542-434f-916d-ee000fe0fcc8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.172185 Apr 06 16:59:59.422636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1400/2801] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:59 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 16:59:59.427406 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6969849f-0e22-4d6f-90ef-6855c5b4b8ee tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 16:59:59.428002 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6969849f-0e22-4d6f-90ef-6855c5b4b8ee tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 16:59:59.430685 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3846bbb4-aac6-4af6-8068-2b39f7d5f397 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:59.432281 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3846bbb4-aac6-4af6-8068-2b39f7d5f397 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:59.433542 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3846bbb4-aac6-4af6-8068-2b39f7d5f397 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.179331 Apr 06 16:59:59.433855 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6969849f-0e22-4d6f-90ef-6855c5b4b8ee tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:59.434271 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1402/2802] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 16:59:59 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 16:59:59.434411 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6969849f-0e22-4d6f-90ef-6855c5b4b8ee tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:59.435031 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6969849f-0e22-4d6f-90ef-6855c5b4b8ee tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 16:59:59.435533 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6969849f-0e22-4d6f-90ef-6855c5b4b8ee tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 16:59:59.497015 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6969849f-0e22-4d6f-90ef-6855c5b4b8ee tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 16:59:59.505546 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6969849f-0e22-4d6f-90ef-6855c5b4b8ee tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.081938 Apr 06 16:59:59.506129 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1401/2803] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 16:59:59 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:00.453006 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-67faca93-7efc-41d0-b588-b716cafdb0f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:00.453694 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-67faca93-7efc-41d0-b588-b716cafdb0f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:00.460552 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-67faca93-7efc-41d0-b588-b716cafdb0f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:00.461124 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-67faca93-7efc-41d0-b588-b716cafdb0f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:00.462038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-67faca93-7efc-41d0-b588-b716cafdb0f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:00.462527 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-67faca93-7efc-41d0-b588-b716cafdb0f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:00.569002 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-12829df5-5f13-41e5-8335-2d00ee1c480a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:00.569745 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-12829df5-5f13-41e5-8335-2d00ee1c480a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:00.575676 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12829df5-5f13-41e5-8335-2d00ee1c480a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:00.576124 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12829df5-5f13-41e5-8335-2d00ee1c480a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:00.576926 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12829df5-5f13-41e5-8335-2d00ee1c480a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:00.577364 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12829df5-5f13-41e5-8335-2d00ee1c480a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:00.598627 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-67faca93-7efc-41d0-b588-b716cafdb0f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:00.607364 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-67faca93-7efc-41d0-b588-b716cafdb0f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:00.608840 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-67faca93-7efc-41d0-b588-b716cafdb0f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:00.609992 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-67faca93-7efc-41d0-b588-b716cafdb0f4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.161527 Apr 06 17:00:00.610557 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1402/2804] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:00 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:00.615432 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-97e8b304-8571-4a96-8f6c-027cc00ef816 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:00.616037 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-97e8b304-8571-4a96-8f6c-027cc00ef816 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:00.622360 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97e8b304-8571-4a96-8f6c-027cc00ef816 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:00.622802 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97e8b304-8571-4a96-8f6c-027cc00ef816 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:00.623563 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97e8b304-8571-4a96-8f6c-027cc00ef816 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:00.623994 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97e8b304-8571-4a96-8f6c-027cc00ef816 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:00.690636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-97e8b304-8571-4a96-8f6c-027cc00ef816 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:00.700950 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-97e8b304-8571-4a96-8f6c-027cc00ef816 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.089005 Apr 06 17:00:00.701902 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1403/2805] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:00 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:00.725051 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-12829df5-5f13-41e5-8335-2d00ee1c480a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:00.733593 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-12829df5-5f13-41e5-8335-2d00ee1c480a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.297106 Apr 06 17:00:00.734164 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1403/2806] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:00 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:01.633521 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-09fd10dd-6d30-4e90-9003-c1fe46edf78b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:01.634611 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-09fd10dd-6d30-4e90-9003-c1fe46edf78b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:01.647064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09fd10dd-6d30-4e90-9003-c1fe46edf78b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:01.647512 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09fd10dd-6d30-4e90-9003-c1fe46edf78b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:01.648271 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09fd10dd-6d30-4e90-9003-c1fe46edf78b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:01.648717 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09fd10dd-6d30-4e90-9003-c1fe46edf78b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:01.724338 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a3dc4308-6987-4dee-8c79-e45c493c49ea tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:01.725005 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a3dc4308-6987-4dee-8c79-e45c493c49ea tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:01.731994 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3dc4308-6987-4dee-8c79-e45c493c49ea tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:01.732442 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3dc4308-6987-4dee-8c79-e45c493c49ea tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:01.733261 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3dc4308-6987-4dee-8c79-e45c493c49ea tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:01.733694 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3dc4308-6987-4dee-8c79-e45c493c49ea tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:01.788516 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-09fd10dd-6d30-4e90-9003-c1fe46edf78b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:01.794356 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a3dc4308-6987-4dee-8c79-e45c493c49ea tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:01.797264 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-09fd10dd-6d30-4e90-9003-c1fe46edf78b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:01.798748 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-09fd10dd-6d30-4e90-9003-c1fe46edf78b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:01.799935 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-09fd10dd-6d30-4e90-9003-c1fe46edf78b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.173715 Apr 06 17:00:01.800476 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1404/2807] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:01 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:01.802863 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a3dc4308-6987-4dee-8c79-e45c493c49ea tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.082648 Apr 06 17:00:01.803569 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1404/2808] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:01 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:01.805571 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3a065f2b-9817-4dd3-9962-9c937458da2b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:01.806164 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3a065f2b-9817-4dd3-9962-9c937458da2b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:01.812375 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a065f2b-9817-4dd3-9962-9c937458da2b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:01.813002 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a065f2b-9817-4dd3-9962-9c937458da2b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:01.813767 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a065f2b-9817-4dd3-9962-9c937458da2b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:01.814196 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a065f2b-9817-4dd3-9962-9c937458da2b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:01.951683 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3a065f2b-9817-4dd3-9962-9c937458da2b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:01.963490 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3a065f2b-9817-4dd3-9962-9c937458da2b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.161704 Apr 06 17:00:01.964261 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1405/2809] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:01 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:02.819697 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-985bc1aa-c3cb-4810-ab5c-9f37519f4551 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:02.820311 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a446259f-d74f-4f6b-b268-529c28e36b50 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:02.820724 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-985bc1aa-c3cb-4810-ab5c-9f37519f4551 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:02.820851 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a446259f-d74f-4f6b-b268-529c28e36b50 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:02.827137 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a446259f-d74f-4f6b-b268-529c28e36b50 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:02.827321 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-985bc1aa-c3cb-4810-ab5c-9f37519f4551 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:02.827583 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a446259f-d74f-4f6b-b268-529c28e36b50 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:02.827743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-985bc1aa-c3cb-4810-ab5c-9f37519f4551 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:02.828353 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a446259f-d74f-4f6b-b268-529c28e36b50 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:02.828511 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-985bc1aa-c3cb-4810-ab5c-9f37519f4551 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:02.828824 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a446259f-d74f-4f6b-b268-529c28e36b50 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:02.828999 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-985bc1aa-c3cb-4810-ab5c-9f37519f4551 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:02.893774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a446259f-d74f-4f6b-b268-529c28e36b50 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:02.901772 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a446259f-d74f-4f6b-b268-529c28e36b50 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.086212 Apr 06 17:00:02.902346 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1406/2810] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:02 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:02.969267 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-985bc1aa-c3cb-4810-ab5c-9f37519f4551 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:02.978138 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-985bc1aa-c3cb-4810-ab5c-9f37519f4551 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:02.979648 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-985bc1aa-c3cb-4810-ab5c-9f37519f4551 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:02.980902 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9965ab67-1a59-4cc8-8c0a-2acd3ca95e3c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:02.981201 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-985bc1aa-c3cb-4810-ab5c-9f37519f4551 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.165669 Apr 06 17:00:02.981517 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9965ab67-1a59-4cc8-8c0a-2acd3ca95e3c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:02.982043 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1405/2811] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:02 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:02.988071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9965ab67-1a59-4cc8-8c0a-2acd3ca95e3c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:02.988521 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9965ab67-1a59-4cc8-8c0a-2acd3ca95e3c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:02.989419 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9965ab67-1a59-4cc8-8c0a-2acd3ca95e3c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:02.989867 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9965ab67-1a59-4cc8-8c0a-2acd3ca95e3c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:03.128280 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9965ab67-1a59-4cc8-8c0a-2acd3ca95e3c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:03.136175 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9965ab67-1a59-4cc8-8c0a-2acd3ca95e3c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.159500 Apr 06 17:00:03.136801 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1407/2812] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:02 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:00:03.922887 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4dc87013-00f7-402f-8ed7-da5d5c097523 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:03.923930 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4dc87013-00f7-402f-8ed7-da5d5c097523 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:03.931828 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4dc87013-00f7-402f-8ed7-da5d5c097523 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:03.932275 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4dc87013-00f7-402f-8ed7-da5d5c097523 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:03.933192 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4dc87013-00f7-402f-8ed7-da5d5c097523 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:03.933621 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4dc87013-00f7-402f-8ed7-da5d5c097523 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:03.999735 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8d60bf83-0a9f-42ba-827b-2f3783ea1395 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:04.000427 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8d60bf83-0a9f-42ba-827b-2f3783ea1395 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:04.006736 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4dc87013-00f7-402f-8ed7-da5d5c097523 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:04.010689 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d60bf83-0a9f-42ba-827b-2f3783ea1395 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:04.011296 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d60bf83-0a9f-42ba-827b-2f3783ea1395 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:04.012195 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d60bf83-0a9f-42ba-827b-2f3783ea1395 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:04.013047 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d60bf83-0a9f-42ba-827b-2f3783ea1395 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:04.020700 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4dc87013-00f7-402f-8ed7-da5d5c097523 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 200 len: 1372 microversion: 2.1 time: 0.103768 Apr 06 17:00:04.021562 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1406/2813] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:03 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:04.038269 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cdc13479-da14-44db-913e-f93ca1f8adb2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '.version_select at 0x7fa9ca1539d0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:04.061657 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cdc13479-da14-44db-913e-f93ca1f8adb2 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-246421952" status: 202 len: 0 microversion: 2.1 time: 0.027522 Apr 06 17:00:04.062254 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1407/2814] 10.222.0.64 () {58 vars in 1217 bytes} [Wed Apr 6 17:00:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-246421952 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 06 17:00:04.151599 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8d60bf83-0a9f-42ba-827b-2f3783ea1395 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:04.153580 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-792ee612-d998-47d4-bd51-37c598f0ba21 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:04.154144 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-792ee612-d998-47d4-bd51-37c598f0ba21 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:04.159952 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-792ee612-d998-47d4-bd51-37c598f0ba21 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:04.160207 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8d60bf83-0a9f-42ba-827b-2f3783ea1395 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:04.160429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-792ee612-d998-47d4-bd51-37c598f0ba21 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:04.161410 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-792ee612-d998-47d4-bd51-37c598f0ba21 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:04.161762 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8d60bf83-0a9f-42ba-827b-2f3783ea1395 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:04.162073 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-792ee612-d998-47d4-bd51-37c598f0ba21 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:04.162912 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8d60bf83-0a9f-42ba-827b-2f3783ea1395 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.167198 Apr 06 17:00:04.163658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1408/2815] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:03 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:04.329837 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-792ee612-d998-47d4-bd51-37c598f0ba21 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:04.339036 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-792ee612-d998-47d4-bd51-37c598f0ba21 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.189230 Apr 06 17:00:04.339915 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1408/2816] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:04 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:00:04.916363 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8483b908-492c-4151-b43c-1b7a3ef7816b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Action: 'create', calling method: .version_select at 0x7fa9cf096b80>, body: {"keypair": {"name": "tempest-keypair-337634090"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:00:04.939242 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-8483b908-492c-4151-b43c-1b7a3ef7816b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Getting quotas for project a7b211944dc94094801aa5dd3d20a401. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 17:00:04.945255 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-8483b908-492c-4151-b43c-1b7a3ef7816b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Getting quotas for user 22d0f09ff8c240a485a775d3c95d626b and project a7b211944dc94094801aa5dd3d20a401. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 17:00:04.959299 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8483b908-492c-4151-b43c-1b7a3ef7816b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [4acf6183-9936-4fbf-8bc7-28fe24a6e66d] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 06 17:00:05.185315 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b69e8eb1-f4d0-4b09-85d0-9f7a0b2cdcc0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:05.186291 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b69e8eb1-f4d0-4b09-85d0-9f7a0b2cdcc0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:05.195458 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b69e8eb1-f4d0-4b09-85d0-9f7a0b2cdcc0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:05.195907 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b69e8eb1-f4d0-4b09-85d0-9f7a0b2cdcc0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:05.196673 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b69e8eb1-f4d0-4b09-85d0-9f7a0b2cdcc0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:05.197133 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b69e8eb1-f4d0-4b09-85d0-9f7a0b2cdcc0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:05.337932 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b69e8eb1-f4d0-4b09-85d0-9f7a0b2cdcc0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:05.346730 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b69e8eb1-f4d0-4b09-85d0-9f7a0b2cdcc0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:05.348272 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b69e8eb1-f4d0-4b09-85d0-9f7a0b2cdcc0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:05.349851 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b69e8eb1-f4d0-4b09-85d0-9f7a0b2cdcc0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.171140 Apr 06 17:00:05.350427 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1409/2817] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:05 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:05.357274 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-935a4cf4-d407-47d1-b0d5-5e3819a352c1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:05.357881 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-935a4cf4-d407-47d1-b0d5-5e3819a352c1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:05.364074 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-935a4cf4-d407-47d1-b0d5-5e3819a352c1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:05.364528 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-935a4cf4-d407-47d1-b0d5-5e3819a352c1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:05.365324 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-935a4cf4-d407-47d1-b0d5-5e3819a352c1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:05.365762 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-935a4cf4-d407-47d1-b0d5-5e3819a352c1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:05.509505 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-935a4cf4-d407-47d1-b0d5-5e3819a352c1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:05.521963 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-935a4cf4-d407-47d1-b0d5-5e3819a352c1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.168694 Apr 06 17:00:05.522531 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1410/2818] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:05 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:00:05.971647 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [None req-8483b908-492c-4151-b43c-1b7a3ef7816b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [4acf6183-9936-4fbf-8bc7-28fe24a6e66d] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 38202. Apr 06 17:00:06.341632 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-8483b908-492c-4151-b43c-1b7a3ef7816b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Getting quotas for project a7b211944dc94094801aa5dd3d20a401. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 17:00:06.346257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-8483b908-492c-4151-b43c-1b7a3ef7816b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Getting quotas for user 22d0f09ff8c240a485a775d3c95d626b and project a7b211944dc94094801aa5dd3d20a401. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 17:00:06.364126 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8483b908-492c-4151-b43c-1b7a3ef7816b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.451576 Apr 06 17:00:06.370225 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1409/2819] 10.222.0.64 () {60 vars in 1157 bytes} [Wed Apr 6 17:00:04 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:06.373980 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0c087769-2ebd-414c-9d29-064a3433a09d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:06.375414 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0c087769-2ebd-414c-9d29-064a3433a09d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:06.381679 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e77a56fb-4abd-446d-9748-6a530f658ace tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:06.382107 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c087769-2ebd-414c-9d29-064a3433a09d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:06.382708 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e77a56fb-4abd-446d-9748-6a530f658ace tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:06.382922 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c087769-2ebd-414c-9d29-064a3433a09d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:06.383865 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c087769-2ebd-414c-9d29-064a3433a09d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:06.384469 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c087769-2ebd-414c-9d29-064a3433a09d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:06.389568 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e77a56fb-4abd-446d-9748-6a530f658ace tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:06.390113 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e77a56fb-4abd-446d-9748-6a530f658ace tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:06.391235 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e77a56fb-4abd-446d-9748-6a530f658ace tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:06.391741 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e77a56fb-4abd-446d-9748-6a530f658ace tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:06.422105 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e77a56fb-4abd-446d-9748-6a530f658ace tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 06 17:00:06.514194 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e77a56fb-4abd-446d-9748-6a530f658ace tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "DELETE /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 204 len: 0 microversion: 2.1 time: 0.136049 Apr 06 17:00:06.518585 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1410/2820] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 17:00:06 2022] DELETE /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 06 17:00:06.526415 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-267a4585-13d6-4888-aba1-146141528c84 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:06.527705 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-267a4585-13d6-4888-aba1-146141528c84 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:06.536659 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-267a4585-13d6-4888-aba1-146141528c84 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:06.537380 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-267a4585-13d6-4888-aba1-146141528c84 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:06.538460 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-267a4585-13d6-4888-aba1-146141528c84 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:06.539057 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-267a4585-13d6-4888-aba1-146141528c84 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:06.562422 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0c087769-2ebd-414c-9d29-064a3433a09d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:06.571171 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0c087769-2ebd-414c-9d29-064a3433a09d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:06.574098 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0c087769-2ebd-414c-9d29-064a3433a09d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:06.575447 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0c087769-2ebd-414c-9d29-064a3433a09d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.210997 Apr 06 17:00:06.576284 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1411/2821] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:06 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 17:00:06.580815 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e19e04be-840c-4496-ba7b-2d541beb2293 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:06.581723 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e19e04be-840c-4496-ba7b-2d541beb2293 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:06.590249 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e19e04be-840c-4496-ba7b-2d541beb2293 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:06.590860 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e19e04be-840c-4496-ba7b-2d541beb2293 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:06.591743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e19e04be-840c-4496-ba7b-2d541beb2293 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:06.592251 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e19e04be-840c-4496-ba7b-2d541beb2293 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:06.683030 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-267a4585-13d6-4888-aba1-146141528c84 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:06.695728 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-267a4585-13d6-4888-aba1-146141528c84 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.174498 Apr 06 17:00:06.695728 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1411/2822] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:06 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:06.808754 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e19e04be-840c-4496-ba7b-2d541beb2293 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:06.817420 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e19e04be-840c-4496-ba7b-2d541beb2293 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.240207 Apr 06 17:00:06.818294 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1412/2823] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:06 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:07.594755 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fa569a33-0060-47c3-bccc-0e1db21fd9ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:07.595901 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fa569a33-0060-47c3-bccc-0e1db21fd9ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:07.602729 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa569a33-0060-47c3-bccc-0e1db21fd9ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:07.603163 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa569a33-0060-47c3-bccc-0e1db21fd9ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:07.603934 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa569a33-0060-47c3-bccc-0e1db21fd9ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:07.604369 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fa569a33-0060-47c3-bccc-0e1db21fd9ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:07.716869 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fef8d2b7-93b5-41f4-9bfe-5afeed4e8f78 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:07.718486 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fef8d2b7-93b5-41f4-9bfe-5afeed4e8f78 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:07.725896 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fef8d2b7-93b5-41f4-9bfe-5afeed4e8f78 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:07.727007 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fef8d2b7-93b5-41f4-9bfe-5afeed4e8f78 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:07.727885 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fef8d2b7-93b5-41f4-9bfe-5afeed4e8f78 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:07.728645 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fef8d2b7-93b5-41f4-9bfe-5afeed4e8f78 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:07.767739 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fa569a33-0060-47c3-bccc-0e1db21fd9ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:07.776564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fa569a33-0060-47c3-bccc-0e1db21fd9ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:07.778180 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fa569a33-0060-47c3-bccc-0e1db21fd9ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:07.779497 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fa569a33-0060-47c3-bccc-0e1db21fd9ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.188807 Apr 06 17:00:07.780152 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1412/2824] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:07 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:07.801642 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f7cdd8dd-4596-4d72-ace6-6d4a8c8a7e40 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-984549954", "imageRef": "c217dd2b-7679-4860-b2e6-01a967f654df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "161b97e6-a667-4e80-ab79-6d47a727bfd9"}], "security_groups": [{"name": "tempest-securitygroup--1961114579"}], "key_name": "tempest-keypair-337634090", "user_data": "}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:00:07.878705 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fef8d2b7-93b5-41f4-9bfe-5afeed4e8f78 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:07.887143 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fef8d2b7-93b5-41f4-9bfe-5afeed4e8f78 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.177176 Apr 06 17:00:07.887723 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1413/2825] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:07 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:07.892353 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ed2e9e93-729b-4388-8d40-0a626cf11175 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:07.892993 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ed2e9e93-729b-4388-8d40-0a626cf11175 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:07.899592 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed2e9e93-729b-4388-8d40-0a626cf11175 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:07.900041 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed2e9e93-729b-4388-8d40-0a626cf11175 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:07.900858 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed2e9e93-729b-4388-8d40-0a626cf11175 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:07.901299 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed2e9e93-729b-4388-8d40-0a626cf11175 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:07.903798 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-f7cdd8dd-4596-4d72-ace6-6d4a8c8a7e40 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] validate_networks() for [('161b97e6-a667-4e80-ab79-6d47a727bfd9', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 06 17:00:08.039549 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ed2e9e93-729b-4388-8d40-0a626cf11175 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:08.047724 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ed2e9e93-729b-4388-8d40-0a626cf11175 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.159009 Apr 06 17:00:08.048304 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1414/2826] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:07 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:08.341840 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-f7cdd8dd-4596-4d72-ace6-6d4a8c8a7e40 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 06 17:00:08.342291 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-f7cdd8dd-4596-4d72-ace6-6d4a8c8a7e40 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 06 17:00:08.342752 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-f7cdd8dd-4596-4d72-ace6-6d4a8c8a7e40 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 06 17:00:08.343125 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-f7cdd8dd-4596-4d72-ace6-6d4a8c8a7e40 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 06 17:00:08.343554 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-f7cdd8dd-4596-4d72-ace6-6d4a8c8a7e40 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 06 17:00:08.352958 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7cdd8dd-4596-4d72-ace6-6d4a8c8a7e40 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:08.353396 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7cdd8dd-4596-4d72-ace6-6d4a8c8a7e40 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:08.354178 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7cdd8dd-4596-4d72-ace6-6d4a8c8a7e40 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:08.354601 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f7cdd8dd-4596-4d72-ace6-6d4a8c8a7e40 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:08.371568 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-f7cdd8dd-4596-4d72-ace6-6d4a8c8a7e40 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Getting quotas for project a7b211944dc94094801aa5dd3d20a401. Resources: {'instances', 'cores', 'ram'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 17:00:08.375549 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-f7cdd8dd-4596-4d72-ace6-6d4a8c8a7e40 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Getting quotas for user 22d0f09ff8c240a485a775d3c95d626b and project a7b211944dc94094801aa5dd3d20a401. Resources: {'instances', 'cores', 'ram'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 17:00:08.386403 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f7cdd8dd-4596-4d72-ace6-6d4a8c8a7e40 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 06 17:00:08.388637 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f7cdd8dd-4596-4d72-ace6-6d4a8c8a7e40 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 4be6d0c6-2b22-40ab-b5b9-0f738db81efe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c217dd2b-7679-4860-b2e6-01a967f654df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 06 17:00:08.444935 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f7cdd8dd-4596-4d72-ace6-6d4a8c8a7e40 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.647674 Apr 06 17:00:08.445585 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1413/2827] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Apr 6 17:00:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 06 17:00:08.455772 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-580dd70e-7be9-408a-87a6-65952f14b591 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:08.456387 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-580dd70e-7be9-408a-87a6-65952f14b591 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 4be6d0c6-2b22-40ab-b5b9-0f738db81efe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:08.510992 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-580dd70e-7be9-408a-87a6-65952f14b591 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:08.517681 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-580dd70e-7be9-408a-87a6-65952f14b591 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe" status: 200 len: 1240 microversion: 2.1 time: 0.065841 Apr 06 17:00:08.518219 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1415/2828] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:08 2022] GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:08.799031 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b56cdc10-dfd8-4071-b142-69f64c6e4acf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:08.799609 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b56cdc10-dfd8-4071-b142-69f64c6e4acf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:08.806230 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b56cdc10-dfd8-4071-b142-69f64c6e4acf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:08.806672 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b56cdc10-dfd8-4071-b142-69f64c6e4acf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:08.807435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b56cdc10-dfd8-4071-b142-69f64c6e4acf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:08.807844 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b56cdc10-dfd8-4071-b142-69f64c6e4acf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:08.904450 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-efb18bc5-9ad1-4c7f-847e-dbb8662938cb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:08.905091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-efb18bc5-9ad1-4c7f-847e-dbb8662938cb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:08.913014 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efb18bc5-9ad1-4c7f-847e-dbb8662938cb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:08.914027 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efb18bc5-9ad1-4c7f-847e-dbb8662938cb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:08.914859 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efb18bc5-9ad1-4c7f-847e-dbb8662938cb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:08.915284 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efb18bc5-9ad1-4c7f-847e-dbb8662938cb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:08.951272 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b56cdc10-dfd8-4071-b142-69f64c6e4acf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:08.967877 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b56cdc10-dfd8-4071-b142-69f64c6e4acf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:08.969414 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b56cdc10-dfd8-4071-b142-69f64c6e4acf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:08.971320 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b56cdc10-dfd8-4071-b142-69f64c6e4acf tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.176872 Apr 06 17:00:08.982921 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1414/2829] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:08 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:09.061646 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-efb18bc5-9ad1-4c7f-847e-dbb8662938cb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:09.065249 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-88cfe62a-b8af-4035-b9a9-bbc460a81e10 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:09.065461 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-88cfe62a-b8af-4035-b9a9-bbc460a81e10 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:09.070097 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-efb18bc5-9ad1-4c7f-847e-dbb8662938cb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.169562 Apr 06 17:00:09.070857 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1416/2830] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:08 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:09.071327 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88cfe62a-b8af-4035-b9a9-bbc460a81e10 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:09.071774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88cfe62a-b8af-4035-b9a9-bbc460a81e10 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:09.072537 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88cfe62a-b8af-4035-b9a9-bbc460a81e10 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:09.072997 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88cfe62a-b8af-4035-b9a9-bbc460a81e10 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:09.212213 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-88cfe62a-b8af-4035-b9a9-bbc460a81e10 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:09.220320 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-88cfe62a-b8af-4035-b9a9-bbc460a81e10 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.159303 Apr 06 17:00:09.220921 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1415/2831] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:09 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:00:09.541082 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-32e5c19f-62ec-42dd-b055-ad26eb14ddf9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:09.541686 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-32e5c19f-62ec-42dd-b055-ad26eb14ddf9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 4be6d0c6-2b22-40ab-b5b9-0f738db81efe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:09.549146 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32e5c19f-62ec-42dd-b055-ad26eb14ddf9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:09.549952 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32e5c19f-62ec-42dd-b055-ad26eb14ddf9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:09.550726 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32e5c19f-62ec-42dd-b055-ad26eb14ddf9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:09.551154 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32e5c19f-62ec-42dd-b055-ad26eb14ddf9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:09.634526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-32e5c19f-62ec-42dd-b055-ad26eb14ddf9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:09.641966 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-32e5c19f-62ec-42dd-b055-ad26eb14ddf9 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe" status: 200 len: 1300 microversion: 2.1 time: 0.110729 Apr 06 17:00:09.642514 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1417/2832] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:09 2022] GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe => generated 1300 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:09.991871 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-69c2ddb1-6635-44ce-9fa2-2fb4f640b4d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:09.992481 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-69c2ddb1-6635-44ce-9fa2-2fb4f640b4d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:09.998916 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69c2ddb1-6635-44ce-9fa2-2fb4f640b4d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:09.999405 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69c2ddb1-6635-44ce-9fa2-2fb4f640b4d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:10.000167 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69c2ddb1-6635-44ce-9fa2-2fb4f640b4d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:10.000603 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-69c2ddb1-6635-44ce-9fa2-2fb4f640b4d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:10.087505 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b997f102-958a-4212-926c-99303447c711 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:10.088253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b997f102-958a-4212-926c-99303447c711 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:10.100771 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b997f102-958a-4212-926c-99303447c711 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:10.101142 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b997f102-958a-4212-926c-99303447c711 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:10.102135 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b997f102-958a-4212-926c-99303447c711 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:10.102706 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b997f102-958a-4212-926c-99303447c711 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:10.148319 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-69c2ddb1-6635-44ce-9fa2-2fb4f640b4d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:10.156981 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-69c2ddb1-6635-44ce-9fa2-2fb4f640b4d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:10.158491 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-69c2ddb1-6635-44ce-9fa2-2fb4f640b4d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:10.159646 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-69c2ddb1-6635-44ce-9fa2-2fb4f640b4d8 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.172597 Apr 06 17:00:10.160214 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1416/2833] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:09 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:10.238616 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-09b71587-b650-45f7-acc9-45049b550a83 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:10.239448 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-09b71587-b650-45f7-acc9-45049b550a83 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:10.245781 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09b71587-b650-45f7-acc9-45049b550a83 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:10.246237 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09b71587-b650-45f7-acc9-45049b550a83 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:10.247012 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09b71587-b650-45f7-acc9-45049b550a83 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:10.247446 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-09b71587-b650-45f7-acc9-45049b550a83 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:10.337492 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b997f102-958a-4212-926c-99303447c711 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:10.346439 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b997f102-958a-4212-926c-99303447c711 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.262805 Apr 06 17:00:10.347353 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1418/2834] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:10 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:00:10.384069 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-09b71587-b650-45f7-acc9-45049b550a83 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:10.392282 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-09b71587-b650-45f7-acc9-45049b550a83 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.157651 Apr 06 17:00:10.392914 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1417/2835] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:10 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:10.659472 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4bffb69e-54f3-4e94-9e5e-9a026a708b6b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:10.660147 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4bffb69e-54f3-4e94-9e5e-9a026a708b6b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 4be6d0c6-2b22-40ab-b5b9-0f738db81efe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:10.666700 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bffb69e-54f3-4e94-9e5e-9a026a708b6b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:10.667234 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bffb69e-54f3-4e94-9e5e-9a026a708b6b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:10.668088 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bffb69e-54f3-4e94-9e5e-9a026a708b6b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:10.668602 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bffb69e-54f3-4e94-9e5e-9a026a708b6b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:10.906640 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4bffb69e-54f3-4e94-9e5e-9a026a708b6b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:10.914684 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4bffb69e-54f3-4e94-9e5e-9a026a708b6b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe" status: 200 len: 1366 microversion: 2.1 time: 0.259180 Apr 06 17:00:10.915235 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1419/2836] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:10 2022] GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:11.178956 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2b269e62-cdd2-45fc-9dcc-b0cf506ec0b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:11.179684 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2b269e62-cdd2-45fc-9dcc-b0cf506ec0b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:11.186135 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b269e62-cdd2-45fc-9dcc-b0cf506ec0b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:11.186653 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b269e62-cdd2-45fc-9dcc-b0cf506ec0b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:11.187474 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b269e62-cdd2-45fc-9dcc-b0cf506ec0b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:11.187971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b269e62-cdd2-45fc-9dcc-b0cf506ec0b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:11.295688 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-799e8081-ab4d-4de5-956a-6cb78e94d1b4 req-a6b98d4f-37d6-4dca-a506-987709c0003f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4be6d0c6-2b22-40ab-b5b9-0f738db81efe", "tag": "55e9d3e8-a34b-4403-8517-a838470f757e"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:00:11.309709 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-799e8081-ab4d-4de5-956a-6cb78e94d1b4 req-a6b98d4f-37d6-4dca-a506-987709c0003f service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:11.310441 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-799e8081-ab4d-4de5-956a-6cb78e94d1b4 req-a6b98d4f-37d6-4dca-a506-987709c0003f service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:11.325635 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-799e8081-ab4d-4de5-956a-6cb78e94d1b4 req-a6b98d4f-37d6-4dca-a506-987709c0003f service nova] Creating event network-changed:55e9d3e8-a34b-4403-8517-a838470f757e for instance 4be6d0c6-2b22-40ab-b5b9-0f738db81efe on hv-cinder-83684 Apr 06 17:00:11.332363 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-799e8081-ab4d-4de5-956a-6cb78e94d1b4 req-a6b98d4f-37d6-4dca-a506-987709c0003f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130767 Apr 06 17:00:11.333502 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1420/2837] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:00:11.367428 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fb202ff5-ed9e-4bf5-942c-b1cd8d884b6b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:11.368159 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fb202ff5-ed9e-4bf5-942c-b1cd8d884b6b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:11.374827 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb202ff5-ed9e-4bf5-942c-b1cd8d884b6b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:11.375288 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb202ff5-ed9e-4bf5-942c-b1cd8d884b6b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:11.376073 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb202ff5-ed9e-4bf5-942c-b1cd8d884b6b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:11.376507 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb202ff5-ed9e-4bf5-942c-b1cd8d884b6b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:11.383988 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2b269e62-cdd2-45fc-9dcc-b0cf506ec0b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:11.397599 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2b269e62-cdd2-45fc-9dcc-b0cf506ec0b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:11.399326 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2b269e62-cdd2-45fc-9dcc-b0cf506ec0b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:11.400581 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2b269e62-cdd2-45fc-9dcc-b0cf506ec0b0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.226052 Apr 06 17:00:11.401259 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1418/2838] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:11 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:11.416591 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-048a1822-ecbb-4b60-90e7-b34d8e225a27 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:11.417532 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-048a1822-ecbb-4b60-90e7-b34d8e225a27 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:11.423604 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-048a1822-ecbb-4b60-90e7-b34d8e225a27 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:11.424282 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-048a1822-ecbb-4b60-90e7-b34d8e225a27 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:11.425075 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-048a1822-ecbb-4b60-90e7-b34d8e225a27 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:11.425804 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-048a1822-ecbb-4b60-90e7-b34d8e225a27 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:11.577481 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-048a1822-ecbb-4b60-90e7-b34d8e225a27 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:11.588264 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-048a1822-ecbb-4b60-90e7-b34d8e225a27 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.174954 Apr 06 17:00:11.588905 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1419/2839] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:11 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:11.590314 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fb202ff5-ed9e-4bf5-942c-b1cd8d884b6b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:11.598798 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fb202ff5-ed9e-4bf5-942c-b1cd8d884b6b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.237095 Apr 06 17:00:11.599783 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1421/2840] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:11 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:00:11.935319 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2136513e-a601-4468-8413-c4ed0b326b3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:11.936300 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2136513e-a601-4468-8413-c4ed0b326b3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 4be6d0c6-2b22-40ab-b5b9-0f738db81efe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:11.945214 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2136513e-a601-4468-8413-c4ed0b326b3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:11.945664 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2136513e-a601-4468-8413-c4ed0b326b3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:11.946427 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2136513e-a601-4468-8413-c4ed0b326b3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:11.946860 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2136513e-a601-4468-8413-c4ed0b326b3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:12.088473 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2136513e-a601-4468-8413-c4ed0b326b3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:12.096458 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2136513e-a601-4468-8413-c4ed0b326b3d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe" status: 200 len: 1366 microversion: 2.1 time: 0.167855 Apr 06 17:00:12.097092 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1420/2841] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:11 2022] GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:12.423734 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fe99d5c8-f2f3-4994-8915-8fcdb02adc8c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:12.424784 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fe99d5c8-f2f3-4994-8915-8fcdb02adc8c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:12.435734 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe99d5c8-f2f3-4994-8915-8fcdb02adc8c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:12.436486 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe99d5c8-f2f3-4994-8915-8fcdb02adc8c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:12.437820 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe99d5c8-f2f3-4994-8915-8fcdb02adc8c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:12.438543 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe99d5c8-f2f3-4994-8915-8fcdb02adc8c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:12.596058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fe99d5c8-f2f3-4994-8915-8fcdb02adc8c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:12.605948 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fe99d5c8-f2f3-4994-8915-8fcdb02adc8c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:12.606180 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2e105a44-726a-4395-9667-79a0712042fc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:12.606641 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2e105a44-726a-4395-9667-79a0712042fc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:12.607441 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fe99d5c8-f2f3-4994-8915-8fcdb02adc8c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:12.608615 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fe99d5c8-f2f3-4994-8915-8fcdb02adc8c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.191615 Apr 06 17:00:12.609200 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1422/2842] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:12 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:12.613272 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e105a44-726a-4395-9667-79a0712042fc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:12.613736 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e105a44-726a-4395-9667-79a0712042fc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:12.614559 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e105a44-726a-4395-9667-79a0712042fc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:12.614997 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e105a44-726a-4395-9667-79a0712042fc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:12.616212 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fcfc8803-a39c-41cf-86a8-008e6687b8d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:12.616847 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fcfc8803-a39c-41cf-86a8-008e6687b8d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:12.623085 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcfc8803-a39c-41cf-86a8-008e6687b8d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:12.623535 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcfc8803-a39c-41cf-86a8-008e6687b8d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:12.624310 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcfc8803-a39c-41cf-86a8-008e6687b8d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:12.624780 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcfc8803-a39c-41cf-86a8-008e6687b8d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:12.778918 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2e105a44-726a-4395-9667-79a0712042fc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:12.787880 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2e105a44-726a-4395-9667-79a0712042fc tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.186069 Apr 06 17:00:12.788779 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1421/2843] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:12 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:12.871222 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fcfc8803-a39c-41cf-86a8-008e6687b8d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:12.880300 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fcfc8803-a39c-41cf-86a8-008e6687b8d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.267464 Apr 06 17:00:12.881019 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1423/2844] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:12 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:13.119865 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7dae708c-7240-46a1-96d2-e183ad5528ee tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:13.120377 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7dae708c-7240-46a1-96d2-e183ad5528ee tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 4be6d0c6-2b22-40ab-b5b9-0f738db81efe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:13.127039 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dae708c-7240-46a1-96d2-e183ad5528ee tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:13.127481 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dae708c-7240-46a1-96d2-e183ad5528ee tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:13.128241 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dae708c-7240-46a1-96d2-e183ad5528ee tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:13.128714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7dae708c-7240-46a1-96d2-e183ad5528ee tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:13.268339 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7dae708c-7240-46a1-96d2-e183ad5528ee tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:13.275775 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7dae708c-7240-46a1-96d2-e183ad5528ee tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe" status: 200 len: 1366 microversion: 2.1 time: 0.160495 Apr 06 17:00:13.276342 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1422/2845] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:13 2022] GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:13.631716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-14fb8082-a1f1-465a-b7e8-4dede3a549c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:13.632388 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-14fb8082-a1f1-465a-b7e8-4dede3a549c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:13.642655 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14fb8082-a1f1-465a-b7e8-4dede3a549c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:13.643317 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14fb8082-a1f1-465a-b7e8-4dede3a549c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:13.644526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14fb8082-a1f1-465a-b7e8-4dede3a549c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:13.645230 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14fb8082-a1f1-465a-b7e8-4dede3a549c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:13.796754 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-14fb8082-a1f1-465a-b7e8-4dede3a549c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:13.805719 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c8478bc-50ca-4d6c-a9ab-46b24fd99495 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:13.806503 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2c8478bc-50ca-4d6c-a9ab-46b24fd99495 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:13.806660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-14fb8082-a1f1-465a-b7e8-4dede3a549c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:13.808158 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-14fb8082-a1f1-465a-b7e8-4dede3a549c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:13.809464 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-14fb8082-a1f1-465a-b7e8-4dede3a549c2 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.184477 Apr 06 17:00:13.810107 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1424/2846] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:13 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:13.813153 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c8478bc-50ca-4d6c-a9ab-46b24fd99495 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:13.813601 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c8478bc-50ca-4d6c-a9ab-46b24fd99495 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:13.814361 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c8478bc-50ca-4d6c-a9ab-46b24fd99495 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:13.814774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c8478bc-50ca-4d6c-a9ab-46b24fd99495 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:13.901077 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5c6dd5d8-ce82-40d0-97fe-8ca922195840 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:13.902032 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5c6dd5d8-ce82-40d0-97fe-8ca922195840 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:13.909005 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c6dd5d8-ce82-40d0-97fe-8ca922195840 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:13.909574 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c6dd5d8-ce82-40d0-97fe-8ca922195840 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:13.910420 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c6dd5d8-ce82-40d0-97fe-8ca922195840 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:13.911235 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c6dd5d8-ce82-40d0-97fe-8ca922195840 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:13.958680 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2c8478bc-50ca-4d6c-a9ab-46b24fd99495 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:13.967121 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2c8478bc-50ca-4d6c-a9ab-46b24fd99495 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.165722 Apr 06 17:00:13.967782 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1423/2847] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:13 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:00:14.049637 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5c6dd5d8-ce82-40d0-97fe-8ca922195840 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:14.057800 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5c6dd5d8-ce82-40d0-97fe-8ca922195840 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.161354 Apr 06 17:00:14.058415 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1425/2848] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:13 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:14.293905 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-892bf672-9d78-4031-9705-ae44f63b6305 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:14.294437 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-892bf672-9d78-4031-9705-ae44f63b6305 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 4be6d0c6-2b22-40ab-b5b9-0f738db81efe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:14.300868 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-892bf672-9d78-4031-9705-ae44f63b6305 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:14.301297 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-892bf672-9d78-4031-9705-ae44f63b6305 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:14.302181 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-892bf672-9d78-4031-9705-ae44f63b6305 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:14.302606 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-892bf672-9d78-4031-9705-ae44f63b6305 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:14.442337 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-892bf672-9d78-4031-9705-ae44f63b6305 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:14.449868 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-892bf672-9d78-4031-9705-ae44f63b6305 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe" status: 200 len: 1366 microversion: 2.1 time: 0.159981 Apr 06 17:00:14.450439 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1424/2849] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:14 2022] GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:14.832096 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1db77d34-2dc3-4a51-b0e2-da9134bcc4a0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:14.833151 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1db77d34-2dc3-4a51-b0e2-da9134bcc4a0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:14.844535 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1db77d34-2dc3-4a51-b0e2-da9134bcc4a0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:14.845334 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1db77d34-2dc3-4a51-b0e2-da9134bcc4a0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:14.846601 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1db77d34-2dc3-4a51-b0e2-da9134bcc4a0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:14.847312 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1db77d34-2dc3-4a51-b0e2-da9134bcc4a0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:14.985752 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ec526f0f-6767-4668-9c73-5ed79d22d1b1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:14.986509 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ec526f0f-6767-4668-9c73-5ed79d22d1b1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:14.993234 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec526f0f-6767-4668-9c73-5ed79d22d1b1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:14.993670 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec526f0f-6767-4668-9c73-5ed79d22d1b1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:14.994436 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec526f0f-6767-4668-9c73-5ed79d22d1b1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:14.994869 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec526f0f-6767-4668-9c73-5ed79d22d1b1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:15.001802 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1db77d34-2dc3-4a51-b0e2-da9134bcc4a0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:15.010477 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1db77d34-2dc3-4a51-b0e2-da9134bcc4a0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:15.012025 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1db77d34-2dc3-4a51-b0e2-da9134bcc4a0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:15.013212 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1db77d34-2dc3-4a51-b0e2-da9134bcc4a0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.187752 Apr 06 17:00:15.013774 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1426/2850] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:14 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:15.077023 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9ce8d3d7-edbb-4f4b-87a2-0a9ebb64bc26 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:15.077628 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9ce8d3d7-edbb-4f4b-87a2-0a9ebb64bc26 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:15.084996 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ce8d3d7-edbb-4f4b-87a2-0a9ebb64bc26 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:15.085365 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ce8d3d7-edbb-4f4b-87a2-0a9ebb64bc26 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:15.086123 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ce8d3d7-edbb-4f4b-87a2-0a9ebb64bc26 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:15.086549 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ce8d3d7-edbb-4f4b-87a2-0a9ebb64bc26 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:15.148351 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ec526f0f-6767-4668-9c73-5ed79d22d1b1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:15.156374 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ec526f0f-6767-4668-9c73-5ed79d22d1b1 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.174934 Apr 06 17:00:15.156984 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1425/2851] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:14 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:15.220836 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9ce8d3d7-edbb-4f4b-87a2-0a9ebb64bc26 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:15.229558 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9ce8d3d7-edbb-4f4b-87a2-0a9ebb64bc26 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.158122 Apr 06 17:00:15.230109 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1427/2852] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:15 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:00:15.471744 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6ff2d207-5cf6-4217-a43b-34c2e90998a4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:15.472768 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6ff2d207-5cf6-4217-a43b-34c2e90998a4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 4be6d0c6-2b22-40ab-b5b9-0f738db81efe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:15.479846 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ff2d207-5cf6-4217-a43b-34c2e90998a4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:15.480301 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ff2d207-5cf6-4217-a43b-34c2e90998a4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:15.481536 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ff2d207-5cf6-4217-a43b-34c2e90998a4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:15.481972 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6ff2d207-5cf6-4217-a43b-34c2e90998a4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:15.621897 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6ff2d207-5cf6-4217-a43b-34c2e90998a4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:15.630288 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6ff2d207-5cf6-4217-a43b-34c2e90998a4 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe" status: 200 len: 1366 microversion: 2.1 time: 0.164891 Apr 06 17:00:15.631048 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1426/2853] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:15 2022] GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:16.033349 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e9787122-ab8a-4b88-8437-1aa5c7c423ab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:16.033966 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e9787122-ab8a-4b88-8437-1aa5c7c423ab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:16.041088 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9787122-ab8a-4b88-8437-1aa5c7c423ab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:16.041541 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9787122-ab8a-4b88-8437-1aa5c7c423ab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:16.042313 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9787122-ab8a-4b88-8437-1aa5c7c423ab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:16.042742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9787122-ab8a-4b88-8437-1aa5c7c423ab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:16.074268 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-b107805c-cb5c-44e0-8dd1-9d1691b97635 req-cd1d6b00-6949-438c-98e7-c950cd355089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be6d0c6-2b22-40ab-b5b9-0f738db81efe", "name": "network-vif-plugged", "status": "completed", "tag": "55e9d3e8-a34b-4403-8517-a838470f757e"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:00:16.082259 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b107805c-cb5c-44e0-8dd1-9d1691b97635 req-cd1d6b00-6949-438c-98e7-c950cd355089 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:16.082892 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b107805c-cb5c-44e0-8dd1-9d1691b97635 req-cd1d6b00-6949-438c-98e7-c950cd355089 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:16.095289 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-b107805c-cb5c-44e0-8dd1-9d1691b97635 req-cd1d6b00-6949-438c-98e7-c950cd355089 service nova] Creating event network-vif-plugged:55e9d3e8-a34b-4403-8517-a838470f757e for instance 4be6d0c6-2b22-40ab-b5b9-0f738db81efe on hv-cinder-83684 Apr 06 17:00:16.100504 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-b107805c-cb5c-44e0-8dd1-9d1691b97635 req-cd1d6b00-6949-438c-98e7-c950cd355089 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093361 Apr 06 17:00:16.101139 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1428/2854] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:00:16.174071 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9a5ce96a-b856-42a9-ba34-6cebe8551fbf tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:16.174829 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9a5ce96a-b856-42a9-ba34-6cebe8551fbf tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:16.181560 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a5ce96a-b856-42a9-ba34-6cebe8551fbf tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:16.182282 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a5ce96a-b856-42a9-ba34-6cebe8551fbf tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:16.183053 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a5ce96a-b856-42a9-ba34-6cebe8551fbf tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:16.183494 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a5ce96a-b856-42a9-ba34-6cebe8551fbf tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:16.187921 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e9787122-ab8a-4b88-8437-1aa5c7c423ab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:16.196624 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e9787122-ab8a-4b88-8437-1aa5c7c423ab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:16.198260 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e9787122-ab8a-4b88-8437-1aa5c7c423ab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:16.200012 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e9787122-ab8a-4b88-8437-1aa5c7c423ab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.171763 Apr 06 17:00:16.200675 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1427/2855] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:16 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:16.248238 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-41da90d2-b812-40f5-a9d7-542661f00c0f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:16.248874 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-41da90d2-b812-40f5-a9d7-542661f00c0f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:16.254701 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41da90d2-b812-40f5-a9d7-542661f00c0f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:16.255380 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41da90d2-b812-40f5-a9d7-542661f00c0f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:16.256656 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41da90d2-b812-40f5-a9d7-542661f00c0f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:16.257308 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-41da90d2-b812-40f5-a9d7-542661f00c0f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:16.355314 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9a5ce96a-b856-42a9-ba34-6cebe8551fbf tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:16.363644 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9a5ce96a-b856-42a9-ba34-6cebe8551fbf tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.193980 Apr 06 17:00:16.364528 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1429/2856] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:16 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:00:16.396170 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-41da90d2-b812-40f5-a9d7-542661f00c0f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:16.404652 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-41da90d2-b812-40f5-a9d7-542661f00c0f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.160494 Apr 06 17:00:16.405251 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1428/2857] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:16 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:00:16.652583 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ce8ff676-780a-4314-80c5-4a10df70ab31 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:16.653449 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ce8ff676-780a-4314-80c5-4a10df70ab31 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 4be6d0c6-2b22-40ab-b5b9-0f738db81efe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:16.664186 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce8ff676-780a-4314-80c5-4a10df70ab31 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:16.664982 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce8ff676-780a-4314-80c5-4a10df70ab31 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:16.666281 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce8ff676-780a-4314-80c5-4a10df70ab31 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:16.667273 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce8ff676-780a-4314-80c5-4a10df70ab31 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:16.812393 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ce8ff676-780a-4314-80c5-4a10df70ab31 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:16.822176 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ce8ff676-780a-4314-80c5-4a10df70ab31 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe" status: 200 len: 1366 microversion: 2.1 time: 0.177088 Apr 06 17:00:16.822745 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1430/2858] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:16 2022] GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:17.223526 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6369322b-434c-4824-a988-029f3d0e9359 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:17.224437 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6369322b-434c-4824-a988-029f3d0e9359 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:17.235664 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6369322b-434c-4824-a988-029f3d0e9359 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:17.236409 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6369322b-434c-4824-a988-029f3d0e9359 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:17.237715 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6369322b-434c-4824-a988-029f3d0e9359 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:17.238435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6369322b-434c-4824-a988-029f3d0e9359 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:17.376058 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6369322b-434c-4824-a988-029f3d0e9359 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:17.382186 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-32806e95-fa37-49e6-b55d-d098e6e50525 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:17.382791 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-32806e95-fa37-49e6-b55d-d098e6e50525 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:17.385064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6369322b-434c-4824-a988-029f3d0e9359 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:17.386636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6369322b-434c-4824-a988-029f3d0e9359 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:17.387805 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6369322b-434c-4824-a988-029f3d0e9359 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.171066 Apr 06 17:00:17.388392 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1429/2859] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:17 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:17.389631 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32806e95-fa37-49e6-b55d-d098e6e50525 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:17.390078 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32806e95-fa37-49e6-b55d-d098e6e50525 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:17.390850 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32806e95-fa37-49e6-b55d-d098e6e50525 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:17.391286 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32806e95-fa37-49e6-b55d-d098e6e50525 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:17.422384 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-90ba6760-98ed-46b3-aa6c-c2a1e7f3c3d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:17.423083 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-90ba6760-98ed-46b3-aa6c-c2a1e7f3c3d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:17.429514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90ba6760-98ed-46b3-aa6c-c2a1e7f3c3d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:17.430053 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90ba6760-98ed-46b3-aa6c-c2a1e7f3c3d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:17.430826 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90ba6760-98ed-46b3-aa6c-c2a1e7f3c3d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:17.431261 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-90ba6760-98ed-46b3-aa6c-c2a1e7f3c3d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:17.531629 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-32806e95-fa37-49e6-b55d-d098e6e50525 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:17.540225 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-32806e95-fa37-49e6-b55d-d098e6e50525 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.162198 Apr 06 17:00:17.540841 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1431/2860] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:17 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:00:17.577157 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-90ba6760-98ed-46b3-aa6c-c2a1e7f3c3d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:17.589128 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-90ba6760-98ed-46b3-aa6c-c2a1e7f3c3d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.170242 Apr 06 17:00:17.589948 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1430/2861] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:17 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:17.845905 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-67ee6782-2ee5-41b7-af09-c91d00ea8242 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:17.846765 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-67ee6782-2ee5-41b7-af09-c91d00ea8242 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 4be6d0c6-2b22-40ab-b5b9-0f738db81efe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:17.854532 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67ee6782-2ee5-41b7-af09-c91d00ea8242 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:17.855000 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67ee6782-2ee5-41b7-af09-c91d00ea8242 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:17.856162 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67ee6782-2ee5-41b7-af09-c91d00ea8242 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:17.856611 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67ee6782-2ee5-41b7-af09-c91d00ea8242 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:18.004607 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-67ee6782-2ee5-41b7-af09-c91d00ea8242 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:18.015120 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-67ee6782-2ee5-41b7-af09-c91d00ea8242 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe" status: 200 len: 1556 microversion: 2.1 time: 0.177345 Apr 06 17:00:18.015845 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1432/2862] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:17 2022] GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe => generated 1556 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:18.032251 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0d0ef4c5-4226-40d8-b739-c667e2bd7119 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:18.032768 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0d0ef4c5-4226-40d8-b739-c667e2bd7119 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 4be6d0c6-2b22-40ab-b5b9-0f738db81efe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:18.039209 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d0ef4c5-4226-40d8-b739-c667e2bd7119 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:18.039701 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d0ef4c5-4226-40d8-b739-c667e2bd7119 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:18.040466 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d0ef4c5-4226-40d8-b739-c667e2bd7119 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:18.040938 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d0ef4c5-4226-40d8-b739-c667e2bd7119 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:18.131266 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0d0ef4c5-4226-40d8-b739-c667e2bd7119 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102325 Apr 06 17:00:18.131988 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1431/2863] 10.222.0.64 () {58 vars in 1274 bytes} [Wed Apr 6 17:00:18 2022] GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:00:18.406846 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9463e091-fc36-40c8-80f3-4018acc67195 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:18.407465 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9463e091-fc36-40c8-80f3-4018acc67195 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:18.414950 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9463e091-fc36-40c8-80f3-4018acc67195 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:18.415401 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9463e091-fc36-40c8-80f3-4018acc67195 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:18.416194 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9463e091-fc36-40c8-80f3-4018acc67195 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:18.416627 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9463e091-fc36-40c8-80f3-4018acc67195 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:18.558784 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ab041d04-d502-40fa-8f4c-d6b3f5fc1c3b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:18.559399 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ab041d04-d502-40fa-8f4c-d6b3f5fc1c3b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:18.566226 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab041d04-d502-40fa-8f4c-d6b3f5fc1c3b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:18.566676 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab041d04-d502-40fa-8f4c-d6b3f5fc1c3b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:18.567450 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab041d04-d502-40fa-8f4c-d6b3f5fc1c3b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:18.567878 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ab041d04-d502-40fa-8f4c-d6b3f5fc1c3b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:18.712748 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ab041d04-d502-40fa-8f4c-d6b3f5fc1c3b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:18.720804 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ab041d04-d502-40fa-8f4c-d6b3f5fc1c3b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.166520 Apr 06 17:00:18.721373 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1432/2864] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:18 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:00:18.726234 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-98ff3397-2fb6-4518-a049-2a41c66cdba4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:18.726831 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-98ff3397-2fb6-4518-a049-2a41c66cdba4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:18.733102 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98ff3397-2fb6-4518-a049-2a41c66cdba4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:18.733613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98ff3397-2fb6-4518-a049-2a41c66cdba4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:18.734343 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98ff3397-2fb6-4518-a049-2a41c66cdba4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:18.734777 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-98ff3397-2fb6-4518-a049-2a41c66cdba4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:18.870677 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-98ff3397-2fb6-4518-a049-2a41c66cdba4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:18.880175 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-98ff3397-2fb6-4518-a049-2a41c66cdba4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.157479 Apr 06 17:00:18.880852 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1433/2865] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:18 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:18.922255 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9463e091-fc36-40c8-80f3-4018acc67195 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:18.931448 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9463e091-fc36-40c8-80f3-4018acc67195 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:18.933153 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9463e091-fc36-40c8-80f3-4018acc67195 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:18.934344 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9463e091-fc36-40c8-80f3-4018acc67195 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.531580 Apr 06 17:00:18.934897 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1433/2866] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:18 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:19.515227 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-95324498-e93b-4a43-9589-3e7bc980a0ac req-74a83210-0194-400f-a72d-e013ad603482 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4be6d0c6-2b22-40ab-b5b9-0f738db81efe", "tag": "55e9d3e8-a34b-4403-8517-a838470f757e"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:00:19.523660 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-95324498-e93b-4a43-9589-3e7bc980a0ac req-74a83210-0194-400f-a72d-e013ad603482 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:19.524092 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-95324498-e93b-4a43-9589-3e7bc980a0ac req-74a83210-0194-400f-a72d-e013ad603482 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:19.540984 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-95324498-e93b-4a43-9589-3e7bc980a0ac req-74a83210-0194-400f-a72d-e013ad603482 service nova] Creating event network-changed:55e9d3e8-a34b-4403-8517-a838470f757e for instance 4be6d0c6-2b22-40ab-b5b9-0f738db81efe on hv-cinder-83684 Apr 06 17:00:19.546409 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-95324498-e93b-4a43-9589-3e7bc980a0ac req-74a83210-0194-400f-a72d-e013ad603482 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034955 Apr 06 17:00:19.547029 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1434/2867] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:00:19.738544 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-606528de-3adf-442c-a9ca-feb13ccabda8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:19.739450 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-606528de-3adf-442c-a9ca-feb13ccabda8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:19.746710 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-606528de-3adf-442c-a9ca-feb13ccabda8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:19.747189 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-606528de-3adf-442c-a9ca-feb13ccabda8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:19.748012 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-606528de-3adf-442c-a9ca-feb13ccabda8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:19.748447 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-606528de-3adf-442c-a9ca-feb13ccabda8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:19.899188 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-942351e4-fabd-4452-8078-15f5dc7504f0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:19.900122 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-942351e4-fabd-4452-8078-15f5dc7504f0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:19.907608 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-942351e4-fabd-4452-8078-15f5dc7504f0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:19.908053 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-942351e4-fabd-4452-8078-15f5dc7504f0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:19.908883 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-942351e4-fabd-4452-8078-15f5dc7504f0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:19.909312 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-942351e4-fabd-4452-8078-15f5dc7504f0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:19.985955 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-606528de-3adf-442c-a9ca-feb13ccabda8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:19.996714 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-606528de-3adf-442c-a9ca-feb13ccabda8 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.262070 Apr 06 17:00:19.997469 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1434/2868] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:19 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:20.006477 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-201486a2-4c1f-4b6c-b5b7-e75e1c3115e5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:20.006477 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-201486a2-4c1f-4b6c-b5b7-e75e1c3115e5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:20.010154 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-201486a2-4c1f-4b6c-b5b7-e75e1c3115e5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:20.010736 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-201486a2-4c1f-4b6c-b5b7-e75e1c3115e5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:20.011666 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-201486a2-4c1f-4b6c-b5b7-e75e1c3115e5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:20.012190 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-201486a2-4c1f-4b6c-b5b7-e75e1c3115e5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:20.060216 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-942351e4-fabd-4452-8078-15f5dc7504f0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:20.068616 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-942351e4-fabd-4452-8078-15f5dc7504f0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.175272 Apr 06 17:00:20.071045 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1435/2869] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:19 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:20.249680 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-201486a2-4c1f-4b6c-b5b7-e75e1c3115e5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:20.259806 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-201486a2-4c1f-4b6c-b5b7-e75e1c3115e5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:20.261407 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-201486a2-4c1f-4b6c-b5b7-e75e1c3115e5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:20.263017 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-201486a2-4c1f-4b6c-b5b7-e75e1c3115e5 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.263927 Apr 06 17:00:20.263789 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1435/2870] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:19 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:21.018547 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eb1cffa0-7ce4-472c-8ae5-6f0d63928037 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:21.019504 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eb1cffa0-7ce4-472c-8ae5-6f0d63928037 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:21.027532 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb1cffa0-7ce4-472c-8ae5-6f0d63928037 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:21.027987 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb1cffa0-7ce4-472c-8ae5-6f0d63928037 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:21.028782 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb1cffa0-7ce4-472c-8ae5-6f0d63928037 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:21.029219 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb1cffa0-7ce4-472c-8ae5-6f0d63928037 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:21.088115 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dbba5f55-3198-499a-aa45-7b9700fa8cbb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:21.088749 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dbba5f55-3198-499a-aa45-7b9700fa8cbb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:21.095646 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dbba5f55-3198-499a-aa45-7b9700fa8cbb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:21.096100 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dbba5f55-3198-499a-aa45-7b9700fa8cbb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:21.096934 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dbba5f55-3198-499a-aa45-7b9700fa8cbb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:21.097336 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dbba5f55-3198-499a-aa45-7b9700fa8cbb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:21.174191 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-eb1cffa0-7ce4-472c-8ae5-6f0d63928037 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:21.182644 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eb1cffa0-7ce4-472c-8ae5-6f0d63928037 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.170858 Apr 06 17:00:21.183593 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1436/2871] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:21 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:21.241943 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-dbba5f55-3198-499a-aa45-7b9700fa8cbb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:21.251702 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dbba5f55-3198-499a-aa45-7b9700fa8cbb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.167831 Apr 06 17:00:21.252326 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1436/2872] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:21 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:21.281558 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-68fb10b3-a0fe-4b75-8c56-68602261d0aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:21.282157 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-68fb10b3-a0fe-4b75-8c56-68602261d0aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:21.288523 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68fb10b3-a0fe-4b75-8c56-68602261d0aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:21.288997 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68fb10b3-a0fe-4b75-8c56-68602261d0aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:21.289753 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68fb10b3-a0fe-4b75-8c56-68602261d0aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:21.290180 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-68fb10b3-a0fe-4b75-8c56-68602261d0aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:21.425370 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-68fb10b3-a0fe-4b75-8c56-68602261d0aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:21.433732 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-68fb10b3-a0fe-4b75-8c56-68602261d0aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:21.435387 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-68fb10b3-a0fe-4b75-8c56-68602261d0aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:21.436536 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-68fb10b3-a0fe-4b75-8c56-68602261d0aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.158950 Apr 06 17:00:21.437156 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1437/2873] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:21 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:22.204209 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ac79e9be-d391-499c-a3ae-8e04d3cc982f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:22.205277 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ac79e9be-d391-499c-a3ae-8e04d3cc982f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:22.216175 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac79e9be-d391-499c-a3ae-8e04d3cc982f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:22.216957 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac79e9be-d391-499c-a3ae-8e04d3cc982f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:22.218254 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac79e9be-d391-499c-a3ae-8e04d3cc982f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:22.218970 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac79e9be-d391-499c-a3ae-8e04d3cc982f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:22.269902 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3ffd8a45-1868-4940-bdfe-68cea3600803 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:22.270530 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3ffd8a45-1868-4940-bdfe-68cea3600803 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:22.277447 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ffd8a45-1868-4940-bdfe-68cea3600803 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:22.277894 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ffd8a45-1868-4940-bdfe-68cea3600803 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:22.278658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ffd8a45-1868-4940-bdfe-68cea3600803 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:22.279097 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ffd8a45-1868-4940-bdfe-68cea3600803 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:22.362623 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ac79e9be-d391-499c-a3ae-8e04d3cc982f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:22.370865 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ac79e9be-d391-499c-a3ae-8e04d3cc982f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.173059 Apr 06 17:00:22.375748 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1437/2874] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:22 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:22.420495 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3ffd8a45-1868-4940-bdfe-68cea3600803 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:22.428701 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3ffd8a45-1868-4940-bdfe-68cea3600803 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.162320 Apr 06 17:00:22.429391 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1438/2875] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:22 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:22.455093 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4708be1c-088f-42db-b9b0-b75f24c4ae84 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:22.455632 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4708be1c-088f-42db-b9b0-b75f24c4ae84 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:22.461870 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4708be1c-088f-42db-b9b0-b75f24c4ae84 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:22.462317 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4708be1c-088f-42db-b9b0-b75f24c4ae84 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:22.463079 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4708be1c-088f-42db-b9b0-b75f24c4ae84 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:22.463540 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4708be1c-088f-42db-b9b0-b75f24c4ae84 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:22.610399 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4708be1c-088f-42db-b9b0-b75f24c4ae84 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:22.622899 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4708be1c-088f-42db-b9b0-b75f24c4ae84 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:22.623647 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4708be1c-088f-42db-b9b0-b75f24c4ae84 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:22.624844 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4708be1c-088f-42db-b9b0-b75f24c4ae84 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.173882 Apr 06 17:00:22.625408 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1438/2876] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:22 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 17:00:23.398052 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-65455bd3-2e04-4315-93bd-222873f50001 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:23.398652 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-65455bd3-2e04-4315-93bd-222873f50001 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:23.405757 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65455bd3-2e04-4315-93bd-222873f50001 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:23.406201 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65455bd3-2e04-4315-93bd-222873f50001 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:23.406934 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65455bd3-2e04-4315-93bd-222873f50001 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:23.407377 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-65455bd3-2e04-4315-93bd-222873f50001 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:23.449713 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1c3bdeb3-31b3-4b28-aa8f-fa9e851c1576 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:23.450303 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1c3bdeb3-31b3-4b28-aa8f-fa9e851c1576 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:23.458714 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c3bdeb3-31b3-4b28-aa8f-fa9e851c1576 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:23.459331 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c3bdeb3-31b3-4b28-aa8f-fa9e851c1576 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:23.460410 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c3bdeb3-31b3-4b28-aa8f-fa9e851c1576 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:23.460883 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c3bdeb3-31b3-4b28-aa8f-fa9e851c1576 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:23.550343 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-65455bd3-2e04-4315-93bd-222873f50001 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:23.559296 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-65455bd3-2e04-4315-93bd-222873f50001 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.167721 Apr 06 17:00:23.559864 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1439/2877] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:23 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:23.599323 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1c3bdeb3-31b3-4b28-aa8f-fa9e851c1576 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:23.607878 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1c3bdeb3-31b3-4b28-aa8f-fa9e851c1576 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.164436 Apr 06 17:00:23.608476 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1439/2878] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:23 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:23.646810 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-095380f9-0931-41a6-884a-2ad3f467421e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:23.648235 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-095380f9-0931-41a6-884a-2ad3f467421e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:23.658191 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-095380f9-0931-41a6-884a-2ad3f467421e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:23.658820 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-095380f9-0931-41a6-884a-2ad3f467421e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:23.660012 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-095380f9-0931-41a6-884a-2ad3f467421e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:23.660610 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-095380f9-0931-41a6-884a-2ad3f467421e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:23.813069 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-095380f9-0931-41a6-884a-2ad3f467421e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:23.822514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-095380f9-0931-41a6-884a-2ad3f467421e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:23.823983 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-095380f9-0931-41a6-884a-2ad3f467421e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:23.825174 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-095380f9-0931-41a6-884a-2ad3f467421e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.184452 Apr 06 17:00:23.825741 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1440/2879] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:23 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:24.581292 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a94bcf5c-8b7c-434c-a2c2-925e1469f386 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:24.582335 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a94bcf5c-8b7c-434c-a2c2-925e1469f386 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:24.592980 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a94bcf5c-8b7c-434c-a2c2-925e1469f386 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:24.593739 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a94bcf5c-8b7c-434c-a2c2-925e1469f386 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:24.594985 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a94bcf5c-8b7c-434c-a2c2-925e1469f386 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:24.595755 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a94bcf5c-8b7c-434c-a2c2-925e1469f386 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:24.625787 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-277de122-0921-4437-bcb4-3bb8d0c13637 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:24.626404 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-277de122-0921-4437-bcb4-3bb8d0c13637 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:24.635778 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-277de122-0921-4437-bcb4-3bb8d0c13637 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:24.635778 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-277de122-0921-4437-bcb4-3bb8d0c13637 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:24.638095 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-277de122-0921-4437-bcb4-3bb8d0c13637 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:24.638095 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-277de122-0921-4437-bcb4-3bb8d0c13637 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:24.744309 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a94bcf5c-8b7c-434c-a2c2-925e1469f386 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:24.752721 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a94bcf5c-8b7c-434c-a2c2-925e1469f386 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.177993 Apr 06 17:00:24.753326 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1440/2880] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:24 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:24.780025 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-277de122-0921-4437-bcb4-3bb8d0c13637 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:24.788375 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-277de122-0921-4437-bcb4-3bb8d0c13637 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.166447 Apr 06 17:00:24.789004 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1441/2881] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:24 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:24.849149 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b398e215-9ad6-4109-bbb4-73aa3a32d295 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:24.850029 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b398e215-9ad6-4109-bbb4-73aa3a32d295 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:24.860868 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b398e215-9ad6-4109-bbb4-73aa3a32d295 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:24.861628 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b398e215-9ad6-4109-bbb4-73aa3a32d295 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:24.862901 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b398e215-9ad6-4109-bbb4-73aa3a32d295 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:24.863679 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b398e215-9ad6-4109-bbb4-73aa3a32d295 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:25.007279 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b398e215-9ad6-4109-bbb4-73aa3a32d295 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:25.015792 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b398e215-9ad6-4109-bbb4-73aa3a32d295 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:25.017319 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b398e215-9ad6-4109-bbb4-73aa3a32d295 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:25.018486 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b398e215-9ad6-4109-bbb4-73aa3a32d295 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.177259 Apr 06 17:00:25.019065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1441/2882] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:24 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:25.772481 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6787788b-3bad-4274-abfc-f74ca385ba74 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:25.773331 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6787788b-3bad-4274-abfc-f74ca385ba74 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:25.782114 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6787788b-3bad-4274-abfc-f74ca385ba74 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:25.782696 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6787788b-3bad-4274-abfc-f74ca385ba74 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:25.783694 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6787788b-3bad-4274-abfc-f74ca385ba74 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:25.784232 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6787788b-3bad-4274-abfc-f74ca385ba74 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:25.805721 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-21600aa3-70a4-4e4a-840c-59326f73b38f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:25.806318 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-21600aa3-70a4-4e4a-840c-59326f73b38f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:25.813163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21600aa3-70a4-4e4a-840c-59326f73b38f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:25.813617 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21600aa3-70a4-4e4a-840c-59326f73b38f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:25.814398 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21600aa3-70a4-4e4a-840c-59326f73b38f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:25.814836 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21600aa3-70a4-4e4a-840c-59326f73b38f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:25.922202 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6787788b-3bad-4274-abfc-f74ca385ba74 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:25.930481 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6787788b-3bad-4274-abfc-f74ca385ba74 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.163313 Apr 06 17:00:25.931405 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1442/2883] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:25 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:25.962205 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-21600aa3-70a4-4e4a-840c-59326f73b38f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:25.975041 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-21600aa3-70a4-4e4a-840c-59326f73b38f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.172981 Apr 06 17:00:25.975906 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1442/2884] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:25 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:26.037611 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2067b154-f0ec-437d-8795-18785b97d1a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:26.038300 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2067b154-f0ec-437d-8795-18785b97d1a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:26.044836 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2067b154-f0ec-437d-8795-18785b97d1a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:26.045289 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2067b154-f0ec-437d-8795-18785b97d1a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:26.046052 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2067b154-f0ec-437d-8795-18785b97d1a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:26.046485 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2067b154-f0ec-437d-8795-18785b97d1a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:26.187735 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2067b154-f0ec-437d-8795-18785b97d1a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:26.200294 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2067b154-f0ec-437d-8795-18785b97d1a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:26.202662 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2067b154-f0ec-437d-8795-18785b97d1a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:26.204441 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2067b154-f0ec-437d-8795-18785b97d1a3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.170510 Apr 06 17:00:26.205367 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1443/2885] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:26 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:26.952130 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9137fdee-27bb-4953-aafc-6935b780fdca tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:26.953136 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9137fdee-27bb-4953-aafc-6935b780fdca tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:26.962856 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9137fdee-27bb-4953-aafc-6935b780fdca tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:26.963309 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9137fdee-27bb-4953-aafc-6935b780fdca tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:26.964083 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9137fdee-27bb-4953-aafc-6935b780fdca tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:26.964518 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9137fdee-27bb-4953-aafc-6935b780fdca tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:27.000517 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-76bfab0e-bf88-4c2e-86c5-d126242be2f1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:27.001244 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-76bfab0e-bf88-4c2e-86c5-d126242be2f1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:27.008857 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76bfab0e-bf88-4c2e-86c5-d126242be2f1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:27.009281 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76bfab0e-bf88-4c2e-86c5-d126242be2f1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:27.010091 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76bfab0e-bf88-4c2e-86c5-d126242be2f1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:27.010523 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-76bfab0e-bf88-4c2e-86c5-d126242be2f1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:27.102137 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9137fdee-27bb-4953-aafc-6935b780fdca tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:27.110543 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9137fdee-27bb-4953-aafc-6935b780fdca tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.165454 Apr 06 17:00:27.111113 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1443/2886] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:26 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:27.145558 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-76bfab0e-bf88-4c2e-86c5-d126242be2f1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:27.153924 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-76bfab0e-bf88-4c2e-86c5-d126242be2f1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.163109 Apr 06 17:00:27.154498 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1444/2887] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:26 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:27.228366 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b2252e3b-9430-4d3f-8dd7-33efe7bcb79b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:27.228953 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b2252e3b-9430-4d3f-8dd7-33efe7bcb79b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:27.237964 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2252e3b-9430-4d3f-8dd7-33efe7bcb79b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:27.238624 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2252e3b-9430-4d3f-8dd7-33efe7bcb79b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:27.239569 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2252e3b-9430-4d3f-8dd7-33efe7bcb79b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:27.240098 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2252e3b-9430-4d3f-8dd7-33efe7bcb79b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:27.385728 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b2252e3b-9430-4d3f-8dd7-33efe7bcb79b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:27.400326 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b2252e3b-9430-4d3f-8dd7-33efe7bcb79b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:27.402842 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b2252e3b-9430-4d3f-8dd7-33efe7bcb79b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:27.404750 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b2252e3b-9430-4d3f-8dd7-33efe7bcb79b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.182006 Apr 06 17:00:27.405672 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1444/2888] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:27 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:28.132188 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-31b85011-c79c-489e-aeb9-792c79c80187 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:28.132861 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-31b85011-c79c-489e-aeb9-792c79c80187 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:28.139681 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31b85011-c79c-489e-aeb9-792c79c80187 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:28.140132 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31b85011-c79c-489e-aeb9-792c79c80187 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:28.140945 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31b85011-c79c-489e-aeb9-792c79c80187 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:28.141381 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-31b85011-c79c-489e-aeb9-792c79c80187 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:28.177079 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bbe7c094-3ec4-4f01-b725-b4946e8b23e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:28.177818 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bbe7c094-3ec4-4f01-b725-b4946e8b23e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:28.185012 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbe7c094-3ec4-4f01-b725-b4946e8b23e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:28.185479 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbe7c094-3ec4-4f01-b725-b4946e8b23e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:28.186259 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbe7c094-3ec4-4f01-b725-b4946e8b23e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:28.186672 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbe7c094-3ec4-4f01-b725-b4946e8b23e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:28.279192 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-31b85011-c79c-489e-aeb9-792c79c80187 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:28.287561 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-31b85011-c79c-489e-aeb9-792c79c80187 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.161928 Apr 06 17:00:28.288327 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1445/2889] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:28 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:28.321579 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-bbe7c094-3ec4-4f01-b725-b4946e8b23e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:28.329811 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bbe7c094-3ec4-4f01-b725-b4946e8b23e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.156653 Apr 06 17:00:28.330389 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1445/2890] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:28 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:28.429843 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d37c49ba-473c-4473-b54c-0c80ab5cd5ea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:28.430353 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d37c49ba-473c-4473-b54c-0c80ab5cd5ea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:28.437286 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d37c49ba-473c-4473-b54c-0c80ab5cd5ea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:28.437738 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d37c49ba-473c-4473-b54c-0c80ab5cd5ea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:28.438518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d37c49ba-473c-4473-b54c-0c80ab5cd5ea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:28.438948 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d37c49ba-473c-4473-b54c-0c80ab5cd5ea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:28.603567 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d37c49ba-473c-4473-b54c-0c80ab5cd5ea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:28.617682 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d37c49ba-473c-4473-b54c-0c80ab5cd5ea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:28.619589 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d37c49ba-473c-4473-b54c-0c80ab5cd5ea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:28.620762 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d37c49ba-473c-4473-b54c-0c80ab5cd5ea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.196837 Apr 06 17:00:28.621349 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1446/2891] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:28 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 06 17:00:29.307404 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-887c1b1d-8519-4c30-8b6a-cf82732889ba tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:29.307994 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-887c1b1d-8519-4c30-8b6a-cf82732889ba tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:29.315139 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-887c1b1d-8519-4c30-8b6a-cf82732889ba tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:29.315586 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-887c1b1d-8519-4c30-8b6a-cf82732889ba tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:29.316376 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-887c1b1d-8519-4c30-8b6a-cf82732889ba tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:29.316848 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-887c1b1d-8519-4c30-8b6a-cf82732889ba tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:29.352654 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-08f04c13-668d-4654-b836-0f756b1f5c7c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:29.353324 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-08f04c13-668d-4654-b836-0f756b1f5c7c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:29.362862 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08f04c13-668d-4654-b836-0f756b1f5c7c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:29.363457 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08f04c13-668d-4654-b836-0f756b1f5c7c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:29.364460 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08f04c13-668d-4654-b836-0f756b1f5c7c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:29.365182 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-08f04c13-668d-4654-b836-0f756b1f5c7c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:29.473425 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-887c1b1d-8519-4c30-8b6a-cf82732889ba tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:29.482015 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-887c1b1d-8519-4c30-8b6a-cf82732889ba tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.180171 Apr 06 17:00:29.482637 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1446/2892] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:29 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:29.511029 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-08f04c13-668d-4654-b836-0f756b1f5c7c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:29.518896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-08f04c13-668d-4654-b836-0f756b1f5c7c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.171266 Apr 06 17:00:29.519473 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1447/2893] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:29 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:29.639540 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d4c9b4a6-caf4-4612-acc7-67e694cda1e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:29.640153 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d4c9b4a6-caf4-4612-acc7-67e694cda1e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:29.646794 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4c9b4a6-caf4-4612-acc7-67e694cda1e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:29.647340 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4c9b4a6-caf4-4612-acc7-67e694cda1e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:29.648254 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4c9b4a6-caf4-4612-acc7-67e694cda1e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:29.648719 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4c9b4a6-caf4-4612-acc7-67e694cda1e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:29.808673 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d4c9b4a6-caf4-4612-acc7-67e694cda1e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:29.817303 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d4c9b4a6-caf4-4612-acc7-67e694cda1e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:29.818754 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d4c9b4a6-caf4-4612-acc7-67e694cda1e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:29.820124 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d4c9b4a6-caf4-4612-acc7-67e694cda1e9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.184641 Apr 06 17:00:29.820705 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1447/2894] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:29 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:30.503537 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-27dedeb2-dc9d-41bd-af19-00db33c0ee43 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:30.504469 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-27dedeb2-dc9d-41bd-af19-00db33c0ee43 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:30.512267 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27dedeb2-dc9d-41bd-af19-00db33c0ee43 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:30.512730 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27dedeb2-dc9d-41bd-af19-00db33c0ee43 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:30.513484 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27dedeb2-dc9d-41bd-af19-00db33c0ee43 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:30.513908 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27dedeb2-dc9d-41bd-af19-00db33c0ee43 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:30.535630 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d499959f-acfc-4395-b8b8-c0f8395eedaf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:30.536220 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d499959f-acfc-4395-b8b8-c0f8395eedaf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:30.543561 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d499959f-acfc-4395-b8b8-c0f8395eedaf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:30.544084 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d499959f-acfc-4395-b8b8-c0f8395eedaf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:30.544879 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d499959f-acfc-4395-b8b8-c0f8395eedaf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:30.545315 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d499959f-acfc-4395-b8b8-c0f8395eedaf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:30.656558 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-27dedeb2-dc9d-41bd-af19-00db33c0ee43 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:30.664636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-27dedeb2-dc9d-41bd-af19-00db33c0ee43 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.167628 Apr 06 17:00:30.665253 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1448/2895] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:30 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:30.686452 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d499959f-acfc-4395-b8b8-c0f8395eedaf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:30.694545 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d499959f-acfc-4395-b8b8-c0f8395eedaf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.162702 Apr 06 17:00:30.695023 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1448/2896] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:30 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:30.842874 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-62c1cc4a-0094-4f93-b6b3-735471cc5be4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:30.843914 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-62c1cc4a-0094-4f93-b6b3-735471cc5be4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:30.854201 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62c1cc4a-0094-4f93-b6b3-735471cc5be4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:30.854829 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62c1cc4a-0094-4f93-b6b3-735471cc5be4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:30.856511 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62c1cc4a-0094-4f93-b6b3-735471cc5be4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:30.857287 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-62c1cc4a-0094-4f93-b6b3-735471cc5be4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:30.994626 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-62c1cc4a-0094-4f93-b6b3-735471cc5be4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:31.002880 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-62c1cc4a-0094-4f93-b6b3-735471cc5be4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:31.004353 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-62c1cc4a-0094-4f93-b6b3-735471cc5be4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:31.005530 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-62c1cc4a-0094-4f93-b6b3-735471cc5be4 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.169218 Apr 06 17:00:31.006081 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1449/2897] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:30 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:31.683755 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c5f37c2f-6908-428c-ad0e-adc81ae8819a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:31.684403 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c5f37c2f-6908-428c-ad0e-adc81ae8819a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:31.693166 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5f37c2f-6908-428c-ad0e-adc81ae8819a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:31.693897 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5f37c2f-6908-428c-ad0e-adc81ae8819a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:31.695112 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5f37c2f-6908-428c-ad0e-adc81ae8819a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:31.695703 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5f37c2f-6908-428c-ad0e-adc81ae8819a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:31.713213 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7a72707e-2e5b-4795-9614-da144bb487b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:31.713805 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7a72707e-2e5b-4795-9614-da144bb487b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:31.720456 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a72707e-2e5b-4795-9614-da144bb487b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:31.720945 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a72707e-2e5b-4795-9614-da144bb487b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:31.721715 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a72707e-2e5b-4795-9614-da144bb487b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:31.722145 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a72707e-2e5b-4795-9614-da144bb487b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:31.835784 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c5f37c2f-6908-428c-ad0e-adc81ae8819a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:31.843840 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c5f37c2f-6908-428c-ad0e-adc81ae8819a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.164771 Apr 06 17:00:31.844446 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1449/2898] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:31 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:31.860308 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7a72707e-2e5b-4795-9614-da144bb487b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:31.868281 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7a72707e-2e5b-4795-9614-da144bb487b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.159776 Apr 06 17:00:31.868852 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1450/2899] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:31 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:32.025590 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-becbd98c-5d67-41ce-83c4-d89ed82651aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:32.026110 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-becbd98c-5d67-41ce-83c4-d89ed82651aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:32.032657 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-becbd98c-5d67-41ce-83c4-d89ed82651aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:32.033143 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-becbd98c-5d67-41ce-83c4-d89ed82651aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:32.033907 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-becbd98c-5d67-41ce-83c4-d89ed82651aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:32.034336 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-becbd98c-5d67-41ce-83c4-d89ed82651aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:32.175437 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-becbd98c-5d67-41ce-83c4-d89ed82651aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:32.185627 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-becbd98c-5d67-41ce-83c4-d89ed82651aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:32.187129 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-becbd98c-5d67-41ce-83c4-d89ed82651aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:32.188289 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-becbd98c-5d67-41ce-83c4-d89ed82651aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.167288 Apr 06 17:00:32.188880 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1450/2900] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:32 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:32.865334 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1f49d634-24c0-436e-b6a1-c26efd7ec463 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:32.866224 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1f49d634-24c0-436e-b6a1-c26efd7ec463 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:32.873405 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f49d634-24c0-436e-b6a1-c26efd7ec463 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:32.873861 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f49d634-24c0-436e-b6a1-c26efd7ec463 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:32.874632 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f49d634-24c0-436e-b6a1-c26efd7ec463 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:32.875069 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1f49d634-24c0-436e-b6a1-c26efd7ec463 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:32.886091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-43a8e81b-a308-4fc6-a2da-3f22183efed3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:32.886664 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-43a8e81b-a308-4fc6-a2da-3f22183efed3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:32.893468 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43a8e81b-a308-4fc6-a2da-3f22183efed3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:32.893917 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43a8e81b-a308-4fc6-a2da-3f22183efed3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:32.894692 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43a8e81b-a308-4fc6-a2da-3f22183efed3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:32.895122 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43a8e81b-a308-4fc6-a2da-3f22183efed3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:33.010915 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1f49d634-24c0-436e-b6a1-c26efd7ec463 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:33.018936 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1f49d634-24c0-436e-b6a1-c26efd7ec463 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.159722 Apr 06 17:00:33.019523 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1451/2901] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:32 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:33.036002 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-43a8e81b-a308-4fc6-a2da-3f22183efed3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:33.044299 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-43a8e81b-a308-4fc6-a2da-3f22183efed3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.162576 Apr 06 17:00:33.044876 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1451/2902] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:32 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:33.211088 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2ddc1117-e4e9-4158-bd51-b95897153362 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:33.211613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2ddc1117-e4e9-4158-bd51-b95897153362 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:33.218339 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ddc1117-e4e9-4158-bd51-b95897153362 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:33.218783 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ddc1117-e4e9-4158-bd51-b95897153362 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:33.219552 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ddc1117-e4e9-4158-bd51-b95897153362 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:33.219985 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2ddc1117-e4e9-4158-bd51-b95897153362 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:33.363507 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2ddc1117-e4e9-4158-bd51-b95897153362 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:33.377168 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2ddc1117-e4e9-4158-bd51-b95897153362 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:33.379609 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2ddc1117-e4e9-4158-bd51-b95897153362 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:33.381524 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2ddc1117-e4e9-4158-bd51-b95897153362 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.176685 Apr 06 17:00:33.382488 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1452/2903] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:33 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:34.040085 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9b0d54be-1491-4466-a0a0-ce2b0b1e131c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:34.040712 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9b0d54be-1491-4466-a0a0-ce2b0b1e131c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:34.047608 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b0d54be-1491-4466-a0a0-ce2b0b1e131c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:34.048061 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b0d54be-1491-4466-a0a0-ce2b0b1e131c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:34.048863 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b0d54be-1491-4466-a0a0-ce2b0b1e131c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:34.049287 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b0d54be-1491-4466-a0a0-ce2b0b1e131c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:34.061983 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f300b32f-a471-4c6c-93de-23479ebd5183 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:34.062574 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f300b32f-a471-4c6c-93de-23479ebd5183 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:34.069782 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f300b32f-a471-4c6c-93de-23479ebd5183 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:34.070253 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f300b32f-a471-4c6c-93de-23479ebd5183 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:34.071241 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f300b32f-a471-4c6c-93de-23479ebd5183 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:34.071682 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f300b32f-a471-4c6c-93de-23479ebd5183 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:34.186985 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9b0d54be-1491-4466-a0a0-ce2b0b1e131c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:34.195110 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9b0d54be-1491-4466-a0a0-ce2b0b1e131c tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.160681 Apr 06 17:00:34.195737 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1452/2904] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:34 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:34.214368 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f300b32f-a471-4c6c-93de-23479ebd5183 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:34.222293 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f300b32f-a471-4c6c-93de-23479ebd5183 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.164280 Apr 06 17:00:34.222858 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1453/2905] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:34 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:34.401391 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b87dc702-fc1f-4b9c-949a-d0c5b670c95f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:34.402035 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b87dc702-fc1f-4b9c-949a-d0c5b670c95f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:34.408875 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b87dc702-fc1f-4b9c-949a-d0c5b670c95f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:34.409335 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b87dc702-fc1f-4b9c-949a-d0c5b670c95f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:34.410102 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b87dc702-fc1f-4b9c-949a-d0c5b670c95f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:34.410539 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b87dc702-fc1f-4b9c-949a-d0c5b670c95f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:34.546810 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b87dc702-fc1f-4b9c-949a-d0c5b670c95f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:34.555262 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b87dc702-fc1f-4b9c-949a-d0c5b670c95f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:34.556789 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b87dc702-fc1f-4b9c-949a-d0c5b670c95f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:34.557955 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b87dc702-fc1f-4b9c-949a-d0c5b670c95f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.161631 Apr 06 17:00:34.558509 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1453/2906] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:34 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:35.214212 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0d419b6d-5d1e-4c7b-bac2-ff49e0dc0312 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:35.214890 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0d419b6d-5d1e-4c7b-bac2-ff49e0dc0312 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:35.221899 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d419b6d-5d1e-4c7b-bac2-ff49e0dc0312 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:35.222346 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d419b6d-5d1e-4c7b-bac2-ff49e0dc0312 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:35.223101 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d419b6d-5d1e-4c7b-bac2-ff49e0dc0312 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:35.223529 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0d419b6d-5d1e-4c7b-bac2-ff49e0dc0312 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:35.239743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8c3088cf-5629-4b92-a2af-21c461b8a541 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:35.240359 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8c3088cf-5629-4b92-a2af-21c461b8a541 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:35.247300 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c3088cf-5629-4b92-a2af-21c461b8a541 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:35.247761 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c3088cf-5629-4b92-a2af-21c461b8a541 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:35.248539 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c3088cf-5629-4b92-a2af-21c461b8a541 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:35.249005 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c3088cf-5629-4b92-a2af-21c461b8a541 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:35.358053 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0d419b6d-5d1e-4c7b-bac2-ff49e0dc0312 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:35.366179 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0d419b6d-5d1e-4c7b-bac2-ff49e0dc0312 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.157288 Apr 06 17:00:35.366761 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1454/2907] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:35 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:35.384945 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8c3088cf-5629-4b92-a2af-21c461b8a541 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:35.392967 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8c3088cf-5629-4b92-a2af-21c461b8a541 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.157248 Apr 06 17:00:35.393531 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1454/2908] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:35 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:35.580280 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-29e1a987-e2bf-4a41-99de-dc7ef3284f27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:35.581174 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-29e1a987-e2bf-4a41-99de-dc7ef3284f27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:35.591778 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29e1a987-e2bf-4a41-99de-dc7ef3284f27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:35.592510 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29e1a987-e2bf-4a41-99de-dc7ef3284f27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:35.593786 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29e1a987-e2bf-4a41-99de-dc7ef3284f27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:35.594491 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-29e1a987-e2bf-4a41-99de-dc7ef3284f27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:35.740472 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-29e1a987-e2bf-4a41-99de-dc7ef3284f27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:35.750287 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-29e1a987-e2bf-4a41-99de-dc7ef3284f27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:35.751779 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-29e1a987-e2bf-4a41-99de-dc7ef3284f27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:35.752999 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-29e1a987-e2bf-4a41-99de-dc7ef3284f27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.179831 Apr 06 17:00:35.753564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1455/2909] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:35 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:36.383910 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-501f02da-c193-4fb0-ab4c-71564a1609a4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:36.384490 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-501f02da-c193-4fb0-ab4c-71564a1609a4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:36.391330 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-501f02da-c193-4fb0-ab4c-71564a1609a4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:36.391772 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-501f02da-c193-4fb0-ab4c-71564a1609a4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:36.392526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-501f02da-c193-4fb0-ab4c-71564a1609a4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:36.392984 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-501f02da-c193-4fb0-ab4c-71564a1609a4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:36.410707 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-18a063af-076d-44c7-abc4-ef5d9992fc03 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:36.411391 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-18a063af-076d-44c7-abc4-ef5d9992fc03 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:36.418414 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18a063af-076d-44c7-abc4-ef5d9992fc03 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:36.418798 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18a063af-076d-44c7-abc4-ef5d9992fc03 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:36.419566 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18a063af-076d-44c7-abc4-ef5d9992fc03 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:36.420005 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-18a063af-076d-44c7-abc4-ef5d9992fc03 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:36.531502 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-501f02da-c193-4fb0-ab4c-71564a1609a4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:36.539674 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-501f02da-c193-4fb0-ab4c-71564a1609a4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.159772 Apr 06 17:00:36.540482 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1455/2910] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:36 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:36.557196 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-18a063af-076d-44c7-abc4-ef5d9992fc03 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:36.564943 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-18a063af-076d-44c7-abc4-ef5d9992fc03 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.158188 Apr 06 17:00:36.565515 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1456/2911] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:36 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:36.775909 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-90f9ebda-b246-4e71-b448-36c3320e8ed6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:36.776597 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-90f9ebda-b246-4e71-b448-36c3320e8ed6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:36.784476 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90f9ebda-b246-4e71-b448-36c3320e8ed6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:36.785082 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90f9ebda-b246-4e71-b448-36c3320e8ed6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:36.786051 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90f9ebda-b246-4e71-b448-36c3320e8ed6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:36.786591 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90f9ebda-b246-4e71-b448-36c3320e8ed6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:36.931343 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-90f9ebda-b246-4e71-b448-36c3320e8ed6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:36.940117 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-90f9ebda-b246-4e71-b448-36c3320e8ed6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:36.941637 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-90f9ebda-b246-4e71-b448-36c3320e8ed6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:36.942808 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-90f9ebda-b246-4e71-b448-36c3320e8ed6 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.173336 Apr 06 17:00:36.943367 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1456/2912] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:36 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:37.559978 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-86a181a1-ce90-4bb9-9fd8-0756ba40e20b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:37.560579 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-86a181a1-ce90-4bb9-9fd8-0756ba40e20b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:37.567494 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86a181a1-ce90-4bb9-9fd8-0756ba40e20b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:37.567944 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86a181a1-ce90-4bb9-9fd8-0756ba40e20b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:37.568722 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86a181a1-ce90-4bb9-9fd8-0756ba40e20b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:37.569174 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-86a181a1-ce90-4bb9-9fd8-0756ba40e20b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:37.582857 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-de61ef23-3ecc-4104-a596-e1ba58bf29cc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:37.583530 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-de61ef23-3ecc-4104-a596-e1ba58bf29cc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:37.590274 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de61ef23-3ecc-4104-a596-e1ba58bf29cc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:37.590752 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de61ef23-3ecc-4104-a596-e1ba58bf29cc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:37.591524 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de61ef23-3ecc-4104-a596-e1ba58bf29cc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:37.591948 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de61ef23-3ecc-4104-a596-e1ba58bf29cc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:37.719189 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-86a181a1-ce90-4bb9-9fd8-0756ba40e20b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:37.727066 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-86a181a1-ce90-4bb9-9fd8-0756ba40e20b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.171880 Apr 06 17:00:37.727607 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1457/2913] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:37 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:37.770777 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-de61ef23-3ecc-4104-a596-e1ba58bf29cc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:37.778915 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-de61ef23-3ecc-4104-a596-e1ba58bf29cc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.199978 Apr 06 17:00:37.779490 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1457/2914] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:37 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:37.962099 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6d0909af-c54b-4947-907e-0178f91d1200 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:37.962839 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6d0909af-c54b-4947-907e-0178f91d1200 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:37.969381 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d0909af-c54b-4947-907e-0178f91d1200 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:37.969830 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d0909af-c54b-4947-907e-0178f91d1200 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:37.970602 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d0909af-c54b-4947-907e-0178f91d1200 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:37.971034 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6d0909af-c54b-4947-907e-0178f91d1200 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:38.110453 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6d0909af-c54b-4947-907e-0178f91d1200 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:38.119032 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6d0909af-c54b-4947-907e-0178f91d1200 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:38.120945 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6d0909af-c54b-4947-907e-0178f91d1200 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:38.122181 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6d0909af-c54b-4947-907e-0178f91d1200 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.164120 Apr 06 17:00:38.123038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1458/2915] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:37 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:38.749534 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-460a5853-9661-4506-9394-4946910fe779 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:38.750444 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-460a5853-9661-4506-9394-4946910fe779 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:38.760816 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-460a5853-9661-4506-9394-4946910fe779 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:38.761265 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-460a5853-9661-4506-9394-4946910fe779 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:38.762023 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-460a5853-9661-4506-9394-4946910fe779 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:38.762449 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-460a5853-9661-4506-9394-4946910fe779 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:38.796346 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e8e8e762-089d-4214-8384-3d8aa66145ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:38.796997 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e8e8e762-089d-4214-8384-3d8aa66145ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:38.803922 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8e8e762-089d-4214-8384-3d8aa66145ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:38.804444 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8e8e762-089d-4214-8384-3d8aa66145ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:38.805315 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8e8e762-089d-4214-8384-3d8aa66145ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:38.805818 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8e8e762-089d-4214-8384-3d8aa66145ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:38.903786 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-460a5853-9661-4506-9394-4946910fe779 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:38.912034 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-460a5853-9661-4506-9394-4946910fe779 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.169195 Apr 06 17:00:38.912729 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1458/2916] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:38 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:38.941572 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e8e8e762-089d-4214-8384-3d8aa66145ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:38.949695 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e8e8e762-089d-4214-8384-3d8aa66145ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.157301 Apr 06 17:00:38.950261 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1459/2917] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:38 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:39.141721 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5d50b528-4e6b-4a5b-ba07-adc7373aa0aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:39.142371 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5d50b528-4e6b-4a5b-ba07-adc7373aa0aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:39.149416 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d50b528-4e6b-4a5b-ba07-adc7373aa0aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:39.150045 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d50b528-4e6b-4a5b-ba07-adc7373aa0aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:39.150926 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d50b528-4e6b-4a5b-ba07-adc7373aa0aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:39.151365 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d50b528-4e6b-4a5b-ba07-adc7373aa0aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:39.296211 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5d50b528-4e6b-4a5b-ba07-adc7373aa0aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:39.304907 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5d50b528-4e6b-4a5b-ba07-adc7373aa0aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:39.306590 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5d50b528-4e6b-4a5b-ba07-adc7373aa0aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:39.307932 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5d50b528-4e6b-4a5b-ba07-adc7373aa0aa tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.170527 Apr 06 17:00:39.308495 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1459/2918] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:39 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:39.933369 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-185b5703-9177-45ac-87d2-3f02c258e59f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:39.933976 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-185b5703-9177-45ac-87d2-3f02c258e59f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:39.940565 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-185b5703-9177-45ac-87d2-3f02c258e59f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:39.941048 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-185b5703-9177-45ac-87d2-3f02c258e59f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:39.941818 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-185b5703-9177-45ac-87d2-3f02c258e59f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:39.942248 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-185b5703-9177-45ac-87d2-3f02c258e59f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:39.967340 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2ecb2845-ee67-4eba-835a-4344a47d08a2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:39.967946 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2ecb2845-ee67-4eba-835a-4344a47d08a2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:39.974562 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ecb2845-ee67-4eba-835a-4344a47d08a2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:39.975009 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ecb2845-ee67-4eba-835a-4344a47d08a2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:39.975764 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ecb2845-ee67-4eba-835a-4344a47d08a2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:39.976190 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ecb2845-ee67-4eba-835a-4344a47d08a2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:40.085478 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-185b5703-9177-45ac-87d2-3f02c258e59f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:40.093752 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-185b5703-9177-45ac-87d2-3f02c258e59f tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.166147 Apr 06 17:00:40.094332 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1460/2919] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:39 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:40.123988 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2ecb2845-ee67-4eba-835a-4344a47d08a2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:40.131895 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2ecb2845-ee67-4eba-835a-4344a47d08a2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.168473 Apr 06 17:00:40.132471 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1460/2920] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:39 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:00:40.327607 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-049aba70-bd3c-4eef-a1d7-ce66f937efb7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:40.328119 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-049aba70-bd3c-4eef-a1d7-ce66f937efb7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:40.334806 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-049aba70-bd3c-4eef-a1d7-ce66f937efb7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:40.335258 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-049aba70-bd3c-4eef-a1d7-ce66f937efb7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:40.336026 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-049aba70-bd3c-4eef-a1d7-ce66f937efb7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:40.336458 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-049aba70-bd3c-4eef-a1d7-ce66f937efb7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:40.474628 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-049aba70-bd3c-4eef-a1d7-ce66f937efb7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:40.489915 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-049aba70-bd3c-4eef-a1d7-ce66f937efb7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:40.493805 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-049aba70-bd3c-4eef-a1d7-ce66f937efb7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:40.494971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-049aba70-bd3c-4eef-a1d7-ce66f937efb7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.171486 Apr 06 17:00:40.495536 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1461/2921] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:40 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:41.115480 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e31a02b7-7cf7-424e-adf1-cc39720e5dd9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:41.116529 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e31a02b7-7cf7-424e-adf1-cc39720e5dd9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:41.124198 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e31a02b7-7cf7-424e-adf1-cc39720e5dd9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:41.124722 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e31a02b7-7cf7-424e-adf1-cc39720e5dd9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:41.125521 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e31a02b7-7cf7-424e-adf1-cc39720e5dd9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:41.126026 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e31a02b7-7cf7-424e-adf1-cc39720e5dd9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:41.148991 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a00d235d-3eb7-463e-9908-240bcd6c0748 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:41.149663 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a00d235d-3eb7-463e-9908-240bcd6c0748 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:41.156245 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a00d235d-3eb7-463e-9908-240bcd6c0748 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:41.156707 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a00d235d-3eb7-463e-9908-240bcd6c0748 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:41.157510 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a00d235d-3eb7-463e-9908-240bcd6c0748 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:41.157950 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a00d235d-3eb7-463e-9908-240bcd6c0748 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:41.264578 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e31a02b7-7cf7-424e-adf1-cc39720e5dd9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:41.273343 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e31a02b7-7cf7-424e-adf1-cc39720e5dd9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.164427 Apr 06 17:00:41.273931 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1461/2922] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:41 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:41.308007 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a00d235d-3eb7-463e-9908-240bcd6c0748 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:41.316607 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a00d235d-3eb7-463e-9908-240bcd6c0748 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.171737 Apr 06 17:00:41.317215 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1462/2923] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:41 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:41.517827 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e3e4025b-8c2a-4840-b8c9-db141e5dd08c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:41.518694 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e3e4025b-8c2a-4840-b8c9-db141e5dd08c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:41.529210 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3e4025b-8c2a-4840-b8c9-db141e5dd08c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:41.529951 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3e4025b-8c2a-4840-b8c9-db141e5dd08c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:41.531192 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3e4025b-8c2a-4840-b8c9-db141e5dd08c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:41.531943 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3e4025b-8c2a-4840-b8c9-db141e5dd08c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:41.670757 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e3e4025b-8c2a-4840-b8c9-db141e5dd08c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:41.679178 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e3e4025b-8c2a-4840-b8c9-db141e5dd08c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:41.680657 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e3e4025b-8c2a-4840-b8c9-db141e5dd08c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:41.682196 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e3e4025b-8c2a-4840-b8c9-db141e5dd08c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.171118 Apr 06 17:00:41.682773 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1462/2924] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:41 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:42.294249 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-97e30e42-4155-41b6-880f-5b6d8a668f62 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:42.294941 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-97e30e42-4155-41b6-880f-5b6d8a668f62 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:42.302705 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97e30e42-4155-41b6-880f-5b6d8a668f62 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:42.303230 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97e30e42-4155-41b6-880f-5b6d8a668f62 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:42.304116 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97e30e42-4155-41b6-880f-5b6d8a668f62 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:42.304629 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97e30e42-4155-41b6-880f-5b6d8a668f62 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:42.334367 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9c720c73-fcb7-4d70-96a6-4d180de5cd86 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:42.334984 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9c720c73-fcb7-4d70-96a6-4d180de5cd86 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:42.342219 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c720c73-fcb7-4d70-96a6-4d180de5cd86 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:42.342692 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c720c73-fcb7-4d70-96a6-4d180de5cd86 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:42.343471 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c720c73-fcb7-4d70-96a6-4d180de5cd86 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:42.343904 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c720c73-fcb7-4d70-96a6-4d180de5cd86 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:42.442985 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-97e30e42-4155-41b6-880f-5b6d8a668f62 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:42.451491 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-97e30e42-4155-41b6-880f-5b6d8a668f62 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.162974 Apr 06 17:00:42.452041 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1463/2925] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:42 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:42.482129 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9c720c73-fcb7-4d70-96a6-4d180de5cd86 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:42.490589 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9c720c73-fcb7-4d70-96a6-4d180de5cd86 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.160242 Apr 06 17:00:42.491166 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1463/2926] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:42 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:42.701949 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-911a5cad-b3f6-401b-a1b0-ffb682ae92b1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:42.702662 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-911a5cad-b3f6-401b-a1b0-ffb682ae92b1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:42.710212 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-911a5cad-b3f6-401b-a1b0-ffb682ae92b1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:42.710745 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-911a5cad-b3f6-401b-a1b0-ffb682ae92b1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:42.711647 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-911a5cad-b3f6-401b-a1b0-ffb682ae92b1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:42.712163 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-911a5cad-b3f6-401b-a1b0-ffb682ae92b1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:42.850738 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-911a5cad-b3f6-401b-a1b0-ffb682ae92b1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:42.859948 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-911a5cad-b3f6-401b-a1b0-ffb682ae92b1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:42.861472 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-911a5cad-b3f6-401b-a1b0-ffb682ae92b1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:42.862636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-911a5cad-b3f6-401b-a1b0-ffb682ae92b1 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.165407 Apr 06 17:00:42.863228 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1464/2927] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:42 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:43.473454 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-92516b5d-01b4-433b-8f64-d8542805ab5b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:43.474495 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-92516b5d-01b4-433b-8f64-d8542805ab5b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:43.485732 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92516b5d-01b4-433b-8f64-d8542805ab5b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:43.486485 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92516b5d-01b4-433b-8f64-d8542805ab5b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:43.487755 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92516b5d-01b4-433b-8f64-d8542805ab5b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:43.488474 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92516b5d-01b4-433b-8f64-d8542805ab5b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:43.507641 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-24dc5143-006a-490c-8fc6-18a5362eac12 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:43.508232 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-24dc5143-006a-490c-8fc6-18a5362eac12 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:43.515045 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24dc5143-006a-490c-8fc6-18a5362eac12 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:43.515495 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24dc5143-006a-490c-8fc6-18a5362eac12 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:43.516262 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24dc5143-006a-490c-8fc6-18a5362eac12 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:43.516714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24dc5143-006a-490c-8fc6-18a5362eac12 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:43.626303 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-92516b5d-01b4-433b-8f64-d8542805ab5b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:43.634301 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-92516b5d-01b4-433b-8f64-d8542805ab5b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.167505 Apr 06 17:00:43.635012 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1464/2928] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:43 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:43.654239 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-24dc5143-006a-490c-8fc6-18a5362eac12 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:43.662287 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-24dc5143-006a-490c-8fc6-18a5362eac12 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.158619 Apr 06 17:00:43.662853 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1465/2929] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:43 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:43.884374 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-20096555-78b2-472d-88a9-ad4d38db9fb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:43.885033 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-20096555-78b2-472d-88a9-ad4d38db9fb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:43.891533 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20096555-78b2-472d-88a9-ad4d38db9fb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:43.891976 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20096555-78b2-472d-88a9-ad4d38db9fb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:43.892734 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20096555-78b2-472d-88a9-ad4d38db9fb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:43.893218 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20096555-78b2-472d-88a9-ad4d38db9fb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:44.046429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-20096555-78b2-472d-88a9-ad4d38db9fb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:44.061070 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-20096555-78b2-472d-88a9-ad4d38db9fb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:44.063505 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-20096555-78b2-472d-88a9-ad4d38db9fb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:44.065399 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-20096555-78b2-472d-88a9-ad4d38db9fb0 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.186151 Apr 06 17:00:44.066213 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1465/2930] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:43 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:44.655974 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7a099b19-fa34-47d1-9d94-93bbd85d1dac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:44.657081 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7a099b19-fa34-47d1-9d94-93bbd85d1dac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:44.667061 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a099b19-fa34-47d1-9d94-93bbd85d1dac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:44.667539 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a099b19-fa34-47d1-9d94-93bbd85d1dac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:44.668303 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a099b19-fa34-47d1-9d94-93bbd85d1dac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:44.668771 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a099b19-fa34-47d1-9d94-93bbd85d1dac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:44.679490 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3feeb0d5-f8f6-4dbf-ba28-24b5c91aa095 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:44.680108 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3feeb0d5-f8f6-4dbf-ba28-24b5c91aa095 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:44.686919 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3feeb0d5-f8f6-4dbf-ba28-24b5c91aa095 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:44.687382 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3feeb0d5-f8f6-4dbf-ba28-24b5c91aa095 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:44.688158 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3feeb0d5-f8f6-4dbf-ba28-24b5c91aa095 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:44.688598 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3feeb0d5-f8f6-4dbf-ba28-24b5c91aa095 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:44.804891 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7a099b19-fa34-47d1-9d94-93bbd85d1dac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:44.813034 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7a099b19-fa34-47d1-9d94-93bbd85d1dac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.163919 Apr 06 17:00:44.813680 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1466/2931] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:44 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:44.824127 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3feeb0d5-f8f6-4dbf-ba28-24b5c91aa095 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:44.832243 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3feeb0d5-f8f6-4dbf-ba28-24b5c91aa095 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.156660 Apr 06 17:00:44.832817 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1466/2932] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:44 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:45.085817 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a14ee177-c12a-4eab-81d1-8596d38410de tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:45.086418 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a14ee177-c12a-4eab-81d1-8596d38410de tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:45.093191 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a14ee177-c12a-4eab-81d1-8596d38410de tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:45.093642 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a14ee177-c12a-4eab-81d1-8596d38410de tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:45.094410 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a14ee177-c12a-4eab-81d1-8596d38410de tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:45.094841 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a14ee177-c12a-4eab-81d1-8596d38410de tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:45.248714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a14ee177-c12a-4eab-81d1-8596d38410de tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:45.257897 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a14ee177-c12a-4eab-81d1-8596d38410de tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:45.259496 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a14ee177-c12a-4eab-81d1-8596d38410de tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:45.260716 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a14ee177-c12a-4eab-81d1-8596d38410de tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.178989 Apr 06 17:00:45.261266 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1467/2933] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:45 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:45.833329 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-89aa8384-019a-46a7-93c2-b8a3d7800894 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:45.834317 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-89aa8384-019a-46a7-93c2-b8a3d7800894 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:45.842202 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89aa8384-019a-46a7-93c2-b8a3d7800894 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:45.842648 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89aa8384-019a-46a7-93c2-b8a3d7800894 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:45.843419 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89aa8384-019a-46a7-93c2-b8a3d7800894 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:45.843853 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89aa8384-019a-46a7-93c2-b8a3d7800894 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:45.852062 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a47d1666-c330-48b1-b34b-fc7ba0defb13 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:45.852945 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a47d1666-c330-48b1-b34b-fc7ba0defb13 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:45.860122 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a47d1666-c330-48b1-b34b-fc7ba0defb13 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:45.860575 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a47d1666-c330-48b1-b34b-fc7ba0defb13 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:45.861376 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a47d1666-c330-48b1-b34b-fc7ba0defb13 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:45.861809 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a47d1666-c330-48b1-b34b-fc7ba0defb13 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:45.980038 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-89aa8384-019a-46a7-93c2-b8a3d7800894 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:45.988520 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-89aa8384-019a-46a7-93c2-b8a3d7800894 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.161697 Apr 06 17:00:45.989115 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1467/2934] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:45 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:45.994390 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a47d1666-c330-48b1-b34b-fc7ba0defb13 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:46.002498 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a47d1666-c330-48b1-b34b-fc7ba0defb13 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.154958 Apr 06 17:00:46.003068 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1468/2935] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:45 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:46.287783 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2a7f9694-1b5b-4eed-be4a-233096cd0a59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:46.288814 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2a7f9694-1b5b-4eed-be4a-233096cd0a59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:46.295949 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a7f9694-1b5b-4eed-be4a-233096cd0a59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:46.296395 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a7f9694-1b5b-4eed-be4a-233096cd0a59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:46.297183 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a7f9694-1b5b-4eed-be4a-233096cd0a59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:46.297616 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a7f9694-1b5b-4eed-be4a-233096cd0a59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:46.435965 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2a7f9694-1b5b-4eed-be4a-233096cd0a59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:46.448748 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2a7f9694-1b5b-4eed-be4a-233096cd0a59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:46.451042 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2a7f9694-1b5b-4eed-be4a-233096cd0a59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:46.452875 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2a7f9694-1b5b-4eed-be4a-233096cd0a59 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.171372 Apr 06 17:00:46.453700 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1468/2936] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:46 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:47.006720 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c8d4bfea-6c06-4ad6-876f-f268d5c9841a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:47.007314 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c8d4bfea-6c06-4ad6-876f-f268d5c9841a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:47.015412 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8d4bfea-6c06-4ad6-876f-f268d5c9841a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:47.016064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8d4bfea-6c06-4ad6-876f-f268d5c9841a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:47.017460 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8d4bfea-6c06-4ad6-876f-f268d5c9841a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:47.017902 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c8d4bfea-6c06-4ad6-876f-f268d5c9841a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:47.020094 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6505b1e4-5b6e-408a-9cef-659c76e1d59d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:47.020980 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6505b1e4-5b6e-408a-9cef-659c76e1d59d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:47.028206 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6505b1e4-5b6e-408a-9cef-659c76e1d59d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:47.028650 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6505b1e4-5b6e-408a-9cef-659c76e1d59d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:47.029453 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6505b1e4-5b6e-408a-9cef-659c76e1d59d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:47.029884 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6505b1e4-5b6e-408a-9cef-659c76e1d59d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:47.156383 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c8d4bfea-6c06-4ad6-876f-f268d5c9841a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:47.162697 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6505b1e4-5b6e-408a-9cef-659c76e1d59d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:47.164634 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c8d4bfea-6c06-4ad6-876f-f268d5c9841a tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.162063 Apr 06 17:00:47.165302 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1469/2937] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:47 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:47.171059 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6505b1e4-5b6e-408a-9cef-659c76e1d59d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.155081 Apr 06 17:00:47.171624 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1469/2938] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:47 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:47.478841 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3d0e4ffe-4634-46df-a00c-eefaffca4665 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:47.479514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3d0e4ffe-4634-46df-a00c-eefaffca4665 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:47.487127 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d0e4ffe-4634-46df-a00c-eefaffca4665 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:47.487632 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d0e4ffe-4634-46df-a00c-eefaffca4665 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:47.488484 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d0e4ffe-4634-46df-a00c-eefaffca4665 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:47.489005 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d0e4ffe-4634-46df-a00c-eefaffca4665 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:47.630131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3d0e4ffe-4634-46df-a00c-eefaffca4665 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:47.638802 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3d0e4ffe-4634-46df-a00c-eefaffca4665 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:47.640302 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3d0e4ffe-4634-46df-a00c-eefaffca4665 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:47.641539 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3d0e4ffe-4634-46df-a00c-eefaffca4665 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.169078 Apr 06 17:00:47.642078 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1470/2939] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:47 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:48.186514 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5f43687a-22cc-4acb-b126-fbeab9ccdeb5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:48.187458 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5f43687a-22cc-4acb-b126-fbeab9ccdeb5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:48.192880 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9f9dd9a7-a00d-457d-9387-34178acd95a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:48.193684 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9f9dd9a7-a00d-457d-9387-34178acd95a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:48.197216 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f43687a-22cc-4acb-b126-fbeab9ccdeb5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:48.197837 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f43687a-22cc-4acb-b126-fbeab9ccdeb5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:48.198625 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f43687a-22cc-4acb-b126-fbeab9ccdeb5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:48.199060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f43687a-22cc-4acb-b126-fbeab9ccdeb5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:48.201141 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f9dd9a7-a00d-457d-9387-34178acd95a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:48.201802 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f9dd9a7-a00d-457d-9387-34178acd95a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:48.202576 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f9dd9a7-a00d-457d-9387-34178acd95a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:48.203019 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f9dd9a7-a00d-457d-9387-34178acd95a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:48.338774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9f9dd9a7-a00d-457d-9387-34178acd95a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:48.339952 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5f43687a-22cc-4acb-b126-fbeab9ccdeb5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:48.346766 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9f9dd9a7-a00d-457d-9387-34178acd95a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.161728 Apr 06 17:00:48.347341 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1471/2940] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:48 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:48.347804 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5f43687a-22cc-4acb-b126-fbeab9ccdeb5 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.168123 Apr 06 17:00:48.348365 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1470/2941] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:48 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:48.664754 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-53868888-bcb3-4f59-828b-8d3f1bd4c8eb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:48.665799 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-53868888-bcb3-4f59-828b-8d3f1bd4c8eb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:48.676317 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53868888-bcb3-4f59-828b-8d3f1bd4c8eb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:48.677129 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53868888-bcb3-4f59-828b-8d3f1bd4c8eb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:48.678394 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53868888-bcb3-4f59-828b-8d3f1bd4c8eb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:48.679118 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-53868888-bcb3-4f59-828b-8d3f1bd4c8eb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:48.833714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-53868888-bcb3-4f59-828b-8d3f1bd4c8eb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:48.843017 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-53868888-bcb3-4f59-828b-8d3f1bd4c8eb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:48.844523 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-53868888-bcb3-4f59-828b-8d3f1bd4c8eb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:48.845716 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-53868888-bcb3-4f59-828b-8d3f1bd4c8eb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.187650 Apr 06 17:00:48.846278 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1472/2942] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:48 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:49.367614 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5db7127a-cfb7-4969-921e-cda6a646a2e0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:49.368671 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5db7127a-cfb7-4969-921e-cda6a646a2e0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:49.369203 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e94b31e0-cf65-45b0-82a1-610068047311 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:49.369818 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e94b31e0-cf65-45b0-82a1-610068047311 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:49.375699 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5db7127a-cfb7-4969-921e-cda6a646a2e0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:49.376147 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5db7127a-cfb7-4969-921e-cda6a646a2e0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:49.376837 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e94b31e0-cf65-45b0-82a1-610068047311 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:49.377055 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5db7127a-cfb7-4969-921e-cda6a646a2e0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:49.377270 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e94b31e0-cf65-45b0-82a1-610068047311 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:49.377447 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5db7127a-cfb7-4969-921e-cda6a646a2e0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:49.378055 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e94b31e0-cf65-45b0-82a1-610068047311 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:49.378484 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e94b31e0-cf65-45b0-82a1-610068047311 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:49.517632 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e94b31e0-cf65-45b0-82a1-610068047311 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:49.517837 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5db7127a-cfb7-4969-921e-cda6a646a2e0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:49.526295 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e94b31e0-cf65-45b0-82a1-610068047311 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.163568 Apr 06 17:00:49.527109 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1473/2943] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:49 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:49.529787 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5db7127a-cfb7-4969-921e-cda6a646a2e0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.164923 Apr 06 17:00:49.532723 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1471/2944] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:49 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:49.864959 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ee1d942e-b835-4605-bbc0-5c827833926b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:49.865736 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ee1d942e-b835-4605-bbc0-5c827833926b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:49.872175 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee1d942e-b835-4605-bbc0-5c827833926b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:49.872618 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee1d942e-b835-4605-bbc0-5c827833926b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:49.873418 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee1d942e-b835-4605-bbc0-5c827833926b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:49.873853 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee1d942e-b835-4605-bbc0-5c827833926b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:50.024180 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ee1d942e-b835-4605-bbc0-5c827833926b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:50.032474 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ee1d942e-b835-4605-bbc0-5c827833926b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:50.033994 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ee1d942e-b835-4605-bbc0-5c827833926b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:50.035182 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ee1d942e-b835-4605-bbc0-5c827833926b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.174664 Apr 06 17:00:50.035745 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1474/2945] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:49 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:50.549530 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-96f8c61f-e98a-46f5-bc4a-24c8267a90a9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:50.550471 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-96f8c61f-e98a-46f5-bc4a-24c8267a90a9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:50.552558 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-22fe9c86-c891-44cd-9134-1c1a717a5b17 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:50.553606 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-22fe9c86-c891-44cd-9134-1c1a717a5b17 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:50.561105 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96f8c61f-e98a-46f5-bc4a-24c8267a90a9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:50.561863 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96f8c61f-e98a-46f5-bc4a-24c8267a90a9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:50.563136 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96f8c61f-e98a-46f5-bc4a-24c8267a90a9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:50.563862 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96f8c61f-e98a-46f5-bc4a-24c8267a90a9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:50.565008 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22fe9c86-c891-44cd-9134-1c1a717a5b17 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:50.565738 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22fe9c86-c891-44cd-9134-1c1a717a5b17 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:50.566990 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22fe9c86-c891-44cd-9134-1c1a717a5b17 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:50.567712 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22fe9c86-c891-44cd-9134-1c1a717a5b17 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:50.703099 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-22fe9c86-c891-44cd-9134-1c1a717a5b17 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:50.704763 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-96f8c61f-e98a-46f5-bc4a-24c8267a90a9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:50.711286 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-22fe9c86-c891-44cd-9134-1c1a717a5b17 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.165106 Apr 06 17:00:50.712015 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1475/2946] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:50 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:50.713387 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-96f8c61f-e98a-46f5-bc4a-24c8267a90a9 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.171420 Apr 06 17:00:50.713964 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1472/2947] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:50 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:51.058517 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6bdd8925-e2d4-4c0d-a2ec-cea4896d4e33 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:51.059238 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6bdd8925-e2d4-4c0d-a2ec-cea4896d4e33 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:51.067177 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bdd8925-e2d4-4c0d-a2ec-cea4896d4e33 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:51.067714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bdd8925-e2d4-4c0d-a2ec-cea4896d4e33 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:51.068615 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bdd8925-e2d4-4c0d-a2ec-cea4896d4e33 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:51.069249 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bdd8925-e2d4-4c0d-a2ec-cea4896d4e33 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:51.227428 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6bdd8925-e2d4-4c0d-a2ec-cea4896d4e33 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:51.239599 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6bdd8925-e2d4-4c0d-a2ec-cea4896d4e33 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:51.241775 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6bdd8925-e2d4-4c0d-a2ec-cea4896d4e33 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:51.243392 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6bdd8925-e2d4-4c0d-a2ec-cea4896d4e33 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.190806 Apr 06 17:00:51.245858 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1476/2948] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:51 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:51.733993 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-80786476-9bc2-4b3e-8f4e-9cbca46bd9ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:51.734975 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-80786476-9bc2-4b3e-8f4e-9cbca46bd9ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:51.735185 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8d45e6d2-e61e-44c5-ba4a-44b45aadda9d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:51.736090 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8d45e6d2-e61e-44c5-ba4a-44b45aadda9d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:51.745550 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80786476-9bc2-4b3e-8f4e-9cbca46bd9ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:51.745765 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d45e6d2-e61e-44c5-ba4a-44b45aadda9d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:51.745994 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80786476-9bc2-4b3e-8f4e-9cbca46bd9ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:51.746161 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d45e6d2-e61e-44c5-ba4a-44b45aadda9d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:51.746761 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80786476-9bc2-4b3e-8f4e-9cbca46bd9ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:51.746917 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d45e6d2-e61e-44c5-ba4a-44b45aadda9d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:51.747224 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80786476-9bc2-4b3e-8f4e-9cbca46bd9ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:51.747414 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8d45e6d2-e61e-44c5-ba4a-44b45aadda9d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:51.879918 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-80786476-9bc2-4b3e-8f4e-9cbca46bd9ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:51.882234 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8d45e6d2-e61e-44c5-ba4a-44b45aadda9d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:51.888879 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-80786476-9bc2-4b3e-8f4e-9cbca46bd9ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.162301 Apr 06 17:00:51.889467 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1473/2949] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:51 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:51.890798 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8d45e6d2-e61e-44c5-ba4a-44b45aadda9d tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.162826 Apr 06 17:00:51.891397 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1477/2950] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:51 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:52.273282 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-39f4adb6-eb63-4918-b465-3feb5721b9c9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:52.274288 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-39f4adb6-eb63-4918-b465-3feb5721b9c9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:52.284664 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39f4adb6-eb63-4918-b465-3feb5721b9c9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:52.285468 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39f4adb6-eb63-4918-b465-3feb5721b9c9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:52.286732 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39f4adb6-eb63-4918-b465-3feb5721b9c9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:52.287453 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39f4adb6-eb63-4918-b465-3feb5721b9c9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:52.430008 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-39f4adb6-eb63-4918-b465-3feb5721b9c9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:52.438869 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-39f4adb6-eb63-4918-b465-3feb5721b9c9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:52.440367 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-39f4adb6-eb63-4918-b465-3feb5721b9c9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:52.441561 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-39f4adb6-eb63-4918-b465-3feb5721b9c9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.174959 Apr 06 17:00:52.442129 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1474/2951] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:52 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:52.907706 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a4ce2fe8-b115-45e5-bd29-723844a0cf2b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:52.908356 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a4ce2fe8-b115-45e5-bd29-723844a0cf2b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:52.909452 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-978ba711-c441-4cfa-9ec2-8edb8ba5d8b7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:52.910089 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-978ba711-c441-4cfa-9ec2-8edb8ba5d8b7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:52.914921 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4ce2fe8-b115-45e5-bd29-723844a0cf2b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:52.915370 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4ce2fe8-b115-45e5-bd29-723844a0cf2b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:52.916210 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4ce2fe8-b115-45e5-bd29-723844a0cf2b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:52.916652 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4ce2fe8-b115-45e5-bd29-723844a0cf2b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:52.917071 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-978ba711-c441-4cfa-9ec2-8edb8ba5d8b7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:52.917510 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-978ba711-c441-4cfa-9ec2-8edb8ba5d8b7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:52.918271 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-978ba711-c441-4cfa-9ec2-8edb8ba5d8b7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:52.918695 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-978ba711-c441-4cfa-9ec2-8edb8ba5d8b7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:53.051227 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a4ce2fe8-b115-45e5-bd29-723844a0cf2b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:53.055174 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-978ba711-c441-4cfa-9ec2-8edb8ba5d8b7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:53.059385 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a4ce2fe8-b115-45e5-bd29-723844a0cf2b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.155684 Apr 06 17:00:53.059979 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1478/2952] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:52 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:53.063495 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-978ba711-c441-4cfa-9ec2-8edb8ba5d8b7 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.157975 Apr 06 17:00:53.064061 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1475/2953] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:52 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:53.463932 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a93d192e-94d2-4723-8f15-5156a7ae2abe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:53.464983 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a93d192e-94d2-4723-8f15-5156a7ae2abe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:53.475447 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a93d192e-94d2-4723-8f15-5156a7ae2abe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:53.476203 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a93d192e-94d2-4723-8f15-5156a7ae2abe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:53.477530 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a93d192e-94d2-4723-8f15-5156a7ae2abe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:53.478377 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a93d192e-94d2-4723-8f15-5156a7ae2abe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:53.629646 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a93d192e-94d2-4723-8f15-5156a7ae2abe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:53.638762 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a93d192e-94d2-4723-8f15-5156a7ae2abe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:53.640221 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a93d192e-94d2-4723-8f15-5156a7ae2abe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:53.641411 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a93d192e-94d2-4723-8f15-5156a7ae2abe tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.184124 Apr 06 17:00:53.641968 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1479/2954] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:53 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:54.083256 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c5a6687d-78aa-4af7-9587-a868c51c2bf0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:54.084165 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c5a6687d-78aa-4af7-9587-a868c51c2bf0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:54.087663 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-24a67214-bbbd-458e-8a2d-c30a1129cec0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:54.088459 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-24a67214-bbbd-458e-8a2d-c30a1129cec0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:54.092910 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5a6687d-78aa-4af7-9587-a868c51c2bf0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:54.093374 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5a6687d-78aa-4af7-9587-a868c51c2bf0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:54.094155 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5a6687d-78aa-4af7-9587-a868c51c2bf0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:54.094589 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5a6687d-78aa-4af7-9587-a868c51c2bf0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:54.095126 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24a67214-bbbd-458e-8a2d-c30a1129cec0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:54.095578 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24a67214-bbbd-458e-8a2d-c30a1129cec0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:54.096351 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24a67214-bbbd-458e-8a2d-c30a1129cec0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:54.096826 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-24a67214-bbbd-458e-8a2d-c30a1129cec0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:54.235436 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c5a6687d-78aa-4af7-9587-a868c51c2bf0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:54.243494 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-24a67214-bbbd-458e-8a2d-c30a1129cec0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:54.245085 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c5a6687d-78aa-4af7-9587-a868c51c2bf0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.170430 Apr 06 17:00:54.245678 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1476/2955] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:54 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:54.251402 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-24a67214-bbbd-458e-8a2d-c30a1129cec0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.170407 Apr 06 17:00:54.252000 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1480/2956] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:54 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:54.533666 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0d73e0d2-fa43-4fbd-8ec8-198849519397 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:54.534375 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0d73e0d2-fa43-4fbd-8ec8-198849519397 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 4be6d0c6-2b22-40ab-b5b9-0f738db81efe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:54.542580 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d73e0d2-fa43-4fbd-8ec8-198849519397 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:54.543035 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d73e0d2-fa43-4fbd-8ec8-198849519397 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:54.543819 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d73e0d2-fa43-4fbd-8ec8-198849519397 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:54.544253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d73e0d2-fa43-4fbd-8ec8-198849519397 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:54.568098 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0d73e0d2-fa43-4fbd-8ec8-198849519397 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe/ips" status: 200 len: 150 microversion: 2.1 time: 0.039706 Apr 06 17:00:54.568660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1477/2957] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Apr 6 17:00:54 2022] GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:00:54.667372 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e8bf370b-9526-41df-98e0-599d01be83f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:54.668009 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e8bf370b-9526-41df-98e0-599d01be83f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:54.675247 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8bf370b-9526-41df-98e0-599d01be83f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:54.675722 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8bf370b-9526-41df-98e0-599d01be83f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:54.676536 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8bf370b-9526-41df-98e0-599d01be83f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:54.677030 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e8bf370b-9526-41df-98e0-599d01be83f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:54.821932 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e8bf370b-9526-41df-98e0-599d01be83f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:54.835632 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e8bf370b-9526-41df-98e0-599d01be83f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:54.837913 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e8bf370b-9526-41df-98e0-599d01be83f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:54.839249 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e8bf370b-9526-41df-98e0-599d01be83f3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.176061 Apr 06 17:00:54.839811 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1481/2958] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:54 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:55.268144 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e1c42e73-c842-4665-bbc8-0c9ed19a3d88 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:55.269170 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e1c42e73-c842-4665-bbc8-0c9ed19a3d88 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:55.275938 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2a5ddbf7-d77e-4afd-ad40-fe0d17f8450b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:55.277125 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2a5ddbf7-d77e-4afd-ad40-fe0d17f8450b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:55.280431 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1c42e73-c842-4665-bbc8-0c9ed19a3d88 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:55.281178 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1c42e73-c842-4665-bbc8-0c9ed19a3d88 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:55.282478 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1c42e73-c842-4665-bbc8-0c9ed19a3d88 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:55.283190 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1c42e73-c842-4665-bbc8-0c9ed19a3d88 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:55.287205 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a5ddbf7-d77e-4afd-ad40-fe0d17f8450b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:55.287951 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a5ddbf7-d77e-4afd-ad40-fe0d17f8450b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:55.289275 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a5ddbf7-d77e-4afd-ad40-fe0d17f8450b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:55.290034 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2a5ddbf7-d77e-4afd-ad40-fe0d17f8450b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:55.426509 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2a5ddbf7-d77e-4afd-ad40-fe0d17f8450b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:55.430688 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e1c42e73-c842-4665-bbc8-0c9ed19a3d88 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:55.434662 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2a5ddbf7-d77e-4afd-ad40-fe0d17f8450b tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.165426 Apr 06 17:00:55.435246 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1482/2959] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:55 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:55.439247 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e1c42e73-c842-4665-bbc8-0c9ed19a3d88 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.179033 Apr 06 17:00:55.439813 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1478/2960] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:55 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:55.859766 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4d4d4d96-d630-498c-8a51-09b2bc40fba3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:55.860405 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4d4d4d96-d630-498c-8a51-09b2bc40fba3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:55.867431 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d4d4d96-d630-498c-8a51-09b2bc40fba3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:55.867902 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d4d4d96-d630-498c-8a51-09b2bc40fba3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:55.868749 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d4d4d96-d630-498c-8a51-09b2bc40fba3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:55.869231 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4d4d4d96-d630-498c-8a51-09b2bc40fba3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:56.036869 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4d4d4d96-d630-498c-8a51-09b2bc40fba3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:56.047247 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4d4d4d96-d630-498c-8a51-09b2bc40fba3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:56.048776 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4d4d4d96-d630-498c-8a51-09b2bc40fba3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:56.049947 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4d4d4d96-d630-498c-8a51-09b2bc40fba3 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.194781 Apr 06 17:00:56.050518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1483/2961] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:55 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:56.453719 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b75e78cb-658f-48cd-a7f0-48a47c5e68f4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:56.454532 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b75e78cb-658f-48cd-a7f0-48a47c5e68f4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:56.458974 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5a93f1f1-9169-439d-ba92-279051ff5b48 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:56.459782 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5a93f1f1-9169-439d-ba92-279051ff5b48 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:56.463217 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b75e78cb-658f-48cd-a7f0-48a47c5e68f4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:56.463832 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b75e78cb-658f-48cd-a7f0-48a47c5e68f4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:56.464889 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b75e78cb-658f-48cd-a7f0-48a47c5e68f4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:56.465473 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b75e78cb-658f-48cd-a7f0-48a47c5e68f4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:56.468652 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a93f1f1-9169-439d-ba92-279051ff5b48 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:56.469301 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a93f1f1-9169-439d-ba92-279051ff5b48 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:56.470320 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a93f1f1-9169-439d-ba92-279051ff5b48 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:56.470901 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a93f1f1-9169-439d-ba92-279051ff5b48 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:56.604014 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b75e78cb-658f-48cd-a7f0-48a47c5e68f4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:56.610369 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5a93f1f1-9169-439d-ba92-279051ff5b48 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:56.612842 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b75e78cb-658f-48cd-a7f0-48a47c5e68f4 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.164291 Apr 06 17:00:56.613403 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1479/2962] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:56 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:56.618658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5a93f1f1-9169-439d-ba92-279051ff5b48 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.164818 Apr 06 17:00:56.619281 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1484/2963] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:56 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:57.068545 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d9b00276-dc03-4147-8baf-e8788f43a76f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:57.069304 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d9b00276-dc03-4147-8baf-e8788f43a76f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:57.075835 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9b00276-dc03-4147-8baf-e8788f43a76f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:57.076289 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9b00276-dc03-4147-8baf-e8788f43a76f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:57.077091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9b00276-dc03-4147-8baf-e8788f43a76f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:57.077526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9b00276-dc03-4147-8baf-e8788f43a76f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:57.222424 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d9b00276-dc03-4147-8baf-e8788f43a76f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:57.232139 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d9b00276-dc03-4147-8baf-e8788f43a76f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:57.233587 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d9b00276-dc03-4147-8baf-e8788f43a76f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:57.234771 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d9b00276-dc03-4147-8baf-e8788f43a76f tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.170252 Apr 06 17:00:57.235327 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1480/2964] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:57 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:57.632560 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9190ed33-1950-4f88-900b-f093b80ad5d0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:57.633316 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9190ed33-1950-4f88-900b-f093b80ad5d0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:57.638148 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5ea72b19-dcfb-47e9-a8e7-ae187e972a9e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:57.638843 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5ea72b19-dcfb-47e9-a8e7-ae187e972a9e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:57.642963 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9190ed33-1950-4f88-900b-f093b80ad5d0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:57.643715 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9190ed33-1950-4f88-900b-f093b80ad5d0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:57.644913 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9190ed33-1950-4f88-900b-f093b80ad5d0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:57.645518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9190ed33-1950-4f88-900b-f093b80ad5d0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:57.648460 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ea72b19-dcfb-47e9-a8e7-ae187e972a9e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:57.649113 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ea72b19-dcfb-47e9-a8e7-ae187e972a9e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:57.650097 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ea72b19-dcfb-47e9-a8e7-ae187e972a9e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:57.650664 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ea72b19-dcfb-47e9-a8e7-ae187e972a9e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:57.784789 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9190ed33-1950-4f88-900b-f093b80ad5d0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:57.787175 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5ea72b19-dcfb-47e9-a8e7-ae187e972a9e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:57.793014 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9190ed33-1950-4f88-900b-f093b80ad5d0 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.166722 Apr 06 17:00:57.793594 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1485/2965] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:57 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:57.795112 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5ea72b19-dcfb-47e9-a8e7-ae187e972a9e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.162704 Apr 06 17:00:57.795664 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1481/2966] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:57 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:58.258459 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-97d2afbe-0e4f-43f4-bd47-8133e00bac27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:58.259444 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-97d2afbe-0e4f-43f4-bd47-8133e00bac27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:58.266731 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97d2afbe-0e4f-43f4-bd47-8133e00bac27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:58.267482 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97d2afbe-0e4f-43f4-bd47-8133e00bac27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:58.268252 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97d2afbe-0e4f-43f4-bd47-8133e00bac27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:58.268725 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97d2afbe-0e4f-43f4-bd47-8133e00bac27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:58.416971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-97d2afbe-0e4f-43f4-bd47-8133e00bac27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:58.425713 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-97d2afbe-0e4f-43f4-bd47-8133e00bac27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:58.427200 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-97d2afbe-0e4f-43f4-bd47-8133e00bac27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:58.428347 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-97d2afbe-0e4f-43f4-bd47-8133e00bac27 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.176828 Apr 06 17:00:58.428944 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1486/2967] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:58 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:58.817002 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-93f2a7e2-ceae-41b5-9100-286c3201aaac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:58.817894 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-93f2a7e2-ceae-41b5-9100-286c3201aaac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:58.819541 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-97eab3f3-2583-4bf5-bebe-caadabadd905 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:58.820563 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-97eab3f3-2583-4bf5-bebe-caadabadd905 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:58.826950 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93f2a7e2-ceae-41b5-9100-286c3201aaac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:58.827290 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93f2a7e2-ceae-41b5-9100-286c3201aaac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:58.828085 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93f2a7e2-ceae-41b5-9100-286c3201aaac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:58.828237 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97eab3f3-2583-4bf5-bebe-caadabadd905 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:58.828512 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93f2a7e2-ceae-41b5-9100-286c3201aaac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:58.828711 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97eab3f3-2583-4bf5-bebe-caadabadd905 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:58.829434 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97eab3f3-2583-4bf5-bebe-caadabadd905 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:58.829874 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-97eab3f3-2583-4bf5-bebe-caadabadd905 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:58.962631 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-97eab3f3-2583-4bf5-bebe-caadabadd905 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:58.963845 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-93f2a7e2-ceae-41b5-9100-286c3201aaac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:58.971424 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-97eab3f3-2583-4bf5-bebe-caadabadd905 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.161361 Apr 06 17:00:58.972004 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1487/2968] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:58 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:58.972740 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-93f2a7e2-ceae-41b5-9100-286c3201aaac tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.163105 Apr 06 17:00:58.973308 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1482/2969] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:58 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:00:59.450060 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-faa1b6c3-474f-4488-8530-a6fe4e949844 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:59.450670 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-faa1b6c3-474f-4488-8530-a6fe4e949844 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:59.457399 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-faa1b6c3-474f-4488-8530-a6fe4e949844 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:59.457849 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-faa1b6c3-474f-4488-8530-a6fe4e949844 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:59.458613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-faa1b6c3-474f-4488-8530-a6fe4e949844 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:59.459029 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-faa1b6c3-474f-4488-8530-a6fe4e949844 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:59.593146 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-faa1b6c3-474f-4488-8530-a6fe4e949844 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:59.601506 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-faa1b6c3-474f-4488-8530-a6fe4e949844 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:59.603034 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-faa1b6c3-474f-4488-8530-a6fe4e949844 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:00:59.604553 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-faa1b6c3-474f-4488-8530-a6fe4e949844 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.159714 Apr 06 17:00:59.605131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1488/2970] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:00:59 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:00:59.991222 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ecff8dca-343b-4521-afef-7687c901155b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:59.991954 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cbe83b80-579a-4688-9ae5-94f4b54f3838 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:00:59.992343 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ecff8dca-343b-4521-afef-7687c901155b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:59.992457 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cbe83b80-579a-4688-9ae5-94f4b54f3838 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:00:59.998711 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ecff8dca-343b-4521-afef-7687c901155b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:59.998911 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cbe83b80-579a-4688-9ae5-94f4b54f3838 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:00:59.999171 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ecff8dca-343b-4521-afef-7687c901155b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:59.999334 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cbe83b80-579a-4688-9ae5-94f4b54f3838 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:00:59.999944 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cbe83b80-579a-4688-9ae5-94f4b54f3838 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:00.000081 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ecff8dca-343b-4521-afef-7687c901155b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:00.000383 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cbe83b80-579a-4688-9ae5-94f4b54f3838 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:00.000513 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ecff8dca-343b-4521-afef-7687c901155b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:00.146780 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cbe83b80-579a-4688-9ae5-94f4b54f3838 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:00.155476 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cbe83b80-579a-4688-9ae5-94f4b54f3838 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.168014 Apr 06 17:01:00.156069 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1483/2971] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:59 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:00.386006 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ecff8dca-343b-4521-afef-7687c901155b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:00.393885 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ecff8dca-343b-4521-afef-7687c901155b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.406463 Apr 06 17:01:00.394456 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1489/2972] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:00:59 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:00.627778 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ebf73a42-a1af-4493-8e02-3c9ad6270a41 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:00.628758 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ebf73a42-a1af-4493-8e02-3c9ad6270a41 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:00.638937 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebf73a42-a1af-4493-8e02-3c9ad6270a41 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:00.639688 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebf73a42-a1af-4493-8e02-3c9ad6270a41 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:00.641014 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebf73a42-a1af-4493-8e02-3c9ad6270a41 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:00.641739 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebf73a42-a1af-4493-8e02-3c9ad6270a41 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:00.782235 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ebf73a42-a1af-4493-8e02-3c9ad6270a41 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:00.794950 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ebf73a42-a1af-4493-8e02-3c9ad6270a41 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:00.797281 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ebf73a42-a1af-4493-8e02-3c9ad6270a41 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:00.799091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ebf73a42-a1af-4493-8e02-3c9ad6270a41 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.177767 Apr 06 17:01:00.799930 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1484/2973] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:01:00 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:01:01.177469 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-255ca56c-51cb-4d51-8386-6a831146a6a2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:01.178514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-255ca56c-51cb-4d51-8386-6a831146a6a2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] [instance: c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:01.189782 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-255ca56c-51cb-4d51-8386-6a831146a6a2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:01.190514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-255ca56c-51cb-4d51-8386-6a831146a6a2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:01.191751 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-255ca56c-51cb-4d51-8386-6a831146a6a2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:01.192461 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-255ca56c-51cb-4d51-8386-6a831146a6a2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:01.330822 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-255ca56c-51cb-4d51-8386-6a831146a6a2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76c0a653a4440b9029b92154f9df1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae63fb1fb5834fb8969a587fde2f5729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:01.338932 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-255ca56c-51cb-4d51-8386-6a831146a6a2 tempest-VolumesSnapshotTestJSON-1798365013 tempest-VolumesSnapshotTestJSON-1798365013-project] 10.222.0.64 "GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce" status: 200 len: 1560 microversion: 2.1 time: 0.168111 Apr 06 17:01:01.339524 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1490/2974] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:01 2022] GET /compute/v2.1/servers/c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:01.411548 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-95138f15-7b5c-456a-9423-f6ad7db6438c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:01.412191 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-95138f15-7b5c-456a-9423-f6ad7db6438c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:01.419302 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95138f15-7b5c-456a-9423-f6ad7db6438c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:01.420077 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95138f15-7b5c-456a-9423-f6ad7db6438c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:01.421142 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95138f15-7b5c-456a-9423-f6ad7db6438c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:01.421640 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95138f15-7b5c-456a-9423-f6ad7db6438c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:01.561841 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-95138f15-7b5c-456a-9423-f6ad7db6438c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:01.570246 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-95138f15-7b5c-456a-9423-f6ad7db6438c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.162625 Apr 06 17:01:01.570837 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1485/2975] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:01 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:01.820741 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5ec3a641-52d5-4eb0-a1f8-cfe43d19731b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:01.821257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5ec3a641-52d5-4eb0-a1f8-cfe43d19731b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:01.827876 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ec3a641-52d5-4eb0-a1f8-cfe43d19731b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:01.828350 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ec3a641-52d5-4eb0-a1f8-cfe43d19731b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:01.829140 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ec3a641-52d5-4eb0-a1f8-cfe43d19731b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:01.829598 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5ec3a641-52d5-4eb0-a1f8-cfe43d19731b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:01.978686 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5ec3a641-52d5-4eb0-a1f8-cfe43d19731b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:01.989723 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5ec3a641-52d5-4eb0-a1f8-cfe43d19731b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:01.991289 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5ec3a641-52d5-4eb0-a1f8-cfe43d19731b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:01.992593 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5ec3a641-52d5-4eb0-a1f8-cfe43d19731b tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 200 len: 1800 microversion: 2.20 time: 0.175884 Apr 06 17:01:01.993260 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1491/2976] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:01:01 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:01:02.013507 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-060614f7-557d-41ba-8d01-ee4f1d067288 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '.version_select at 0x7fa9ca2da280>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:02.036709 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-060614f7-557d-41ba-8d01-ee4f1d067288 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-595131113" status: 204 len: 0 microversion: 2.20 time: 0.028857 Apr 06 17:01:02.037295 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1486/2977] 10.222.0.64 () {60 vars in 1258 bytes} [Wed Apr 6 17:01:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-595131113 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 06 17:01:02.589315 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c77b9807-5b6f-4618-9594-d61df8e51c53 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:02.590234 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c77b9807-5b6f-4618-9594-d61df8e51c53 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:02.598890 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c77b9807-5b6f-4618-9594-d61df8e51c53 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:02.599468 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c77b9807-5b6f-4618-9594-d61df8e51c53 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:02.600398 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c77b9807-5b6f-4618-9594-d61df8e51c53 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:02.601065 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c77b9807-5b6f-4618-9594-d61df8e51c53 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:02.752675 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c77b9807-5b6f-4618-9594-d61df8e51c53 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:02.761188 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c77b9807-5b6f-4618-9594-d61df8e51c53 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.177225 Apr 06 17:01:02.762386 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1492/2978] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:02 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:03.265021 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-bc61a099-6de3-4749-ac06-d0a8fee5efea req-1a96653b-1bab-44de-a9e7-3b2538d24f33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "330d17b1-0d7d-4519-8dc3-3210eb25aa3c", "tag": "e267cfb2-7045-4a09-851f-05d45654d0a1"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:01:03.274168 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-bc61a099-6de3-4749-ac06-d0a8fee5efea req-1a96653b-1bab-44de-a9e7-3b2538d24f33 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:03.274603 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-bc61a099-6de3-4749-ac06-d0a8fee5efea req-1a96653b-1bab-44de-a9e7-3b2538d24f33 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:03.286034 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-bc61a099-6de3-4749-ac06-d0a8fee5efea req-1a96653b-1bab-44de-a9e7-3b2538d24f33 service nova] Creating event network-changed:e267cfb2-7045-4a09-851f-05d45654d0a1 for instance 330d17b1-0d7d-4519-8dc3-3210eb25aa3c on hv-cinder-83684 Apr 06 17:01:03.291796 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-bc61a099-6de3-4749-ac06-d0a8fee5efea req-1a96653b-1bab-44de-a9e7-3b2538d24f33 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031654 Apr 06 17:01:03.292398 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1487/2979] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 17:01:03.460804 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-74efc25b-e46d-418f-88a0-63e30c9c7618 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Action: 'create', calling method: .version_select at 0x7fa9cf144af0>, body: {"keypair": {"name": "tempest-keypair-718255457"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:01:03.476600 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-74efc25b-e46d-418f-88a0-63e30c9c7618 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Getting quotas for project d07f53a1a9c4463693fa2c0005504b58. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 17:01:03.481745 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-74efc25b-e46d-418f-88a0-63e30c9c7618 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Getting quotas for user 2230d519a0bf4024ac9e8be3a4f5aeb2 and project d07f53a1a9c4463693fa2c0005504b58. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 17:01:03.779171 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-aaaa570d-6718-4464-898b-0d36f5e75794 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:03.780294 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-aaaa570d-6718-4464-898b-0d36f5e75794 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:03.788708 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aaaa570d-6718-4464-898b-0d36f5e75794 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:03.789336 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aaaa570d-6718-4464-898b-0d36f5e75794 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:03.790257 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aaaa570d-6718-4464-898b-0d36f5e75794 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:03.790787 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aaaa570d-6718-4464-898b-0d36f5e75794 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:03.806146 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-74efc25b-e46d-418f-88a0-63e30c9c7618 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Getting quotas for project d07f53a1a9c4463693fa2c0005504b58. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 17:01:03.816027 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-74efc25b-e46d-418f-88a0-63e30c9c7618 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Getting quotas for user 2230d519a0bf4024ac9e8be3a4f5aeb2 and project d07f53a1a9c4463693fa2c0005504b58. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 17:01:03.829569 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-74efc25b-e46d-418f-88a0-63e30c9c7618 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.372649 Apr 06 17:01:03.830645 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1493/2980] 10.222.0.64 () {62 vars in 1198 bytes} [Wed Apr 6 17:01:03 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 374 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Apr 06 17:01:03.957726 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-aaaa570d-6718-4464-898b-0d36f5e75794 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:03.967705 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-aaaa570d-6718-4464-898b-0d36f5e75794 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.192740 Apr 06 17:01:03.968957 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1488/2981] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:03 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:01:04.986798 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3ce27302-b505-4731-be3f-0bc372cb77ab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:04.987720 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3ce27302-b505-4731-be3f-0bc372cb77ab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:04.994071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ce27302-b505-4731-be3f-0bc372cb77ab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:04.994526 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ce27302-b505-4731-be3f-0bc372cb77ab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:04.995297 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ce27302-b505-4731-be3f-0bc372cb77ab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:04.995735 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3ce27302-b505-4731-be3f-0bc372cb77ab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:05.150912 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3ce27302-b505-4731-be3f-0bc372cb77ab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:05.159567 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3ce27302-b505-4731-be3f-0bc372cb77ab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.177362 Apr 06 17:01:05.160150 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1494/2982] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:04 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:05.167620 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3e431a24-1f94-4199-8a2d-4ed56f5a10ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2126929448", "imageRef": "c217dd2b-7679-4860-b2e6-01a967f654df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ba7aff5-22d6-4ba8-b4f9-b36e4d32350f"}], "security_groups": [{"name": "tempest-securitygroup--173568913"}], "key_name": "tempest-keypair-718255457", "user_data": "}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:01:05.270431 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-3e431a24-1f94-4199-8a2d-4ed56f5a10ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] validate_networks() for [('2ba7aff5-22d6-4ba8-b4f9-b36e4d32350f', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 06 17:01:05.723614 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-3e431a24-1f94-4199-8a2d-4ed56f5a10ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 06 17:01:05.724030 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-3e431a24-1f94-4199-8a2d-4ed56f5a10ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 06 17:01:05.724520 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-3e431a24-1f94-4199-8a2d-4ed56f5a10ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 06 17:01:05.724953 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-3e431a24-1f94-4199-8a2d-4ed56f5a10ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 06 17:01:05.725357 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-3e431a24-1f94-4199-8a2d-4ed56f5a10ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 06 17:01:05.735335 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e431a24-1f94-4199-8a2d-4ed56f5a10ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:05.735774 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e431a24-1f94-4199-8a2d-4ed56f5a10ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:05.736563 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e431a24-1f94-4199-8a2d-4ed56f5a10ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:05.737033 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e431a24-1f94-4199-8a2d-4ed56f5a10ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:05.757284 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-3e431a24-1f94-4199-8a2d-4ed56f5a10ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Getting quotas for project d07f53a1a9c4463693fa2c0005504b58. Resources: {'instances', 'cores', 'ram'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 17:01:05.762039 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-3e431a24-1f94-4199-8a2d-4ed56f5a10ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Getting quotas for user 2230d519a0bf4024ac9e8be3a4f5aeb2 and project d07f53a1a9c4463693fa2c0005504b58. Resources: {'instances', 'cores', 'ram'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 17:01:05.773308 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3e431a24-1f94-4199-8a2d-4ed56f5a10ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 06 17:01:05.775601 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3e431a24-1f94-4199-8a2d-4ed56f5a10ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 51c2747f-a615-42e2-9fb6-13e355306395] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c217dd2b-7679-4860-b2e6-01a967f654df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 06 17:01:05.823022 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3e431a24-1f94-4199-8a2d-4ed56f5a10ff tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.659739 Apr 06 17:01:05.823679 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1489/2983] 10.222.0.64 () {62 vars in 1187 bytes} [Wed Apr 6 17:01:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Apr 06 17:01:05.834036 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8a815063-a798-45ef-b469-2c7454c8b1af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:05.834637 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8a815063-a798-45ef-b469-2c7454c8b1af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 51c2747f-a615-42e2-9fb6-13e355306395] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:05.885588 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8a815063-a798-45ef-b469-2c7454c8b1af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:05.893136 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8a815063-a798-45ef-b469-2c7454c8b1af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:05.894616 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8a815063-a798-45ef-b469-2c7454c8b1af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:05.895715 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8a815063-a798-45ef-b469-2c7454c8b1af tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395" status: 200 len: 1281 microversion: 2.20 time: 0.065778 Apr 06 17:01:05.896265 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1495/2984] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:01:05 2022] GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395 => generated 1281 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:01:06.177470 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2712914e-6daa-46e9-98eb-fb3af40436b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:06.178223 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2712914e-6daa-46e9-98eb-fb3af40436b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:06.185353 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2712914e-6daa-46e9-98eb-fb3af40436b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:06.186084 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2712914e-6daa-46e9-98eb-fb3af40436b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:06.187081 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2712914e-6daa-46e9-98eb-fb3af40436b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:06.187457 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2712914e-6daa-46e9-98eb-fb3af40436b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:06.328329 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2712914e-6daa-46e9-98eb-fb3af40436b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:06.338817 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2712914e-6daa-46e9-98eb-fb3af40436b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.165531 Apr 06 17:01:06.339256 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1490/2985] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:06 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:06.914380 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-96b5b837-32e3-402a-91fe-6e609e9b2bfb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:06.915040 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-96b5b837-32e3-402a-91fe-6e609e9b2bfb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 51c2747f-a615-42e2-9fb6-13e355306395] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:06.922005 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96b5b837-32e3-402a-91fe-6e609e9b2bfb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:06.922458 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96b5b837-32e3-402a-91fe-6e609e9b2bfb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:06.923243 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96b5b837-32e3-402a-91fe-6e609e9b2bfb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:06.923664 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-96b5b837-32e3-402a-91fe-6e609e9b2bfb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:06.985534 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-96b5b837-32e3-402a-91fe-6e609e9b2bfb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:07.001093 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-96b5b837-32e3-402a-91fe-6e609e9b2bfb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:07.002614 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-96b5b837-32e3-402a-91fe-6e609e9b2bfb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:07.004426 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-96b5b837-32e3-402a-91fe-6e609e9b2bfb tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395" status: 200 len: 1351 microversion: 2.20 time: 0.094043 Apr 06 17:01:07.005303 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1496/2986] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:01:06 2022] GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395 => generated 1351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:01:07.356390 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cc25fcdd-6660-421d-bc45-8ae45ec4d75b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:07.357163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cc25fcdd-6660-421d-bc45-8ae45ec4d75b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:07.364469 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc25fcdd-6660-421d-bc45-8ae45ec4d75b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:07.365051 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc25fcdd-6660-421d-bc45-8ae45ec4d75b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:07.366069 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc25fcdd-6660-421d-bc45-8ae45ec4d75b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:07.366678 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc25fcdd-6660-421d-bc45-8ae45ec4d75b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:07.607821 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cc25fcdd-6660-421d-bc45-8ae45ec4d75b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:07.616118 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cc25fcdd-6660-421d-bc45-8ae45ec4d75b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.264152 Apr 06 17:01:07.616733 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1491/2987] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:07 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:01:08.022697 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-aafb2fff-78bc-4972-b039-fc053e563dea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:08.023313 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-aafb2fff-78bc-4972-b039-fc053e563dea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 51c2747f-a615-42e2-9fb6-13e355306395] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:08.031305 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aafb2fff-78bc-4972-b039-fc053e563dea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:08.031701 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aafb2fff-78bc-4972-b039-fc053e563dea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:08.032471 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aafb2fff-78bc-4972-b039-fc053e563dea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:08.032942 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-aafb2fff-78bc-4972-b039-fc053e563dea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:08.174181 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-aafb2fff-78bc-4972-b039-fc053e563dea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:08.182411 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-aafb2fff-78bc-4972-b039-fc053e563dea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:08.184502 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-aafb2fff-78bc-4972-b039-fc053e563dea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:08.186430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-aafb2fff-78bc-4972-b039-fc053e563dea tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395" status: 200 len: 1406 microversion: 2.20 time: 0.167767 Apr 06 17:01:08.187085 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1497/2988] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:01:08 2022] GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:01:08.428614 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-b8f3d98e-615d-43ad-a258-9aac77e9f127 req-a4f7292a-432a-4db8-93ad-98c04c666c25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51c2747f-a615-42e2-9fb6-13e355306395", "tag": "ece5056b-f8ed-42bb-96c3-81d12b2f0317"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:01:08.440915 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b8f3d98e-615d-43ad-a258-9aac77e9f127 req-a4f7292a-432a-4db8-93ad-98c04c666c25 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:08.441597 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b8f3d98e-615d-43ad-a258-9aac77e9f127 req-a4f7292a-432a-4db8-93ad-98c04c666c25 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:08.456996 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-b8f3d98e-615d-43ad-a258-9aac77e9f127 req-a4f7292a-432a-4db8-93ad-98c04c666c25 service nova] Creating event network-changed:ece5056b-f8ed-42bb-96c3-81d12b2f0317 for instance 51c2747f-a615-42e2-9fb6-13e355306395 on hv-cinder-83684 Apr 06 17:01:08.462465 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-b8f3d98e-615d-43ad-a258-9aac77e9f127 req-a4f7292a-432a-4db8-93ad-98c04c666c25 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037852 Apr 06 17:01:08.463541 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1492/2989] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:01:08.634688 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-47c2db1c-b5e3-4889-a77b-d45e765b0a43 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:08.635649 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-47c2db1c-b5e3-4889-a77b-d45e765b0a43 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:08.642679 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47c2db1c-b5e3-4889-a77b-d45e765b0a43 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:08.643133 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47c2db1c-b5e3-4889-a77b-d45e765b0a43 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:08.643902 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47c2db1c-b5e3-4889-a77b-d45e765b0a43 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:08.644336 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47c2db1c-b5e3-4889-a77b-d45e765b0a43 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:08.776327 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-47c2db1c-b5e3-4889-a77b-d45e765b0a43 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:08.784186 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-47c2db1c-b5e3-4889-a77b-d45e765b0a43 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.154053 Apr 06 17:01:08.784804 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1498/2990] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:08 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:09.210933 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d8cc3606-0be6-46da-a7a7-f6367173da61 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:09.212090 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d8cc3606-0be6-46da-a7a7-f6367173da61 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 51c2747f-a615-42e2-9fb6-13e355306395] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:09.223268 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8cc3606-0be6-46da-a7a7-f6367173da61 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:09.224028 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8cc3606-0be6-46da-a7a7-f6367173da61 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:09.225394 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8cc3606-0be6-46da-a7a7-f6367173da61 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:09.226218 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8cc3606-0be6-46da-a7a7-f6367173da61 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:09.387708 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d8cc3606-0be6-46da-a7a7-f6367173da61 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:09.396293 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d8cc3606-0be6-46da-a7a7-f6367173da61 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:09.397837 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d8cc3606-0be6-46da-a7a7-f6367173da61 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:09.398946 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d8cc3606-0be6-46da-a7a7-f6367173da61 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395" status: 200 len: 1406 microversion: 2.20 time: 0.195699 Apr 06 17:01:09.399483 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1493/2991] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:01:09 2022] GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395 => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:01:09.803129 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4ed53ccf-82e3-4a7e-bb93-c10f5bc08b09 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:09.803790 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4ed53ccf-82e3-4a7e-bb93-c10f5bc08b09 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:09.813622 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ed53ccf-82e3-4a7e-bb93-c10f5bc08b09 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:09.814397 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ed53ccf-82e3-4a7e-bb93-c10f5bc08b09 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:09.815227 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ed53ccf-82e3-4a7e-bb93-c10f5bc08b09 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:09.815692 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ed53ccf-82e3-4a7e-bb93-c10f5bc08b09 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:09.959410 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4ed53ccf-82e3-4a7e-bb93-c10f5bc08b09 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:09.967416 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4ed53ccf-82e3-4a7e-bb93-c10f5bc08b09 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.168677 Apr 06 17:01:09.967998 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1499/2992] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:09 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:10.420458 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3dd49243-d5db-4901-883c-09fd25e5180c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:10.421621 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3dd49243-d5db-4901-883c-09fd25e5180c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 51c2747f-a615-42e2-9fb6-13e355306395] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:10.432420 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dd49243-d5db-4901-883c-09fd25e5180c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:10.433165 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dd49243-d5db-4901-883c-09fd25e5180c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:10.434419 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dd49243-d5db-4901-883c-09fd25e5180c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:10.435132 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dd49243-d5db-4901-883c-09fd25e5180c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:10.578113 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3dd49243-d5db-4901-883c-09fd25e5180c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:10.586150 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3dd49243-d5db-4901-883c-09fd25e5180c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:10.587701 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3dd49243-d5db-4901-883c-09fd25e5180c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:10.588828 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3dd49243-d5db-4901-883c-09fd25e5180c tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395" status: 200 len: 1406 microversion: 2.20 time: 0.175025 Apr 06 17:01:10.589394 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1494/2993] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:01:10 2022] GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:01:10.989673 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-22010285-2bd9-4ef9-b6e6-93bcca29149a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:10.990681 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-22010285-2bd9-4ef9-b6e6-93bcca29149a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:11.000745 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22010285-2bd9-4ef9-b6e6-93bcca29149a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:11.001203 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22010285-2bd9-4ef9-b6e6-93bcca29149a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:11.001986 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22010285-2bd9-4ef9-b6e6-93bcca29149a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:11.002428 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-22010285-2bd9-4ef9-b6e6-93bcca29149a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:11.153044 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-22010285-2bd9-4ef9-b6e6-93bcca29149a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:11.162727 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-22010285-2bd9-4ef9-b6e6-93bcca29149a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.180019 Apr 06 17:01:11.163293 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1500/2994] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:10 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:11.610433 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-31ae1101-a11b-4c0f-a918-f1926ff40c5e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:11.611154 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-31ae1101-a11b-4c0f-a918-f1926ff40c5e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 51c2747f-a615-42e2-9fb6-13e355306395] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:11.619143 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31ae1101-a11b-4c0f-a918-f1926ff40c5e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:11.619705 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31ae1101-a11b-4c0f-a918-f1926ff40c5e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:11.620665 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31ae1101-a11b-4c0f-a918-f1926ff40c5e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:11.621254 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31ae1101-a11b-4c0f-a918-f1926ff40c5e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:11.765585 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-31ae1101-a11b-4c0f-a918-f1926ff40c5e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:11.777613 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-31ae1101-a11b-4c0f-a918-f1926ff40c5e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:11.779947 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-31ae1101-a11b-4c0f-a918-f1926ff40c5e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:11.781432 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-31ae1101-a11b-4c0f-a918-f1926ff40c5e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395" status: 200 len: 1406 microversion: 2.20 time: 0.177677 Apr 06 17:01:11.782165 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1495/2995] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:01:11 2022] GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:01:12.180552 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c9d64732-6539-4f59-bede-72088bb2f6ca tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:12.181308 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c9d64732-6539-4f59-bede-72088bb2f6ca tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:12.188768 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9d64732-6539-4f59-bede-72088bb2f6ca tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:12.189162 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9d64732-6539-4f59-bede-72088bb2f6ca tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:12.189927 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9d64732-6539-4f59-bede-72088bb2f6ca tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:12.190356 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c9d64732-6539-4f59-bede-72088bb2f6ca tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:12.325660 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c9d64732-6539-4f59-bede-72088bb2f6ca tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:12.333911 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c9d64732-6539-4f59-bede-72088bb2f6ca tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.157433 Apr 06 17:01:12.334493 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1501/2996] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:12 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:12.802822 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c894a99a-0658-456c-882d-e863ffc4f771 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:12.803511 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c894a99a-0658-456c-882d-e863ffc4f771 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 51c2747f-a615-42e2-9fb6-13e355306395] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:12.811885 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c894a99a-0658-456c-882d-e863ffc4f771 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:12.812569 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c894a99a-0658-456c-882d-e863ffc4f771 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:12.813876 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c894a99a-0658-456c-882d-e863ffc4f771 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:12.814419 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c894a99a-0658-456c-882d-e863ffc4f771 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:12.987093 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c894a99a-0658-456c-882d-e863ffc4f771 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:12.995153 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c894a99a-0658-456c-882d-e863ffc4f771 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:12.996647 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c894a99a-0658-456c-882d-e863ffc4f771 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:12.997789 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c894a99a-0658-456c-882d-e863ffc4f771 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395" status: 200 len: 1406 microversion: 2.20 time: 0.200543 Apr 06 17:01:12.998356 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1496/2997] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:01:12 2022] GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395 => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:01:13.351914 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bacd4c53-0a55-43df-bfd3-7cdd955ea833 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:13.352490 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bacd4c53-0a55-43df-bfd3-7cdd955ea833 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:13.359750 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bacd4c53-0a55-43df-bfd3-7cdd955ea833 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:13.360220 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bacd4c53-0a55-43df-bfd3-7cdd955ea833 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:13.361007 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bacd4c53-0a55-43df-bfd3-7cdd955ea833 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:13.361435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bacd4c53-0a55-43df-bfd3-7cdd955ea833 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:13.514293 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-bacd4c53-0a55-43df-bfd3-7cdd955ea833 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:13.523156 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bacd4c53-0a55-43df-bfd3-7cdd955ea833 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.175360 Apr 06 17:01:13.523779 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1502/2998] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:13 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:14.020165 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-17d48f5f-ac85-447e-bddc-8368b8e70b24 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:14.021217 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-17d48f5f-ac85-447e-bddc-8368b8e70b24 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 51c2747f-a615-42e2-9fb6-13e355306395] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:14.032302 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17d48f5f-ac85-447e-bddc-8368b8e70b24 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:14.032785 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17d48f5f-ac85-447e-bddc-8368b8e70b24 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:14.033577 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17d48f5f-ac85-447e-bddc-8368b8e70b24 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:14.034015 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17d48f5f-ac85-447e-bddc-8368b8e70b24 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:14.173337 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-17d48f5f-ac85-447e-bddc-8368b8e70b24 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:14.181296 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-17d48f5f-ac85-447e-bddc-8368b8e70b24 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:14.182785 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-17d48f5f-ac85-447e-bddc-8368b8e70b24 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:14.183879 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-17d48f5f-ac85-447e-bddc-8368b8e70b24 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395" status: 200 len: 1406 microversion: 2.20 time: 0.170797 Apr 06 17:01:14.184463 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1497/2999] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:01:14 2022] GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:01:14.196443 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-67135e77-00dd-4326-83af-a776211dcbfd req-32835ede-4e53-4f6a-a13c-b269b844aad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c2747f-a615-42e2-9fb6-13e355306395", "name": "network-vif-plugged", "status": "completed", "tag": "ece5056b-f8ed-42bb-96c3-81d12b2f0317"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:01:14.204819 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-67135e77-00dd-4326-83af-a776211dcbfd req-32835ede-4e53-4f6a-a13c-b269b844aad8 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:14.205324 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-67135e77-00dd-4326-83af-a776211dcbfd req-32835ede-4e53-4f6a-a13c-b269b844aad8 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:14.216562 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-67135e77-00dd-4326-83af-a776211dcbfd req-32835ede-4e53-4f6a-a13c-b269b844aad8 service nova] Creating event network-vif-plugged:ece5056b-f8ed-42bb-96c3-81d12b2f0317 for instance 51c2747f-a615-42e2-9fb6-13e355306395 on hv-cinder-83684 Apr 06 17:01:14.221842 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-67135e77-00dd-4326-83af-a776211dcbfd req-32835ede-4e53-4f6a-a13c-b269b844aad8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029227 Apr 06 17:01:14.222430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1503/3000] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:01:14.541385 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3050d1c6-263a-4c7f-93d4-49f8e89302ba tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:14.541917 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3050d1c6-263a-4c7f-93d4-49f8e89302ba tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:14.548943 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3050d1c6-263a-4c7f-93d4-49f8e89302ba tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:14.549385 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3050d1c6-263a-4c7f-93d4-49f8e89302ba tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:14.550142 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3050d1c6-263a-4c7f-93d4-49f8e89302ba tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:14.550565 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3050d1c6-263a-4c7f-93d4-49f8e89302ba tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:14.705473 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3050d1c6-263a-4c7f-93d4-49f8e89302ba tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:14.717525 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3050d1c6-263a-4c7f-93d4-49f8e89302ba tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.179733 Apr 06 17:01:14.718279 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1498/3001] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:14 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:15.207548 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cc0b98fc-8277-4d84-95ef-cab1d84d9ab9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:15.208412 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cc0b98fc-8277-4d84-95ef-cab1d84d9ab9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 51c2747f-a615-42e2-9fb6-13e355306395] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:15.216744 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc0b98fc-8277-4d84-95ef-cab1d84d9ab9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:15.217331 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc0b98fc-8277-4d84-95ef-cab1d84d9ab9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:15.218276 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc0b98fc-8277-4d84-95ef-cab1d84d9ab9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:15.219023 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc0b98fc-8277-4d84-95ef-cab1d84d9ab9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:15.365865 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-cc0b98fc-8277-4d84-95ef-cab1d84d9ab9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:15.374232 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-cc0b98fc-8277-4d84-95ef-cab1d84d9ab9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:15.375924 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-cc0b98fc-8277-4d84-95ef-cab1d84d9ab9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:15.377070 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cc0b98fc-8277-4d84-95ef-cab1d84d9ab9 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395" status: 200 len: 1406 microversion: 2.20 time: 0.176851 Apr 06 17:01:15.377630 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1504/3002] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:01:15 2022] GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:01:15.735300 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-057a5f12-97cb-4475-812a-621b3eb71e04 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:15.735904 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-057a5f12-97cb-4475-812a-621b3eb71e04 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:15.742714 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-057a5f12-97cb-4475-812a-621b3eb71e04 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:15.743165 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-057a5f12-97cb-4475-812a-621b3eb71e04 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:15.743931 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-057a5f12-97cb-4475-812a-621b3eb71e04 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:15.744364 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-057a5f12-97cb-4475-812a-621b3eb71e04 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:15.892308 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-057a5f12-97cb-4475-812a-621b3eb71e04 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:15.900850 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-057a5f12-97cb-4475-812a-621b3eb71e04 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.170074 Apr 06 17:01:15.901429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1499/3003] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:15 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:16.400109 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0c49627f-f402-4d6e-88c5-b72d8aed7280 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:16.400732 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0c49627f-f402-4d6e-88c5-b72d8aed7280 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 51c2747f-a615-42e2-9fb6-13e355306395] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:16.407783 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c49627f-f402-4d6e-88c5-b72d8aed7280 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:16.408234 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c49627f-f402-4d6e-88c5-b72d8aed7280 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:16.409126 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c49627f-f402-4d6e-88c5-b72d8aed7280 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:16.409561 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c49627f-f402-4d6e-88c5-b72d8aed7280 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:16.560228 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0c49627f-f402-4d6e-88c5-b72d8aed7280 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:16.572179 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0c49627f-f402-4d6e-88c5-b72d8aed7280 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:16.574618 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0c49627f-f402-4d6e-88c5-b72d8aed7280 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:16.576442 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0c49627f-f402-4d6e-88c5-b72d8aed7280 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395" status: 200 len: 1598 microversion: 2.20 time: 0.180046 Apr 06 17:01:16.577282 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1505/3004] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:01:16 2022] GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395 => generated 1598 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:01:16.600190 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d48b5478-4104-4efa-8959-8108c213ea42 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:16.600584 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d48b5478-4104-4efa-8959-8108c213ea42 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 51c2747f-a615-42e2-9fb6-13e355306395] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:16.607388 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d48b5478-4104-4efa-8959-8108c213ea42 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:16.607837 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d48b5478-4104-4efa-8959-8108c213ea42 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:16.608601 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d48b5478-4104-4efa-8959-8108c213ea42 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:16.609063 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d48b5478-4104-4efa-8959-8108c213ea42 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:16.699085 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d48b5478-4104-4efa-8959-8108c213ea42 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.103411 Apr 06 17:01:16.699911 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1500/3005] 10.222.0.64 () {60 vars in 1315 bytes} [Wed Apr 6 17:01:16 2022] GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 17:01:16.918824 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fc2060c7-5ec2-45f4-91dd-6b688caece07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:16.919620 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fc2060c7-5ec2-45f4-91dd-6b688caece07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:16.928165 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc2060c7-5ec2-45f4-91dd-6b688caece07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:16.928863 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc2060c7-5ec2-45f4-91dd-6b688caece07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:16.930083 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc2060c7-5ec2-45f4-91dd-6b688caece07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:16.930574 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc2060c7-5ec2-45f4-91dd-6b688caece07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:17.196053 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fc2060c7-5ec2-45f4-91dd-6b688caece07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:17.204587 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fc2060c7-5ec2-45f4-91dd-6b688caece07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.289905 Apr 06 17:01:17.205268 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1506/3006] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:16 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:17.888011 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-b0538385-fea2-47ee-b446-bfcfb7918507 req-d614b77d-42a8-41c3-b0d4-78129d53dc49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51c2747f-a615-42e2-9fb6-13e355306395", "tag": "ece5056b-f8ed-42bb-96c3-81d12b2f0317"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:01:17.896327 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b0538385-fea2-47ee-b446-bfcfb7918507 req-d614b77d-42a8-41c3-b0d4-78129d53dc49 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:17.896803 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b0538385-fea2-47ee-b446-bfcfb7918507 req-d614b77d-42a8-41c3-b0d4-78129d53dc49 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:17.907769 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-b0538385-fea2-47ee-b446-bfcfb7918507 req-d614b77d-42a8-41c3-b0d4-78129d53dc49 service nova] Creating event network-changed:ece5056b-f8ed-42bb-96c3-81d12b2f0317 for instance 51c2747f-a615-42e2-9fb6-13e355306395 on hv-cinder-83684 Apr 06 17:01:17.913193 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-b0538385-fea2-47ee-b446-bfcfb7918507 req-d614b77d-42a8-41c3-b0d4-78129d53dc49 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088007 Apr 06 17:01:17.913909 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1501/3007] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:01:18.231339 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-423d8614-7ff7-4482-80d4-02d298e107fe tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:18.232042 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-423d8614-7ff7-4482-80d4-02d298e107fe tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:18.238584 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-423d8614-7ff7-4482-80d4-02d298e107fe tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:18.239023 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-423d8614-7ff7-4482-80d4-02d298e107fe tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:18.239787 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-423d8614-7ff7-4482-80d4-02d298e107fe tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:18.240233 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-423d8614-7ff7-4482-80d4-02d298e107fe tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:18.398430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-423d8614-7ff7-4482-80d4-02d298e107fe tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:18.409309 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-423d8614-7ff7-4482-80d4-02d298e107fe tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.182148 Apr 06 17:01:18.410079 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1507/3008] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:18 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:19.432746 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c84fde74-1f1d-435a-bed3-c2f0b5d0846c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:19.434287 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c84fde74-1f1d-435a-bed3-c2f0b5d0846c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:19.441832 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c84fde74-1f1d-435a-bed3-c2f0b5d0846c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:19.442420 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c84fde74-1f1d-435a-bed3-c2f0b5d0846c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:19.443220 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c84fde74-1f1d-435a-bed3-c2f0b5d0846c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:19.443661 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c84fde74-1f1d-435a-bed3-c2f0b5d0846c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:19.590681 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c84fde74-1f1d-435a-bed3-c2f0b5d0846c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:19.603009 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c84fde74-1f1d-435a-bed3-c2f0b5d0846c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.177989 Apr 06 17:01:19.603894 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1502/3009] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:19 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:20.626129 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e490c20c-82b9-4c8e-ab87-1b56fd63b3bf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:20.627186 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e490c20c-82b9-4c8e-ab87-1b56fd63b3bf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:20.637887 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e490c20c-82b9-4c8e-ab87-1b56fd63b3bf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:20.638633 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e490c20c-82b9-4c8e-ab87-1b56fd63b3bf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:20.639903 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e490c20c-82b9-4c8e-ab87-1b56fd63b3bf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:20.640749 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e490c20c-82b9-4c8e-ab87-1b56fd63b3bf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:20.789922 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e490c20c-82b9-4c8e-ab87-1b56fd63b3bf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:20.802195 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e490c20c-82b9-4c8e-ab87-1b56fd63b3bf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.182739 Apr 06 17:01:20.802845 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1508/3010] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:20 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:21.824066 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6224a014-eacb-4b3c-ac0e-c6244e19592f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:21.825094 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6224a014-eacb-4b3c-ac0e-c6244e19592f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:21.833567 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6224a014-eacb-4b3c-ac0e-c6244e19592f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:21.834020 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6224a014-eacb-4b3c-ac0e-c6244e19592f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:21.834792 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6224a014-eacb-4b3c-ac0e-c6244e19592f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:21.835232 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6224a014-eacb-4b3c-ac0e-c6244e19592f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:21.978966 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6224a014-eacb-4b3c-ac0e-c6244e19592f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:21.988091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6224a014-eacb-4b3c-ac0e-c6244e19592f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.170686 Apr 06 17:01:21.988677 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1503/3011] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:21 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:23.006471 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d8a462c5-5b14-46e2-9d5e-01df3a58ab43 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:23.007080 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d8a462c5-5b14-46e2-9d5e-01df3a58ab43 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:23.013946 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8a462c5-5b14-46e2-9d5e-01df3a58ab43 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:23.014389 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8a462c5-5b14-46e2-9d5e-01df3a58ab43 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:23.015143 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8a462c5-5b14-46e2-9d5e-01df3a58ab43 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:23.015545 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d8a462c5-5b14-46e2-9d5e-01df3a58ab43 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:23.163127 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d8a462c5-5b14-46e2-9d5e-01df3a58ab43 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:23.171699 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d8a462c5-5b14-46e2-9d5e-01df3a58ab43 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.169197 Apr 06 17:01:23.172318 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1509/3012] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:23 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:24.193487 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c4074a43-c189-463a-9e90-767251f3843d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:24.194542 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c4074a43-c189-463a-9e90-767251f3843d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:24.205074 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4074a43-c189-463a-9e90-767251f3843d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:24.205530 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4074a43-c189-463a-9e90-767251f3843d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:24.206314 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4074a43-c189-463a-9e90-767251f3843d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:24.206748 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4074a43-c189-463a-9e90-767251f3843d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:24.354901 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c4074a43-c189-463a-9e90-767251f3843d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:24.363283 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c4074a43-c189-463a-9e90-767251f3843d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.176585 Apr 06 17:01:24.363826 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1504/3013] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:24 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:25.383475 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8f631318-d6d7-4137-bd74-98962ea4a9f8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:25.384294 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8f631318-d6d7-4137-bd74-98962ea4a9f8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:25.393346 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f631318-d6d7-4137-bd74-98962ea4a9f8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:25.393975 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f631318-d6d7-4137-bd74-98962ea4a9f8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:25.395020 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f631318-d6d7-4137-bd74-98962ea4a9f8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:25.395636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8f631318-d6d7-4137-bd74-98962ea4a9f8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:25.549832 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8f631318-d6d7-4137-bd74-98962ea4a9f8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:25.562370 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8f631318-d6d7-4137-bd74-98962ea4a9f8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.183887 Apr 06 17:01:25.563370 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1510/3014] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:25 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:26.590651 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f8e2a984-2f02-45b1-8ed0-08ced53c7332 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:26.591620 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f8e2a984-2f02-45b1-8ed0-08ced53c7332 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:26.602957 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f8e2a984-2f02-45b1-8ed0-08ced53c7332 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:26.603696 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f8e2a984-2f02-45b1-8ed0-08ced53c7332 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:26.605002 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f8e2a984-2f02-45b1-8ed0-08ced53c7332 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:26.605716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f8e2a984-2f02-45b1-8ed0-08ced53c7332 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:26.744482 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f8e2a984-2f02-45b1-8ed0-08ced53c7332 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:26.752878 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f8e2a984-2f02-45b1-8ed0-08ced53c7332 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.168933 Apr 06 17:01:26.753444 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1505/3015] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:26 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:27.779651 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bee8ff69-8d3e-42f5-8f06-fc720cc8e97b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:27.780781 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bee8ff69-8d3e-42f5-8f06-fc720cc8e97b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:27.791507 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bee8ff69-8d3e-42f5-8f06-fc720cc8e97b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:27.792266 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bee8ff69-8d3e-42f5-8f06-fc720cc8e97b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:27.793592 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bee8ff69-8d3e-42f5-8f06-fc720cc8e97b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:27.794320 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bee8ff69-8d3e-42f5-8f06-fc720cc8e97b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:27.941884 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-bee8ff69-8d3e-42f5-8f06-fc720cc8e97b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:27.954261 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bee8ff69-8d3e-42f5-8f06-fc720cc8e97b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.180852 Apr 06 17:01:27.955325 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1511/3016] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:27 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:28.975390 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6088f353-91bc-4898-9f89-5faa41f038dd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:28.976267 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6088f353-91bc-4898-9f89-5faa41f038dd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:28.985234 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6088f353-91bc-4898-9f89-5faa41f038dd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:28.985825 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6088f353-91bc-4898-9f89-5faa41f038dd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:28.986830 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6088f353-91bc-4898-9f89-5faa41f038dd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:28.987404 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6088f353-91bc-4898-9f89-5faa41f038dd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:29.154256 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6088f353-91bc-4898-9f89-5faa41f038dd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:29.163856 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6088f353-91bc-4898-9f89-5faa41f038dd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.194833 Apr 06 17:01:29.164463 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1506/3017] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:28 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:30.182923 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b3e8f313-e389-43b3-b1ef-a0ec31255308 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:30.183596 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b3e8f313-e389-43b3-b1ef-a0ec31255308 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:30.190188 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3e8f313-e389-43b3-b1ef-a0ec31255308 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:30.190638 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3e8f313-e389-43b3-b1ef-a0ec31255308 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:30.191403 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3e8f313-e389-43b3-b1ef-a0ec31255308 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:30.191837 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b3e8f313-e389-43b3-b1ef-a0ec31255308 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:30.364904 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b3e8f313-e389-43b3-b1ef-a0ec31255308 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:30.376368 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b3e8f313-e389-43b3-b1ef-a0ec31255308 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.197737 Apr 06 17:01:30.377192 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1512/3018] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:30 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:31.402290 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0f5cd5ac-fdd2-4a6b-aa19-c9da4c6152ae tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:31.403274 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0f5cd5ac-fdd2-4a6b-aa19-c9da4c6152ae tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:31.413155 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f5cd5ac-fdd2-4a6b-aa19-c9da4c6152ae tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:31.413651 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f5cd5ac-fdd2-4a6b-aa19-c9da4c6152ae tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:31.414426 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f5cd5ac-fdd2-4a6b-aa19-c9da4c6152ae tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:31.414854 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f5cd5ac-fdd2-4a6b-aa19-c9da4c6152ae tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:31.566093 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0f5cd5ac-fdd2-4a6b-aa19-c9da4c6152ae tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:31.574104 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0f5cd5ac-fdd2-4a6b-aa19-c9da4c6152ae tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.178136 Apr 06 17:01:31.574677 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1507/3019] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:31 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:32.596212 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-06a94d9a-fa7f-47a6-8fff-2255fa9112a5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:32.597176 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-06a94d9a-fa7f-47a6-8fff-2255fa9112a5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:32.608249 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06a94d9a-fa7f-47a6-8fff-2255fa9112a5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:32.609078 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06a94d9a-fa7f-47a6-8fff-2255fa9112a5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:32.610373 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06a94d9a-fa7f-47a6-8fff-2255fa9112a5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:32.611190 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-06a94d9a-fa7f-47a6-8fff-2255fa9112a5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:32.762695 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-06a94d9a-fa7f-47a6-8fff-2255fa9112a5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:32.775139 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-06a94d9a-fa7f-47a6-8fff-2255fa9112a5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.185446 Apr 06 17:01:32.775980 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1513/3020] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:32 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:33.797258 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f68ac2a0-ebda-4e54-bc39-b5ed4d4d9734 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:33.798252 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f68ac2a0-ebda-4e54-bc39-b5ed4d4d9734 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:33.805981 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f68ac2a0-ebda-4e54-bc39-b5ed4d4d9734 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:33.806443 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f68ac2a0-ebda-4e54-bc39-b5ed4d4d9734 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:33.807214 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f68ac2a0-ebda-4e54-bc39-b5ed4d4d9734 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:33.807654 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f68ac2a0-ebda-4e54-bc39-b5ed4d4d9734 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:33.949512 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f68ac2a0-ebda-4e54-bc39-b5ed4d4d9734 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:33.957665 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f68ac2a0-ebda-4e54-bc39-b5ed4d4d9734 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.166837 Apr 06 17:01:33.958494 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1508/3021] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:33 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:34.978674 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-777e17dc-eff2-4a4d-bca5-a2bf105cbed5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:34.979384 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-777e17dc-eff2-4a4d-bca5-a2bf105cbed5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:34.988116 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-777e17dc-eff2-4a4d-bca5-a2bf105cbed5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:34.988668 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-777e17dc-eff2-4a4d-bca5-a2bf105cbed5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:34.990159 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-777e17dc-eff2-4a4d-bca5-a2bf105cbed5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:34.990696 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-777e17dc-eff2-4a4d-bca5-a2bf105cbed5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:35.136367 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-777e17dc-eff2-4a4d-bca5-a2bf105cbed5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:35.144344 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-777e17dc-eff2-4a4d-bca5-a2bf105cbed5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.171275 Apr 06 17:01:35.145166 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1514/3022] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:34 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:36.167443 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7a2ca4ea-ed0a-4f1f-a9e0-9375358acf8f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:36.168475 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7a2ca4ea-ed0a-4f1f-a9e0-9375358acf8f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:36.178504 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a2ca4ea-ed0a-4f1f-a9e0-9375358acf8f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:36.178964 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a2ca4ea-ed0a-4f1f-a9e0-9375358acf8f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:36.179741 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a2ca4ea-ed0a-4f1f-a9e0-9375358acf8f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:36.180183 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a2ca4ea-ed0a-4f1f-a9e0-9375358acf8f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:36.329022 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7a2ca4ea-ed0a-4f1f-a9e0-9375358acf8f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:36.337084 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7a2ca4ea-ed0a-4f1f-a9e0-9375358acf8f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.176677 Apr 06 17:01:36.337653 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1509/3023] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:36 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:37.354819 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5dfd9b93-5c42-43a7-b63a-946fe91c8189 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:37.355424 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5dfd9b93-5c42-43a7-b63a-946fe91c8189 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:37.362690 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5dfd9b93-5c42-43a7-b63a-946fe91c8189 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:37.363157 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5dfd9b93-5c42-43a7-b63a-946fe91c8189 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:37.363921 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5dfd9b93-5c42-43a7-b63a-946fe91c8189 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:37.364586 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5dfd9b93-5c42-43a7-b63a-946fe91c8189 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:37.505362 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5dfd9b93-5c42-43a7-b63a-946fe91c8189 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:37.514038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5dfd9b93-5c42-43a7-b63a-946fe91c8189 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.163138 Apr 06 17:01:37.514615 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1515/3024] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:37 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:38.535351 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ca09b890-0611-428d-8a1b-ebf0c6249314 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:38.536350 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ca09b890-0611-428d-8a1b-ebf0c6249314 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:38.543313 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca09b890-0611-428d-8a1b-ebf0c6249314 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:38.543765 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca09b890-0611-428d-8a1b-ebf0c6249314 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:38.544531 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca09b890-0611-428d-8a1b-ebf0c6249314 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:38.545163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca09b890-0611-428d-8a1b-ebf0c6249314 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:38.720059 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ca09b890-0611-428d-8a1b-ebf0c6249314 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:38.728275 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ca09b890-0611-428d-8a1b-ebf0c6249314 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.199469 Apr 06 17:01:38.728889 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1510/3025] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:38 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:39.749863 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-54a86607-8cd7-4873-9f5d-93829d8d52a2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:39.750675 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-54a86607-8cd7-4873-9f5d-93829d8d52a2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:39.761252 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54a86607-8cd7-4873-9f5d-93829d8d52a2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:39.761896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54a86607-8cd7-4873-9f5d-93829d8d52a2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:39.763111 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54a86607-8cd7-4873-9f5d-93829d8d52a2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:39.763757 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54a86607-8cd7-4873-9f5d-93829d8d52a2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:39.914554 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-54a86607-8cd7-4873-9f5d-93829d8d52a2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:39.927208 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-54a86607-8cd7-4873-9f5d-93829d8d52a2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.183851 Apr 06 17:01:39.927775 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1516/3026] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:39 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:40.947556 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8c9c150f-17f3-4144-a7e8-d7b279899588 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:40.948326 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8c9c150f-17f3-4144-a7e8-d7b279899588 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:40.956494 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c9c150f-17f3-4144-a7e8-d7b279899588 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:40.957287 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c9c150f-17f3-4144-a7e8-d7b279899588 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:40.958512 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c9c150f-17f3-4144-a7e8-d7b279899588 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:40.959062 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c9c150f-17f3-4144-a7e8-d7b279899588 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:41.112716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8c9c150f-17f3-4144-a7e8-d7b279899588 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:41.121520 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8c9c150f-17f3-4144-a7e8-d7b279899588 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.179356 Apr 06 17:01:41.122094 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1511/3027] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:40 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:42.143293 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9f214863-1e38-4b7a-bc09-fee9ec002d52 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:42.144275 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9f214863-1e38-4b7a-bc09-fee9ec002d52 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:42.154827 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f214863-1e38-4b7a-bc09-fee9ec002d52 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:42.155573 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f214863-1e38-4b7a-bc09-fee9ec002d52 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:42.156838 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f214863-1e38-4b7a-bc09-fee9ec002d52 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:42.157555 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9f214863-1e38-4b7a-bc09-fee9ec002d52 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:42.310810 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9f214863-1e38-4b7a-bc09-fee9ec002d52 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:42.319432 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9f214863-1e38-4b7a-bc09-fee9ec002d52 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.182755 Apr 06 17:01:42.320016 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1517/3028] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:42 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:43.340069 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-52827a2e-70b5-4e79-bad4-43f727ce953d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:43.340712 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-52827a2e-70b5-4e79-bad4-43f727ce953d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:43.349685 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52827a2e-70b5-4e79-bad4-43f727ce953d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:43.350132 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52827a2e-70b5-4e79-bad4-43f727ce953d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:43.350907 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52827a2e-70b5-4e79-bad4-43f727ce953d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:43.351349 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52827a2e-70b5-4e79-bad4-43f727ce953d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:43.497669 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-52827a2e-70b5-4e79-bad4-43f727ce953d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:43.506459 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-52827a2e-70b5-4e79-bad4-43f727ce953d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.172705 Apr 06 17:01:43.507036 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1512/3029] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:43 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:44.526986 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ecaf62fd-0d4a-423e-9ccd-a538cb98abf9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:44.527818 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ecaf62fd-0d4a-423e-9ccd-a538cb98abf9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:44.537899 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ecaf62fd-0d4a-423e-9ccd-a538cb98abf9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:44.538360 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ecaf62fd-0d4a-423e-9ccd-a538cb98abf9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:44.539123 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ecaf62fd-0d4a-423e-9ccd-a538cb98abf9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:44.539568 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ecaf62fd-0d4a-423e-9ccd-a538cb98abf9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:44.689442 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ecaf62fd-0d4a-423e-9ccd-a538cb98abf9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:44.697953 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ecaf62fd-0d4a-423e-9ccd-a538cb98abf9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.178127 Apr 06 17:01:44.698526 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1518/3030] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:44 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:45.715207 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-56619549-ddfc-42fd-97a3-fd3bddb8bcf2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:45.715819 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-56619549-ddfc-42fd-97a3-fd3bddb8bcf2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:45.722324 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56619549-ddfc-42fd-97a3-fd3bddb8bcf2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:45.722787 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56619549-ddfc-42fd-97a3-fd3bddb8bcf2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:45.723556 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56619549-ddfc-42fd-97a3-fd3bddb8bcf2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:45.724000 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56619549-ddfc-42fd-97a3-fd3bddb8bcf2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:45.990313 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-56619549-ddfc-42fd-97a3-fd3bddb8bcf2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:45.998946 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-56619549-ddfc-42fd-97a3-fd3bddb8bcf2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.287647 Apr 06 17:01:45.999521 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1513/3031] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:45 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:47.019153 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-685c7af4-bbe0-4b35-ba35-8e1ddc5ea141 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:47.019795 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-685c7af4-bbe0-4b35-ba35-8e1ddc5ea141 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:47.026943 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-685c7af4-bbe0-4b35-ba35-8e1ddc5ea141 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:47.027428 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-685c7af4-bbe0-4b35-ba35-8e1ddc5ea141 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:47.028196 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-685c7af4-bbe0-4b35-ba35-8e1ddc5ea141 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:47.028634 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-685c7af4-bbe0-4b35-ba35-8e1ddc5ea141 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:47.168587 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-685c7af4-bbe0-4b35-ba35-8e1ddc5ea141 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:47.176896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-685c7af4-bbe0-4b35-ba35-8e1ddc5ea141 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.161746 Apr 06 17:01:47.177565 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1519/3032] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:47 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:48.198725 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fc2edcca-fa2a-44b1-aa06-3093f1f2573d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:48.199704 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fc2edcca-fa2a-44b1-aa06-3093f1f2573d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:48.209966 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc2edcca-fa2a-44b1-aa06-3093f1f2573d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:48.210417 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc2edcca-fa2a-44b1-aa06-3093f1f2573d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:48.211189 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc2edcca-fa2a-44b1-aa06-3093f1f2573d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:48.211626 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc2edcca-fa2a-44b1-aa06-3093f1f2573d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:48.353055 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fc2edcca-fa2a-44b1-aa06-3093f1f2573d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:48.361498 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fc2edcca-fa2a-44b1-aa06-3093f1f2573d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.169681 Apr 06 17:01:48.362075 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1514/3033] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:48 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:49.382106 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-52d4eebe-ce4d-4160-a09f-e55ae9f56c0f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:49.382676 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-52d4eebe-ce4d-4160-a09f-e55ae9f56c0f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:49.389606 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52d4eebe-ce4d-4160-a09f-e55ae9f56c0f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:49.390059 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52d4eebe-ce4d-4160-a09f-e55ae9f56c0f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:49.390815 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52d4eebe-ce4d-4160-a09f-e55ae9f56c0f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:49.391268 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52d4eebe-ce4d-4160-a09f-e55ae9f56c0f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:49.535515 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-52d4eebe-ce4d-4160-a09f-e55ae9f56c0f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:49.544874 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-52d4eebe-ce4d-4160-a09f-e55ae9f56c0f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.168194 Apr 06 17:01:49.545957 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1520/3034] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:49 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:50.568991 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-be6d41ce-20b7-4ee6-b97f-a6b2c3239a28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:50.569619 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-be6d41ce-20b7-4ee6-b97f-a6b2c3239a28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:50.576966 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be6d41ce-20b7-4ee6-b97f-a6b2c3239a28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:50.577441 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be6d41ce-20b7-4ee6-b97f-a6b2c3239a28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:50.578253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be6d41ce-20b7-4ee6-b97f-a6b2c3239a28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:50.578718 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be6d41ce-20b7-4ee6-b97f-a6b2c3239a28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:50.725549 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-be6d41ce-20b7-4ee6-b97f-a6b2c3239a28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:50.734512 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-be6d41ce-20b7-4ee6-b97f-a6b2c3239a28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.172301 Apr 06 17:01:50.735066 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1515/3035] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:50 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:51.757439 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d4ccd72c-c30a-4437-b0a7-6f8e622e4aed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:51.758401 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d4ccd72c-c30a-4437-b0a7-6f8e622e4aed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:51.768841 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4ccd72c-c30a-4437-b0a7-6f8e622e4aed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:51.769555 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4ccd72c-c30a-4437-b0a7-6f8e622e4aed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:51.770809 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4ccd72c-c30a-4437-b0a7-6f8e622e4aed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:51.771505 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d4ccd72c-c30a-4437-b0a7-6f8e622e4aed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:51.921643 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d4ccd72c-c30a-4437-b0a7-6f8e622e4aed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:51.930733 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d4ccd72c-c30a-4437-b0a7-6f8e622e4aed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.180109 Apr 06 17:01:51.931286 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1521/3036] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:51 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:52.958654 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b166da08-9282-4eef-95dc-95004af68976 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:52.960080 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b166da08-9282-4eef-95dc-95004af68976 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:52.971069 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b166da08-9282-4eef-95dc-95004af68976 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:52.971874 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b166da08-9282-4eef-95dc-95004af68976 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:52.973217 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b166da08-9282-4eef-95dc-95004af68976 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:52.973938 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b166da08-9282-4eef-95dc-95004af68976 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:53.118018 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b166da08-9282-4eef-95dc-95004af68976 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:53.127487 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b166da08-9282-4eef-95dc-95004af68976 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.175403 Apr 06 17:01:53.128065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1516/3037] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:52 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:54.073886 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e9a44f77-4e14-4fb9-b638-0891d7485e20 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:54.074687 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e9a44f77-4e14-4fb9-b638-0891d7485e20 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 51c2747f-a615-42e2-9fb6-13e355306395] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:54.085366 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9a44f77-4e14-4fb9-b638-0891d7485e20 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:54.085809 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9a44f77-4e14-4fb9-b638-0891d7485e20 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:54.086579 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9a44f77-4e14-4fb9-b638-0891d7485e20 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:54.087008 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9a44f77-4e14-4fb9-b638-0891d7485e20 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:54.110338 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e9a44f77-4e14-4fb9-b638-0891d7485e20 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395/ips" status: 200 len: 151 microversion: 2.20 time: 0.041802 Apr 06 17:01:54.110911 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1522/3038] 10.222.0.64 () {60 vars in 1288 bytes} [Wed Apr 6 17:01:54 2022] GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 06 17:01:54.146530 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8f6c2fdc-eaea-43c9-8557-705e24409651 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:54.147255 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8f6c2fdc-eaea-43c9-8557-705e24409651 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:54.154048 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f6c2fdc-eaea-43c9-8557-705e24409651 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:54.154504 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f6c2fdc-eaea-43c9-8557-705e24409651 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:54.155278 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f6c2fdc-eaea-43c9-8557-705e24409651 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:54.155719 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f6c2fdc-eaea-43c9-8557-705e24409651 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:54.301532 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8f6c2fdc-eaea-43c9-8557-705e24409651 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:54.310228 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8f6c2fdc-eaea-43c9-8557-705e24409651 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.167542 Apr 06 17:01:54.310797 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1517/3039] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:54 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:55.329704 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b308dd54-31eb-41d2-8113-fad2089b0b1a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:55.330564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b308dd54-31eb-41d2-8113-fad2089b0b1a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:55.337272 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b308dd54-31eb-41d2-8113-fad2089b0b1a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:55.337741 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b308dd54-31eb-41d2-8113-fad2089b0b1a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:55.338494 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b308dd54-31eb-41d2-8113-fad2089b0b1a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:55.338922 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b308dd54-31eb-41d2-8113-fad2089b0b1a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:55.493017 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b308dd54-31eb-41d2-8113-fad2089b0b1a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:55.501676 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b308dd54-31eb-41d2-8113-fad2089b0b1a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.175964 Apr 06 17:01:55.502260 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1523/3040] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:55 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:56.519833 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-602abe82-0cbf-4623-aaf9-eb260eb65251 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:56.520419 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-602abe82-0cbf-4623-aaf9-eb260eb65251 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:56.527413 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-602abe82-0cbf-4623-aaf9-eb260eb65251 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:56.527857 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-602abe82-0cbf-4623-aaf9-eb260eb65251 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:56.528613 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-602abe82-0cbf-4623-aaf9-eb260eb65251 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:56.529079 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-602abe82-0cbf-4623-aaf9-eb260eb65251 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:56.674580 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-602abe82-0cbf-4623-aaf9-eb260eb65251 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:56.687339 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-602abe82-0cbf-4623-aaf9-eb260eb65251 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.171236 Apr 06 17:01:56.688070 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1518/3041] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:56 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:57.709766 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b9c5de6b-c386-473a-b45d-013e1f6ceccc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:57.710773 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b9c5de6b-c386-473a-b45d-013e1f6ceccc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:57.717785 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9c5de6b-c386-473a-b45d-013e1f6ceccc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:57.718271 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9c5de6b-c386-473a-b45d-013e1f6ceccc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:57.719046 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9c5de6b-c386-473a-b45d-013e1f6ceccc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:57.719483 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b9c5de6b-c386-473a-b45d-013e1f6ceccc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:57.875634 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b9c5de6b-c386-473a-b45d-013e1f6ceccc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:57.888193 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b9c5de6b-c386-473a-b45d-013e1f6ceccc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.184827 Apr 06 17:01:57.889064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1524/3042] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:57 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:01:58.913608 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-456c01af-b6da-4577-b8eb-b088fc55b54e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:01:58.914657 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-456c01af-b6da-4577-b8eb-b088fc55b54e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:01:58.921515 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-456c01af-b6da-4577-b8eb-b088fc55b54e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:58.921956 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-456c01af-b6da-4577-b8eb-b088fc55b54e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:58.922713 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-456c01af-b6da-4577-b8eb-b088fc55b54e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:01:58.923139 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-456c01af-b6da-4577-b8eb-b088fc55b54e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:01:59.065529 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-456c01af-b6da-4577-b8eb-b088fc55b54e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:01:59.074477 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-456c01af-b6da-4577-b8eb-b088fc55b54e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.167480 Apr 06 17:01:59.075070 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1519/3043] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:01:58 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:00.095663 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bd7e217b-a023-45f2-9b6a-5a624405796f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:00.096635 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bd7e217b-a023-45f2-9b6a-5a624405796f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:00.108596 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd7e217b-a023-45f2-9b6a-5a624405796f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:00.109390 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd7e217b-a023-45f2-9b6a-5a624405796f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:00.110634 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd7e217b-a023-45f2-9b6a-5a624405796f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:00.111367 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bd7e217b-a023-45f2-9b6a-5a624405796f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:00.247126 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-bd7e217b-a023-45f2-9b6a-5a624405796f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:00.255534 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bd7e217b-a023-45f2-9b6a-5a624405796f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.166382 Apr 06 17:02:00.256125 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1525/3044] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:00 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:01.275050 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-18800986-1466-444b-9367-ca506b05ee08 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:01.275647 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-18800986-1466-444b-9367-ca506b05ee08 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:01.282235 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18800986-1466-444b-9367-ca506b05ee08 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:01.282695 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18800986-1466-444b-9367-ca506b05ee08 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:01.283495 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18800986-1466-444b-9367-ca506b05ee08 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:01.283917 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18800986-1466-444b-9367-ca506b05ee08 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:01.431362 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-18800986-1466-444b-9367-ca506b05ee08 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:01.439756 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-18800986-1466-444b-9367-ca506b05ee08 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.170360 Apr 06 17:02:01.440337 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1520/3045] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:01 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:02.466347 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-03631256-1a5c-45b5-85f9-48b19e610888 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:02.467261 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-03631256-1a5c-45b5-85f9-48b19e610888 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:02.477685 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03631256-1a5c-45b5-85f9-48b19e610888 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:02.478445 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03631256-1a5c-45b5-85f9-48b19e610888 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:02.479310 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03631256-1a5c-45b5-85f9-48b19e610888 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:02.479739 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03631256-1a5c-45b5-85f9-48b19e610888 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:02.626843 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-03631256-1a5c-45b5-85f9-48b19e610888 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:02.635277 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-03631256-1a5c-45b5-85f9-48b19e610888 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.175639 Apr 06 17:02:02.635848 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1526/3046] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:02 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:03.661766 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-174e45df-5540-41a7-9f25-68a635058506 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:03.662694 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-174e45df-5540-41a7-9f25-68a635058506 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:03.673767 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-174e45df-5540-41a7-9f25-68a635058506 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:03.674526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-174e45df-5540-41a7-9f25-68a635058506 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:03.675796 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-174e45df-5540-41a7-9f25-68a635058506 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:03.676526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-174e45df-5540-41a7-9f25-68a635058506 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:03.823465 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-174e45df-5540-41a7-9f25-68a635058506 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:03.837255 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-174e45df-5540-41a7-9f25-68a635058506 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.181642 Apr 06 17:02:03.837916 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1521/3047] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:03 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:04.857952 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cf0f218d-fa09-4c12-98b6-f03339915518 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:04.858574 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cf0f218d-fa09-4c12-98b6-f03339915518 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:04.865102 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf0f218d-fa09-4c12-98b6-f03339915518 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:04.865554 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf0f218d-fa09-4c12-98b6-f03339915518 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:04.866344 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf0f218d-fa09-4c12-98b6-f03339915518 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:04.866777 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cf0f218d-fa09-4c12-98b6-f03339915518 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:05.011288 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-cf0f218d-fa09-4c12-98b6-f03339915518 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:05.019959 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cf0f218d-fa09-4c12-98b6-f03339915518 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.167298 Apr 06 17:02:05.020530 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1527/3048] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:04 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:06.041592 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4986ddf4-f7c1-471d-9d79-b6e7af6c2549 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:06.042776 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4986ddf4-f7c1-471d-9d79-b6e7af6c2549 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:06.053412 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4986ddf4-f7c1-471d-9d79-b6e7af6c2549 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:06.054150 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4986ddf4-f7c1-471d-9d79-b6e7af6c2549 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:06.055397 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4986ddf4-f7c1-471d-9d79-b6e7af6c2549 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:06.056108 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4986ddf4-f7c1-471d-9d79-b6e7af6c2549 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:06.212593 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4986ddf4-f7c1-471d-9d79-b6e7af6c2549 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:06.221325 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4986ddf4-f7c1-471d-9d79-b6e7af6c2549 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.186160 Apr 06 17:02:06.221895 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1522/3049] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:06 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:07.239746 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ff8c2c63-58ac-4dec-a11a-0bbe345ef36d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:07.240400 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ff8c2c63-58ac-4dec-a11a-0bbe345ef36d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:07.248377 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff8c2c63-58ac-4dec-a11a-0bbe345ef36d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:07.248898 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff8c2c63-58ac-4dec-a11a-0bbe345ef36d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:07.249704 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff8c2c63-58ac-4dec-a11a-0bbe345ef36d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:07.250161 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff8c2c63-58ac-4dec-a11a-0bbe345ef36d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:07.392768 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ff8c2c63-58ac-4dec-a11a-0bbe345ef36d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:07.400870 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ff8c2c63-58ac-4dec-a11a-0bbe345ef36d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.165194 Apr 06 17:02:07.401437 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1528/3050] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:07 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:08.419709 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e05a6b33-37bc-497f-a85f-a87aff13ab4a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:08.420296 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e05a6b33-37bc-497f-a85f-a87aff13ab4a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:08.427189 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e05a6b33-37bc-497f-a85f-a87aff13ab4a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:08.427649 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e05a6b33-37bc-497f-a85f-a87aff13ab4a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:08.428411 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e05a6b33-37bc-497f-a85f-a87aff13ab4a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:08.428889 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e05a6b33-37bc-497f-a85f-a87aff13ab4a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:08.579819 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e05a6b33-37bc-497f-a85f-a87aff13ab4a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:08.588644 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e05a6b33-37bc-497f-a85f-a87aff13ab4a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.173326 Apr 06 17:02:08.589195 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1523/3051] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:08 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:09.612471 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0bb8657b-9194-4d55-a1d5-6e4656355aff tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:09.613119 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0bb8657b-9194-4d55-a1d5-6e4656355aff tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:09.620184 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bb8657b-9194-4d55-a1d5-6e4656355aff tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:09.620633 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bb8657b-9194-4d55-a1d5-6e4656355aff tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:09.621458 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bb8657b-9194-4d55-a1d5-6e4656355aff tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:09.621889 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bb8657b-9194-4d55-a1d5-6e4656355aff tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:09.780234 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0bb8657b-9194-4d55-a1d5-6e4656355aff tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:09.793344 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0bb8657b-9194-4d55-a1d5-6e4656355aff tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.184579 Apr 06 17:02:09.794223 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1529/3052] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:09 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:10.815737 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fcf01102-f231-4be6-813c-bb3f38f92aa7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:10.816723 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fcf01102-f231-4be6-813c-bb3f38f92aa7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:10.825910 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcf01102-f231-4be6-813c-bb3f38f92aa7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:10.826357 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcf01102-f231-4be6-813c-bb3f38f92aa7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:10.827115 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcf01102-f231-4be6-813c-bb3f38f92aa7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:10.827542 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcf01102-f231-4be6-813c-bb3f38f92aa7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:10.967383 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fcf01102-f231-4be6-813c-bb3f38f92aa7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:10.979153 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fcf01102-f231-4be6-813c-bb3f38f92aa7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.169920 Apr 06 17:02:10.979777 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1524/3053] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:10 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:12.002561 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-03d4d371-37fc-44f5-850d-154243177241 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:12.003211 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-03d4d371-37fc-44f5-850d-154243177241 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:12.009751 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03d4d371-37fc-44f5-850d-154243177241 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:12.010242 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03d4d371-37fc-44f5-850d-154243177241 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:12.011001 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03d4d371-37fc-44f5-850d-154243177241 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:12.011428 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03d4d371-37fc-44f5-850d-154243177241 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:12.160133 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-03d4d371-37fc-44f5-850d-154243177241 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:12.168613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-03d4d371-37fc-44f5-850d-154243177241 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.170162 Apr 06 17:02:12.169229 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1530/3054] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:11 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:12.948141 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:02:12.948577 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 17:02:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:02:13.195969 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d3b88c60-6aee-452f-8f77-75ef26b1299a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:13.197030 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d3b88c60-6aee-452f-8f77-75ef26b1299a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:13.203706 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3b88c60-6aee-452f-8f77-75ef26b1299a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:13.204084 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3b88c60-6aee-452f-8f77-75ef26b1299a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:13.204882 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3b88c60-6aee-452f-8f77-75ef26b1299a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:13.205341 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3b88c60-6aee-452f-8f77-75ef26b1299a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:13.343780 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d3b88c60-6aee-452f-8f77-75ef26b1299a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:13.352064 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d3b88c60-6aee-452f-8f77-75ef26b1299a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.163055 Apr 06 17:02:13.352607 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1525/3055] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:13 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:14.371586 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-54c7d6c7-0b8c-464d-948b-63a178592ed2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:14.373897 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-54c7d6c7-0b8c-464d-948b-63a178592ed2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:14.388375 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54c7d6c7-0b8c-464d-948b-63a178592ed2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:14.389140 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54c7d6c7-0b8c-464d-948b-63a178592ed2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:14.390250 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54c7d6c7-0b8c-464d-948b-63a178592ed2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:14.390965 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-54c7d6c7-0b8c-464d-948b-63a178592ed2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:14.545548 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-54c7d6c7-0b8c-464d-948b-63a178592ed2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:14.561363 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-54c7d6c7-0b8c-464d-948b-63a178592ed2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.194422 Apr 06 17:02:14.562218 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1531/3056] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:14 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:15.586588 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-92c9d0a3-4eb0-41c3-9a2d-50f061e26f7e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:15.587704 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-92c9d0a3-4eb0-41c3-9a2d-50f061e26f7e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:15.594878 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92c9d0a3-4eb0-41c3-9a2d-50f061e26f7e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:15.595350 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92c9d0a3-4eb0-41c3-9a2d-50f061e26f7e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:15.596148 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92c9d0a3-4eb0-41c3-9a2d-50f061e26f7e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:15.596596 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92c9d0a3-4eb0-41c3-9a2d-50f061e26f7e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:15.744037 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-92c9d0a3-4eb0-41c3-9a2d-50f061e26f7e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:15.752001 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-92c9d0a3-4eb0-41c3-9a2d-50f061e26f7e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.172251 Apr 06 17:02:15.752559 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1526/3057] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:15 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:16.773006 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7fffc57d-df3e-4987-bd1a-85a04bbaee5d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:16.773630 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7fffc57d-df3e-4987-bd1a-85a04bbaee5d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:16.783971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fffc57d-df3e-4987-bd1a-85a04bbaee5d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:16.784577 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fffc57d-df3e-4987-bd1a-85a04bbaee5d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:16.785761 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fffc57d-df3e-4987-bd1a-85a04bbaee5d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:16.786209 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7fffc57d-df3e-4987-bd1a-85a04bbaee5d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:16.944843 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7fffc57d-df3e-4987-bd1a-85a04bbaee5d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:16.953500 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7fffc57d-df3e-4987-bd1a-85a04bbaee5d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.187196 Apr 06 17:02:16.954081 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1532/3058] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:16 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:17.975083 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b48d63f7-d80d-458a-802b-92a3976e68e9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:17.976071 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b48d63f7-d80d-458a-802b-92a3976e68e9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:17.987859 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b48d63f7-d80d-458a-802b-92a3976e68e9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:17.988601 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b48d63f7-d80d-458a-802b-92a3976e68e9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:17.989927 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b48d63f7-d80d-458a-802b-92a3976e68e9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:17.990643 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b48d63f7-d80d-458a-802b-92a3976e68e9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:18.140798 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b48d63f7-d80d-458a-802b-92a3976e68e9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:18.149404 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b48d63f7-d80d-458a-802b-92a3976e68e9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.180772 Apr 06 17:02:18.150196 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1527/3059] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:17 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:19.170428 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-03d410c8-8a19-4631-b21f-70d06c9cea02 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:19.171164 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-03d410c8-8a19-4631-b21f-70d06c9cea02 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:19.179428 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03d410c8-8a19-4631-b21f-70d06c9cea02 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:19.179958 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03d410c8-8a19-4631-b21f-70d06c9cea02 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:19.180961 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03d410c8-8a19-4631-b21f-70d06c9cea02 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:19.181604 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-03d410c8-8a19-4631-b21f-70d06c9cea02 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:19.333726 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-03d410c8-8a19-4631-b21f-70d06c9cea02 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:19.342456 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-03d410c8-8a19-4631-b21f-70d06c9cea02 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.177422 Apr 06 17:02:19.342754 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1533/3060] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:19 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:20.359722 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-31f3d6b0-8945-4e19-93d9-e1ac95c64be3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:20.360232 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-31f3d6b0-8945-4e19-93d9-e1ac95c64be3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:20.367061 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31f3d6b0-8945-4e19-93d9-e1ac95c64be3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:20.367509 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31f3d6b0-8945-4e19-93d9-e1ac95c64be3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:20.368259 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31f3d6b0-8945-4e19-93d9-e1ac95c64be3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:20.368825 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31f3d6b0-8945-4e19-93d9-e1ac95c64be3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:20.511224 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-31f3d6b0-8945-4e19-93d9-e1ac95c64be3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:20.519219 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-31f3d6b0-8945-4e19-93d9-e1ac95c64be3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.163911 Apr 06 17:02:20.519791 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1528/3061] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:20 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:21.546376 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cb4461d9-12a1-4a87-a857-04f10a00eba5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:21.546960 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cb4461d9-12a1-4a87-a857-04f10a00eba5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:21.553527 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb4461d9-12a1-4a87-a857-04f10a00eba5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:21.553983 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb4461d9-12a1-4a87-a857-04f10a00eba5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:21.554762 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb4461d9-12a1-4a87-a857-04f10a00eba5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:21.555201 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cb4461d9-12a1-4a87-a857-04f10a00eba5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:21.701092 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-cb4461d9-12a1-4a87-a857-04f10a00eba5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:21.709637 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cb4461d9-12a1-4a87-a857-04f10a00eba5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.167230 Apr 06 17:02:21.710197 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1534/3062] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:21 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:22.730079 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-53559e01-6db3-40f0-814a-939adddddba9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:22.730699 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-53559e01-6db3-40f0-814a-939adddddba9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:22.737696 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53559e01-6db3-40f0-814a-939adddddba9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:22.738151 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53559e01-6db3-40f0-814a-939adddddba9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:22.740095 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53559e01-6db3-40f0-814a-939adddddba9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:22.740095 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53559e01-6db3-40f0-814a-939adddddba9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:22.880060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-53559e01-6db3-40f0-814a-939adddddba9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:22.889583 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-53559e01-6db3-40f0-814a-939adddddba9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.164775 Apr 06 17:02:22.890151 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1529/3063] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:22 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:23.908727 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b73d218f-9143-47ac-8263-d4387d312475 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:23.909480 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b73d218f-9143-47ac-8263-d4387d312475 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:23.918022 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b73d218f-9143-47ac-8263-d4387d312475 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:23.918588 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b73d218f-9143-47ac-8263-d4387d312475 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:23.919544 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b73d218f-9143-47ac-8263-d4387d312475 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:23.920084 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b73d218f-9143-47ac-8263-d4387d312475 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:24.068742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b73d218f-9143-47ac-8263-d4387d312475 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:24.081258 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b73d218f-9143-47ac-8263-d4387d312475 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.177221 Apr 06 17:02:24.082103 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1535/3064] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:23 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:25.102157 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-60333d61-0514-45b2-8232-6c2158c47ff5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:25.102768 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-60333d61-0514-45b2-8232-6c2158c47ff5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:25.112427 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60333d61-0514-45b2-8232-6c2158c47ff5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:25.113082 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60333d61-0514-45b2-8232-6c2158c47ff5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:25.113860 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60333d61-0514-45b2-8232-6c2158c47ff5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:25.114292 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60333d61-0514-45b2-8232-6c2158c47ff5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:25.259600 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-60333d61-0514-45b2-8232-6c2158c47ff5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:25.268309 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-60333d61-0514-45b2-8232-6c2158c47ff5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.170490 Apr 06 17:02:25.268918 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1530/3065] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:25 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:26.286592 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-486e6a5b-b69f-4565-b6d5-9ded907f64dd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:26.287247 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-486e6a5b-b69f-4565-b6d5-9ded907f64dd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:26.295038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-486e6a5b-b69f-4565-b6d5-9ded907f64dd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:26.295489 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-486e6a5b-b69f-4565-b6d5-9ded907f64dd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:26.296249 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-486e6a5b-b69f-4565-b6d5-9ded907f64dd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:26.296704 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-486e6a5b-b69f-4565-b6d5-9ded907f64dd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:26.453835 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-486e6a5b-b69f-4565-b6d5-9ded907f64dd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:26.466082 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-486e6a5b-b69f-4565-b6d5-9ded907f64dd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.183225 Apr 06 17:02:26.466852 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1536/3066] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:26 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:27.492652 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fca97b04-068e-4c4b-ae6f-e123cd8e9c15 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:27.493654 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fca97b04-068e-4c4b-ae6f-e123cd8e9c15 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:27.501486 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fca97b04-068e-4c4b-ae6f-e123cd8e9c15 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:27.501933 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fca97b04-068e-4c4b-ae6f-e123cd8e9c15 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:27.502690 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fca97b04-068e-4c4b-ae6f-e123cd8e9c15 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:27.503127 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fca97b04-068e-4c4b-ae6f-e123cd8e9c15 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:27.647122 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fca97b04-068e-4c4b-ae6f-e123cd8e9c15 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:27.658040 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fca97b04-068e-4c4b-ae6f-e123cd8e9c15 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.171893 Apr 06 17:02:27.658634 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1531/3067] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:27 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:28.677087 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c53605cc-5b24-4fcf-ac32-b3bbd9f1c3ff tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:28.677774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c53605cc-5b24-4fcf-ac32-b3bbd9f1c3ff tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:28.685300 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c53605cc-5b24-4fcf-ac32-b3bbd9f1c3ff tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:28.685809 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c53605cc-5b24-4fcf-ac32-b3bbd9f1c3ff tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:28.686654 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c53605cc-5b24-4fcf-ac32-b3bbd9f1c3ff tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:28.687139 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c53605cc-5b24-4fcf-ac32-b3bbd9f1c3ff tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:28.830671 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c53605cc-5b24-4fcf-ac32-b3bbd9f1c3ff tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:28.843230 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c53605cc-5b24-4fcf-ac32-b3bbd9f1c3ff tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.170223 Apr 06 17:02:28.843985 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1537/3068] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:28 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:29.866413 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b6465f29-485a-405e-b313-cbbaf3bacb44 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:29.867525 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b6465f29-485a-405e-b313-cbbaf3bacb44 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:29.875792 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6465f29-485a-405e-b313-cbbaf3bacb44 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:29.876249 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6465f29-485a-405e-b313-cbbaf3bacb44 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:29.877059 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6465f29-485a-405e-b313-cbbaf3bacb44 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:29.877501 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6465f29-485a-405e-b313-cbbaf3bacb44 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:30.030564 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b6465f29-485a-405e-b313-cbbaf3bacb44 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:30.038828 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b6465f29-485a-405e-b313-cbbaf3bacb44 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.178976 Apr 06 17:02:30.039425 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1532/3069] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:29 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:31.055807 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cd76bfc7-ec77-45e2-a7c5-3ebba500b10f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:31.056416 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cd76bfc7-ec77-45e2-a7c5-3ebba500b10f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:31.063354 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd76bfc7-ec77-45e2-a7c5-3ebba500b10f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:31.063781 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd76bfc7-ec77-45e2-a7c5-3ebba500b10f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:31.064552 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd76bfc7-ec77-45e2-a7c5-3ebba500b10f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:31.065025 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cd76bfc7-ec77-45e2-a7c5-3ebba500b10f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:31.214163 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-cd76bfc7-ec77-45e2-a7c5-3ebba500b10f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:31.223397 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cd76bfc7-ec77-45e2-a7c5-3ebba500b10f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.171577 Apr 06 17:02:31.223976 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1538/3070] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:31 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:32.242461 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f5f867cf-5317-427f-bdb4-8dcdadac27a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:32.243142 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f5f867cf-5317-427f-bdb4-8dcdadac27a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:32.250376 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5f867cf-5317-427f-bdb4-8dcdadac27a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:32.250858 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5f867cf-5317-427f-bdb4-8dcdadac27a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:32.251651 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5f867cf-5317-427f-bdb4-8dcdadac27a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:32.252087 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5f867cf-5317-427f-bdb4-8dcdadac27a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:32.412764 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f5f867cf-5317-427f-bdb4-8dcdadac27a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:32.423857 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f5f867cf-5317-427f-bdb4-8dcdadac27a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.185445 Apr 06 17:02:32.424437 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1533/3071] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:32 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:33.445568 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c3af261b-9e90-49ac-8f45-3843afa0e8e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:33.446767 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c3af261b-9e90-49ac-8f45-3843afa0e8e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:33.457809 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3af261b-9e90-49ac-8f45-3843afa0e8e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:33.458576 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3af261b-9e90-49ac-8f45-3843afa0e8e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:33.459846 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3af261b-9e90-49ac-8f45-3843afa0e8e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:33.460576 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c3af261b-9e90-49ac-8f45-3843afa0e8e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:33.606013 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c3af261b-9e90-49ac-8f45-3843afa0e8e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:33.614628 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c3af261b-9e90-49ac-8f45-3843afa0e8e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.175682 Apr 06 17:02:33.615202 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1539/3072] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:33 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:34.635643 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0e5cd650-5473-4015-bc9e-6203d55efbe0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:34.636590 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0e5cd650-5473-4015-bc9e-6203d55efbe0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:34.644246 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e5cd650-5473-4015-bc9e-6203d55efbe0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:34.644713 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e5cd650-5473-4015-bc9e-6203d55efbe0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:34.645478 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e5cd650-5473-4015-bc9e-6203d55efbe0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:34.645904 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e5cd650-5473-4015-bc9e-6203d55efbe0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:34.782944 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0e5cd650-5473-4015-bc9e-6203d55efbe0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:34.790850 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0e5cd650-5473-4015-bc9e-6203d55efbe0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.161712 Apr 06 17:02:34.791417 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1534/3073] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:34 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:35.812253 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dbc90b18-14d9-4812-bbbf-db72d3ef45e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:35.812967 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dbc90b18-14d9-4812-bbbf-db72d3ef45e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:35.819715 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbc90b18-14d9-4812-bbbf-db72d3ef45e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:35.820163 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbc90b18-14d9-4812-bbbf-db72d3ef45e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:35.820963 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbc90b18-14d9-4812-bbbf-db72d3ef45e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:35.821394 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dbc90b18-14d9-4812-bbbf-db72d3ef45e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:35.977124 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-dbc90b18-14d9-4812-bbbf-db72d3ef45e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:35.985545 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dbc90b18-14d9-4812-bbbf-db72d3ef45e4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.179640 Apr 06 17:02:35.986108 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1540/3074] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:35 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:37.003132 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4fed50f5-9dc9-4cc8-8e38-a3d0a0c5a512 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:37.003816 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4fed50f5-9dc9-4cc8-8e38-a3d0a0c5a512 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:37.010611 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fed50f5-9dc9-4cc8-8e38-a3d0a0c5a512 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:37.011068 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fed50f5-9dc9-4cc8-8e38-a3d0a0c5a512 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:37.011844 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fed50f5-9dc9-4cc8-8e38-a3d0a0c5a512 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:37.012530 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fed50f5-9dc9-4cc8-8e38-a3d0a0c5a512 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:37.158795 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4fed50f5-9dc9-4cc8-8e38-a3d0a0c5a512 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:37.166662 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4fed50f5-9dc9-4cc8-8e38-a3d0a0c5a512 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.167619 Apr 06 17:02:37.167229 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1535/3075] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:36 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:38.187989 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5b60e0cc-4f75-4ce3-a1d9-56c5cbe0fcec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:38.188636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5b60e0cc-4f75-4ce3-a1d9-56c5cbe0fcec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:38.195469 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b60e0cc-4f75-4ce3-a1d9-56c5cbe0fcec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:38.195923 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b60e0cc-4f75-4ce3-a1d9-56c5cbe0fcec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:38.196706 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b60e0cc-4f75-4ce3-a1d9-56c5cbe0fcec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:38.197153 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5b60e0cc-4f75-4ce3-a1d9-56c5cbe0fcec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:38.348930 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5b60e0cc-4f75-4ce3-a1d9-56c5cbe0fcec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:38.357651 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5b60e0cc-4f75-4ce3-a1d9-56c5cbe0fcec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.175668 Apr 06 17:02:38.358422 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1541/3076] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:38 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:39.378038 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-344009a0-d19d-487b-b44c-9066cf2c786b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:39.378654 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-344009a0-d19d-487b-b44c-9066cf2c786b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:39.385762 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-344009a0-d19d-487b-b44c-9066cf2c786b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:39.386244 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-344009a0-d19d-487b-b44c-9066cf2c786b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:39.387060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-344009a0-d19d-487b-b44c-9066cf2c786b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:39.387520 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-344009a0-d19d-487b-b44c-9066cf2c786b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:39.527931 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-344009a0-d19d-487b-b44c-9066cf2c786b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:39.536349 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-344009a0-d19d-487b-b44c-9066cf2c786b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.162565 Apr 06 17:02:39.536927 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1536/3077] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:39 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:40.557923 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cc5a1ff7-bd62-4f15-89a7-0e48807fd7c3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:40.558901 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cc5a1ff7-bd62-4f15-89a7-0e48807fd7c3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:40.570183 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc5a1ff7-bd62-4f15-89a7-0e48807fd7c3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:40.570927 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc5a1ff7-bd62-4f15-89a7-0e48807fd7c3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:40.572179 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc5a1ff7-bd62-4f15-89a7-0e48807fd7c3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:40.572954 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cc5a1ff7-bd62-4f15-89a7-0e48807fd7c3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:40.727768 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-cc5a1ff7-bd62-4f15-89a7-0e48807fd7c3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:40.737855 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cc5a1ff7-bd62-4f15-89a7-0e48807fd7c3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.186477 Apr 06 17:02:40.738449 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1542/3078] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:40 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:41.758825 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-00f4de01-f103-4ef8-9b27-8a5a6c3b9958 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:41.759865 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-00f4de01-f103-4ef8-9b27-8a5a6c3b9958 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:41.770604 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00f4de01-f103-4ef8-9b27-8a5a6c3b9958 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:41.771493 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00f4de01-f103-4ef8-9b27-8a5a6c3b9958 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:41.773103 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00f4de01-f103-4ef8-9b27-8a5a6c3b9958 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:41.773870 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00f4de01-f103-4ef8-9b27-8a5a6c3b9958 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:41.928297 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-00f4de01-f103-4ef8-9b27-8a5a6c3b9958 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:41.939418 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-00f4de01-f103-4ef8-9b27-8a5a6c3b9958 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.187130 Apr 06 17:02:41.940000 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1537/3079] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:41 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:42.960321 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2e20fa95-d8c0-4465-83af-a8b664f2a622 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:42.961399 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2e20fa95-d8c0-4465-83af-a8b664f2a622 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:42.971568 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e20fa95-d8c0-4465-83af-a8b664f2a622 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:42.972306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e20fa95-d8c0-4465-83af-a8b664f2a622 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:42.973608 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e20fa95-d8c0-4465-83af-a8b664f2a622 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:42.974316 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e20fa95-d8c0-4465-83af-a8b664f2a622 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:43.115122 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2e20fa95-d8c0-4465-83af-a8b664f2a622 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:43.128183 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2e20fa95-d8c0-4465-83af-a8b664f2a622 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.174068 Apr 06 17:02:43.129006 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1543/3080] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:42 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:44.153403 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7587e58c-4781-428e-8021-80581ebbc944 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:44.154384 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7587e58c-4781-428e-8021-80581ebbc944 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:44.162021 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7587e58c-4781-428e-8021-80581ebbc944 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:44.162479 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7587e58c-4781-428e-8021-80581ebbc944 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:44.163251 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7587e58c-4781-428e-8021-80581ebbc944 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:44.163712 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7587e58c-4781-428e-8021-80581ebbc944 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:44.323404 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7587e58c-4781-428e-8021-80581ebbc944 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:44.332216 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7587e58c-4781-428e-8021-80581ebbc944 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.185322 Apr 06 17:02:44.332771 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1538/3081] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:44 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:45.353949 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c56b7952-3b76-47b1-aa6b-adc19a8db994 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:45.354547 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c56b7952-3b76-47b1-aa6b-adc19a8db994 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:45.362886 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c56b7952-3b76-47b1-aa6b-adc19a8db994 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:45.363343 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c56b7952-3b76-47b1-aa6b-adc19a8db994 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:45.364140 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c56b7952-3b76-47b1-aa6b-adc19a8db994 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:45.364580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c56b7952-3b76-47b1-aa6b-adc19a8db994 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:45.516912 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c56b7952-3b76-47b1-aa6b-adc19a8db994 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:45.528877 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c56b7952-3b76-47b1-aa6b-adc19a8db994 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.181768 Apr 06 17:02:45.529767 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1544/3082] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:45 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:46.550763 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8a96f0b7-f5e8-4e60-94e5-52337fbb7694 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:46.551562 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8a96f0b7-f5e8-4e60-94e5-52337fbb7694 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:46.560366 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a96f0b7-f5e8-4e60-94e5-52337fbb7694 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:46.561021 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a96f0b7-f5e8-4e60-94e5-52337fbb7694 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:46.562046 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a96f0b7-f5e8-4e60-94e5-52337fbb7694 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:46.562632 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a96f0b7-f5e8-4e60-94e5-52337fbb7694 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:46.708718 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8a96f0b7-f5e8-4e60-94e5-52337fbb7694 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:46.720636 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8a96f0b7-f5e8-4e60-94e5-52337fbb7694 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.175991 Apr 06 17:02:46.721459 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1539/3083] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:46 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:47.748102 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c86b0831-52eb-489c-9347-b8e4dc646e92 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:47.749110 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c86b0831-52eb-489c-9347-b8e4dc646e92 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:47.756655 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c86b0831-52eb-489c-9347-b8e4dc646e92 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:47.757511 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c86b0831-52eb-489c-9347-b8e4dc646e92 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:47.758289 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c86b0831-52eb-489c-9347-b8e4dc646e92 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:47.758731 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c86b0831-52eb-489c-9347-b8e4dc646e92 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:47.901296 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c86b0831-52eb-489c-9347-b8e4dc646e92 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:47.911311 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c86b0831-52eb-489c-9347-b8e4dc646e92 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.169889 Apr 06 17:02:47.911895 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1545/3084] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:47 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:48.931077 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-233ccfdb-a903-4e94-af5c-9d5dcea4d6ae tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:48.931893 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-233ccfdb-a903-4e94-af5c-9d5dcea4d6ae tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:48.940662 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-233ccfdb-a903-4e94-af5c-9d5dcea4d6ae tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:48.941292 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-233ccfdb-a903-4e94-af5c-9d5dcea4d6ae tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:48.942297 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-233ccfdb-a903-4e94-af5c-9d5dcea4d6ae tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:48.942868 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-233ccfdb-a903-4e94-af5c-9d5dcea4d6ae tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:49.084751 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-233ccfdb-a903-4e94-af5c-9d5dcea4d6ae tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:49.096162 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-233ccfdb-a903-4e94-af5c-9d5dcea4d6ae tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.170293 Apr 06 17:02:49.096714 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1540/3085] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:48 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:50.113778 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5c17f55f-7b5f-4962-a73c-7ec7ffe38e4e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:50.114383 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5c17f55f-7b5f-4962-a73c-7ec7ffe38e4e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:50.121195 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c17f55f-7b5f-4962-a73c-7ec7ffe38e4e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:50.121630 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c17f55f-7b5f-4962-a73c-7ec7ffe38e4e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:50.122389 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c17f55f-7b5f-4962-a73c-7ec7ffe38e4e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:50.122822 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5c17f55f-7b5f-4962-a73c-7ec7ffe38e4e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:50.266107 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5c17f55f-7b5f-4962-a73c-7ec7ffe38e4e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:50.274887 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5c17f55f-7b5f-4962-a73c-7ec7ffe38e4e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.165092 Apr 06 17:02:50.275467 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1546/3086] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:50 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:51.292277 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-16b62de8-eec6-460d-9220-7ee5c93ef589 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:51.292892 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-16b62de8-eec6-460d-9220-7ee5c93ef589 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:51.300142 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16b62de8-eec6-460d-9220-7ee5c93ef589 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:51.300565 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16b62de8-eec6-460d-9220-7ee5c93ef589 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:51.301370 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16b62de8-eec6-460d-9220-7ee5c93ef589 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:51.301805 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16b62de8-eec6-460d-9220-7ee5c93ef589 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:51.442704 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-16b62de8-eec6-460d-9220-7ee5c93ef589 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:51.451274 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-16b62de8-eec6-460d-9220-7ee5c93ef589 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.163059 Apr 06 17:02:51.451854 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1541/3087] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:51 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:52.479001 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-25e1a2e4-17ff-42cc-92f6-81be3a3afac3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:52.479996 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-25e1a2e4-17ff-42cc-92f6-81be3a3afac3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:52.489686 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25e1a2e4-17ff-42cc-92f6-81be3a3afac3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:52.490147 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25e1a2e4-17ff-42cc-92f6-81be3a3afac3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:52.490917 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25e1a2e4-17ff-42cc-92f6-81be3a3afac3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:52.491355 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-25e1a2e4-17ff-42cc-92f6-81be3a3afac3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:52.641127 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-25e1a2e4-17ff-42cc-92f6-81be3a3afac3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:52.650923 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-25e1a2e4-17ff-42cc-92f6-81be3a3afac3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.178482 Apr 06 17:02:52.651515 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1547/3088] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:52 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:53.671502 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3b3ea35a-0c13-4059-a79f-8e2a9a56a312 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:53.672618 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3b3ea35a-0c13-4059-a79f-8e2a9a56a312 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:53.683647 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b3ea35a-0c13-4059-a79f-8e2a9a56a312 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:53.684413 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b3ea35a-0c13-4059-a79f-8e2a9a56a312 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:53.685740 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b3ea35a-0c13-4059-a79f-8e2a9a56a312 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:53.686473 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b3ea35a-0c13-4059-a79f-8e2a9a56a312 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:53.842174 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3b3ea35a-0c13-4059-a79f-8e2a9a56a312 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:53.851842 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3b3ea35a-0c13-4059-a79f-8e2a9a56a312 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.186862 Apr 06 17:02:53.852432 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1542/3089] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:53 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:54.875500 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0272032b-6138-40df-922b-046bbb981201 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:54.876466 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0272032b-6138-40df-922b-046bbb981201 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:54.887000 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0272032b-6138-40df-922b-046bbb981201 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:54.887760 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0272032b-6138-40df-922b-046bbb981201 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:54.889085 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0272032b-6138-40df-922b-046bbb981201 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:54.889778 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0272032b-6138-40df-922b-046bbb981201 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:55.032130 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0272032b-6138-40df-922b-046bbb981201 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:55.044040 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0272032b-6138-40df-922b-046bbb981201 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.176465 Apr 06 17:02:55.044930 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1548/3090] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:54 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:56.067718 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d8a5de5d-eb45-4304-be37-2b9a23521e80 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:56.068507 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d8a5de5d-eb45-4304-be37-2b9a23521e80 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:56.076631 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8a5de5d-eb45-4304-be37-2b9a23521e80 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:56.077227 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8a5de5d-eb45-4304-be37-2b9a23521e80 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:56.078166 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8a5de5d-eb45-4304-be37-2b9a23521e80 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:56.078703 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8a5de5d-eb45-4304-be37-2b9a23521e80 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:56.220717 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d8a5de5d-eb45-4304-be37-2b9a23521e80 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:56.229313 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d8a5de5d-eb45-4304-be37-2b9a23521e80 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.167975 Apr 06 17:02:56.229893 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1543/3091] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:56 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:57.251632 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0c77d0f7-6836-4a74-b9f7-b3a5f0f60bfd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:57.252602 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0c77d0f7-6836-4a74-b9f7-b3a5f0f60bfd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:57.264237 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c77d0f7-6836-4a74-b9f7-b3a5f0f60bfd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:57.265042 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c77d0f7-6836-4a74-b9f7-b3a5f0f60bfd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:57.266302 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c77d0f7-6836-4a74-b9f7-b3a5f0f60bfd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:57.267025 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0c77d0f7-6836-4a74-b9f7-b3a5f0f60bfd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:57.417109 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0c77d0f7-6836-4a74-b9f7-b3a5f0f60bfd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:57.426041 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0c77d0f7-6836-4a74-b9f7-b3a5f0f60bfd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.181040 Apr 06 17:02:57.426622 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1549/3092] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:57 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:58.448140 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ff9d4e05-096c-42d4-b0a7-4b21a651dc1f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:58.449163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ff9d4e05-096c-42d4-b0a7-4b21a651dc1f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:58.459845 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff9d4e05-096c-42d4-b0a7-4b21a651dc1f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:58.460310 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff9d4e05-096c-42d4-b0a7-4b21a651dc1f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:58.461298 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff9d4e05-096c-42d4-b0a7-4b21a651dc1f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:58.461737 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff9d4e05-096c-42d4-b0a7-4b21a651dc1f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:58.613397 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ff9d4e05-096c-42d4-b0a7-4b21a651dc1f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:58.621526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ff9d4e05-096c-42d4-b0a7-4b21a651dc1f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.179932 Apr 06 17:02:58.622101 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1544/3093] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:58 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:02:59.643419 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4ecbc6d0-814b-48b2-b4ed-42bbed697cc8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:02:59.644314 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4ecbc6d0-814b-48b2-b4ed-42bbed697cc8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:02:59.656113 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ecbc6d0-814b-48b2-b4ed-42bbed697cc8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:59.657010 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ecbc6d0-814b-48b2-b4ed-42bbed697cc8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:59.658290 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ecbc6d0-814b-48b2-b4ed-42bbed697cc8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:02:59.659124 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ecbc6d0-814b-48b2-b4ed-42bbed697cc8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:02:59.810545 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4ecbc6d0-814b-48b2-b4ed-42bbed697cc8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:02:59.821601 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4ecbc6d0-814b-48b2-b4ed-42bbed697cc8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.184964 Apr 06 17:02:59.822171 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1550/3094] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:02:59 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:00.842841 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-571ad7ed-c585-41ba-8bb9-fda4eb051911 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:00.844072 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-571ad7ed-c585-41ba-8bb9-fda4eb051911 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:00.855125 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-571ad7ed-c585-41ba-8bb9-fda4eb051911 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:00.855909 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-571ad7ed-c585-41ba-8bb9-fda4eb051911 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:00.857610 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-571ad7ed-c585-41ba-8bb9-fda4eb051911 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:00.858322 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-571ad7ed-c585-41ba-8bb9-fda4eb051911 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:01.013326 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-571ad7ed-c585-41ba-8bb9-fda4eb051911 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:01.025538 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-571ad7ed-c585-41ba-8bb9-fda4eb051911 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.188885 Apr 06 17:03:01.026426 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1545/3095] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:00 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:02.051921 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-779c836c-86fe-4a13-9752-3e5c8d73eaec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:02.052928 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-779c836c-86fe-4a13-9752-3e5c8d73eaec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:02.064180 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-779c836c-86fe-4a13-9752-3e5c8d73eaec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:02.065027 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-779c836c-86fe-4a13-9752-3e5c8d73eaec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:02.066305 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-779c836c-86fe-4a13-9752-3e5c8d73eaec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:02.067088 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-779c836c-86fe-4a13-9752-3e5c8d73eaec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:02.220999 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-779c836c-86fe-4a13-9752-3e5c8d73eaec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:02.229607 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-779c836c-86fe-4a13-9752-3e5c8d73eaec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.184531 Apr 06 17:03:02.230368 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1551/3096] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:02 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:03.249237 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-afe4cf84-af5d-4d29-881f-1ecd4f167c1d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:03.249962 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-afe4cf84-af5d-4d29-881f-1ecd4f167c1d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:03.258157 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afe4cf84-af5d-4d29-881f-1ecd4f167c1d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:03.258615 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afe4cf84-af5d-4d29-881f-1ecd4f167c1d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:03.259401 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afe4cf84-af5d-4d29-881f-1ecd4f167c1d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:03.259838 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afe4cf84-af5d-4d29-881f-1ecd4f167c1d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:03.397454 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-afe4cf84-af5d-4d29-881f-1ecd4f167c1d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:03.405716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-afe4cf84-af5d-4d29-881f-1ecd4f167c1d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1719 microversion: 2.1 time: 0.161468 Apr 06 17:03:03.406295 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1546/3097] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:03 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:04.328890 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-332056a4-ad0e-43e3-923f-4289a0752f5a req-3c7c450d-ee54-4e1e-87bc-27f57ceff548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bab853ba-a3d5-4828-baf6-1088f936bc96", "name": "network-vif-deleted", "tag": "85e18e37-1e89-48a0-8d94-cf2d33254117"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:03:04.336350 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-332056a4-ad0e-43e3-923f-4289a0752f5a req-3c7c450d-ee54-4e1e-87bc-27f57ceff548 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:04.336889 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-332056a4-ad0e-43e3-923f-4289a0752f5a req-3c7c450d-ee54-4e1e-87bc-27f57ceff548 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:04.348784 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-332056a4-ad0e-43e3-923f-4289a0752f5a req-3c7c450d-ee54-4e1e-87bc-27f57ceff548 service nova] Creating event network-vif-deleted:85e18e37-1e89-48a0-8d94-cf2d33254117 for instance bab853ba-a3d5-4828-baf6-1088f936bc96 on hv-cinder-83684 Apr 06 17:03:04.354037 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-332056a4-ad0e-43e3-923f-4289a0752f5a req-3c7c450d-ee54-4e1e-87bc-27f57ceff548 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032131 Apr 06 17:03:04.354588 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1552/3098] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:03:04.423826 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-edf12d0a-801e-45ae-9a60-16d55b78a069 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:04.424603 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-edf12d0a-801e-45ae-9a60-16d55b78a069 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:04.431868 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edf12d0a-801e-45ae-9a60-16d55b78a069 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:04.432325 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edf12d0a-801e-45ae-9a60-16d55b78a069 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:04.433140 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edf12d0a-801e-45ae-9a60-16d55b78a069 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:04.433570 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edf12d0a-801e-45ae-9a60-16d55b78a069 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:04.500176 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-edf12d0a-801e-45ae-9a60-16d55b78a069 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:04.509776 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-edf12d0a-801e-45ae-9a60-16d55b78a069 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.090006 Apr 06 17:03:04.519465 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1547/3099] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:04 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:05.529596 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5a001459-385c-4f66-92d8-768d10d894cc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:05.530299 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5a001459-385c-4f66-92d8-768d10d894cc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:05.537131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a001459-385c-4f66-92d8-768d10d894cc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:05.537582 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a001459-385c-4f66-92d8-768d10d894cc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:05.538357 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a001459-385c-4f66-92d8-768d10d894cc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:05.538794 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5a001459-385c-4f66-92d8-768d10d894cc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:05.600721 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5a001459-385c-4f66-92d8-768d10d894cc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:05.609967 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5a001459-385c-4f66-92d8-768d10d894cc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.085211 Apr 06 17:03:05.610535 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1553/3100] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:05 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:06.627209 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-da161b5b-1c84-41de-80d2-dc731b79fdae tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:06.627797 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-da161b5b-1c84-41de-80d2-dc731b79fdae tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:06.634427 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da161b5b-1c84-41de-80d2-dc731b79fdae tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:06.634880 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da161b5b-1c84-41de-80d2-dc731b79fdae tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:06.635656 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da161b5b-1c84-41de-80d2-dc731b79fdae tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:06.636088 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da161b5b-1c84-41de-80d2-dc731b79fdae tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:06.698544 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-da161b5b-1c84-41de-80d2-dc731b79fdae tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:06.706611 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-da161b5b-1c84-41de-80d2-dc731b79fdae tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.083357 Apr 06 17:03:06.707186 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1548/3101] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:06 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:07.728034 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5f5bd2d3-2b16-445d-8203-0e94185f1a89 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:07.728672 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5f5bd2d3-2b16-445d-8203-0e94185f1a89 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:07.736478 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f5bd2d3-2b16-445d-8203-0e94185f1a89 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:07.737008 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f5bd2d3-2b16-445d-8203-0e94185f1a89 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:07.737843 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f5bd2d3-2b16-445d-8203-0e94185f1a89 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:07.738324 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f5bd2d3-2b16-445d-8203-0e94185f1a89 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:07.800328 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5f5bd2d3-2b16-445d-8203-0e94185f1a89 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:07.808845 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5f5bd2d3-2b16-445d-8203-0e94185f1a89 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.087176 Apr 06 17:03:07.809409 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1554/3102] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:07 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:08.829417 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d96960b9-befc-4c88-aa2c-a3b3ab389294 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:08.830080 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d96960b9-befc-4c88-aa2c-a3b3ab389294 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:08.838887 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d96960b9-befc-4c88-aa2c-a3b3ab389294 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:08.839340 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d96960b9-befc-4c88-aa2c-a3b3ab389294 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:08.840104 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d96960b9-befc-4c88-aa2c-a3b3ab389294 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:08.840538 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d96960b9-befc-4c88-aa2c-a3b3ab389294 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:08.903916 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d96960b9-befc-4c88-aa2c-a3b3ab389294 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:08.911868 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d96960b9-befc-4c88-aa2c-a3b3ab389294 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.088959 Apr 06 17:03:08.912435 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1549/3103] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:08 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:09.931412 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-60bf83fe-a5f6-4d33-9b71-8fee43a69294 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:09.932255 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-60bf83fe-a5f6-4d33-9b71-8fee43a69294 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:09.941143 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60bf83fe-a5f6-4d33-9b71-8fee43a69294 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:09.941745 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60bf83fe-a5f6-4d33-9b71-8fee43a69294 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:09.942770 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60bf83fe-a5f6-4d33-9b71-8fee43a69294 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:09.943315 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-60bf83fe-a5f6-4d33-9b71-8fee43a69294 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:10.007065 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-60bf83fe-a5f6-4d33-9b71-8fee43a69294 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:10.015859 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-60bf83fe-a5f6-4d33-9b71-8fee43a69294 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.089851 Apr 06 17:03:10.016475 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1555/3104] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:09 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:11.037488 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-23d8e90b-be3b-4bb0-8047-133f84e63e1c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:11.038412 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-23d8e90b-be3b-4bb0-8047-133f84e63e1c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:11.049246 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23d8e90b-be3b-4bb0-8047-133f84e63e1c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:11.049976 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23d8e90b-be3b-4bb0-8047-133f84e63e1c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:11.051246 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23d8e90b-be3b-4bb0-8047-133f84e63e1c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:11.051993 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23d8e90b-be3b-4bb0-8047-133f84e63e1c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:11.114539 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-23d8e90b-be3b-4bb0-8047-133f84e63e1c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:11.123210 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-23d8e90b-be3b-4bb0-8047-133f84e63e1c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.092320 Apr 06 17:03:11.123766 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1550/3105] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:11 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:12.145883 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bed4fc8b-0967-4437-b8a8-d6a80aba14d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:12.147067 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bed4fc8b-0967-4437-b8a8-d6a80aba14d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:12.154414 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bed4fc8b-0967-4437-b8a8-d6a80aba14d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:12.154881 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bed4fc8b-0967-4437-b8a8-d6a80aba14d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:12.155648 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bed4fc8b-0967-4437-b8a8-d6a80aba14d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:12.156084 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bed4fc8b-0967-4437-b8a8-d6a80aba14d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:12.447437 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-bed4fc8b-0967-4437-b8a8-d6a80aba14d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:12.458806 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bed4fc8b-0967-4437-b8a8-d6a80aba14d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.320653 Apr 06 17:03:12.459385 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1556/3106] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:12 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:13.476928 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0a9fc8ae-8b1d-4638-83c5-738624997f8f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:13.477569 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0a9fc8ae-8b1d-4638-83c5-738624997f8f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:13.484797 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a9fc8ae-8b1d-4638-83c5-738624997f8f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:13.485280 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a9fc8ae-8b1d-4638-83c5-738624997f8f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:13.486087 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a9fc8ae-8b1d-4638-83c5-738624997f8f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:13.486551 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a9fc8ae-8b1d-4638-83c5-738624997f8f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:13.556321 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0a9fc8ae-8b1d-4638-83c5-738624997f8f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:13.568497 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0a9fc8ae-8b1d-4638-83c5-738624997f8f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.095660 Apr 06 17:03:13.569393 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1551/3107] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:13 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:14.598097 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1505b8bb-5e8c-4eb5-b414-e54a3cf2dd2c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:14.599428 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1505b8bb-5e8c-4eb5-b414-e54a3cf2dd2c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:14.607866 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1505b8bb-5e8c-4eb5-b414-e54a3cf2dd2c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:14.608318 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1505b8bb-5e8c-4eb5-b414-e54a3cf2dd2c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:14.609126 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1505b8bb-5e8c-4eb5-b414-e54a3cf2dd2c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:14.609557 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1505b8bb-5e8c-4eb5-b414-e54a3cf2dd2c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:14.671295 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1505b8bb-5e8c-4eb5-b414-e54a3cf2dd2c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:14.679271 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1505b8bb-5e8c-4eb5-b414-e54a3cf2dd2c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.088990 Apr 06 17:03:14.679852 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1557/3108] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:14 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:15.700503 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9801aa83-a218-4dea-82c8-6a39cf1b20c9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:15.701231 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9801aa83-a218-4dea-82c8-6a39cf1b20c9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:15.710800 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9801aa83-a218-4dea-82c8-6a39cf1b20c9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:15.711347 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9801aa83-a218-4dea-82c8-6a39cf1b20c9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:15.712539 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9801aa83-a218-4dea-82c8-6a39cf1b20c9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:15.713093 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9801aa83-a218-4dea-82c8-6a39cf1b20c9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:15.785049 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9801aa83-a218-4dea-82c8-6a39cf1b20c9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:15.797337 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9801aa83-a218-4dea-82c8-6a39cf1b20c9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.103118 Apr 06 17:03:15.798081 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1552/3109] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:15 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:16.821716 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-025d0c21-6439-4e23-a6dc-4d3543da03e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:16.822614 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-025d0c21-6439-4e23-a6dc-4d3543da03e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:16.830132 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-025d0c21-6439-4e23-a6dc-4d3543da03e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:16.830651 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-025d0c21-6439-4e23-a6dc-4d3543da03e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:16.831538 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-025d0c21-6439-4e23-a6dc-4d3543da03e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:16.832039 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-025d0c21-6439-4e23-a6dc-4d3543da03e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:16.897014 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-025d0c21-6439-4e23-a6dc-4d3543da03e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:16.906093 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-025d0c21-6439-4e23-a6dc-4d3543da03e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.090956 Apr 06 17:03:16.906670 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1558/3110] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:16 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:17.927588 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-451b1c92-28c3-4655-a1fb-05c250cce197 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:17.928562 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-451b1c92-28c3-4655-a1fb-05c250cce197 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:17.938967 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-451b1c92-28c3-4655-a1fb-05c250cce197 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:17.939567 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-451b1c92-28c3-4655-a1fb-05c250cce197 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:17.940646 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-451b1c92-28c3-4655-a1fb-05c250cce197 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:17.942870 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-451b1c92-28c3-4655-a1fb-05c250cce197 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:18.011576 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-451b1c92-28c3-4655-a1fb-05c250cce197 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:18.021326 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-451b1c92-28c3-4655-a1fb-05c250cce197 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.100422 Apr 06 17:03:18.021933 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1553/3111] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:17 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:19.043216 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-abe47a36-335a-4313-bf4f-3ef4985518f4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:19.044062 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-abe47a36-335a-4313-bf4f-3ef4985518f4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:19.053273 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abe47a36-335a-4313-bf4f-3ef4985518f4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:19.053448 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abe47a36-335a-4313-bf4f-3ef4985518f4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:19.054410 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abe47a36-335a-4313-bf4f-3ef4985518f4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:19.054993 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abe47a36-335a-4313-bf4f-3ef4985518f4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:19.118486 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-abe47a36-335a-4313-bf4f-3ef4985518f4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:19.126623 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-abe47a36-335a-4313-bf4f-3ef4985518f4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.089623 Apr 06 17:03:19.127195 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1559/3112] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:19 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:20.147475 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-98ce4f31-6695-4de4-82f5-ab67171b2c7f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:20.148154 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-98ce4f31-6695-4de4-82f5-ab67171b2c7f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:20.155816 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98ce4f31-6695-4de4-82f5-ab67171b2c7f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:20.156273 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98ce4f31-6695-4de4-82f5-ab67171b2c7f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:20.157065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98ce4f31-6695-4de4-82f5-ab67171b2c7f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:20.157497 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98ce4f31-6695-4de4-82f5-ab67171b2c7f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:20.221569 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-98ce4f31-6695-4de4-82f5-ab67171b2c7f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:20.233770 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-98ce4f31-6695-4de4-82f5-ab67171b2c7f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.092290 Apr 06 17:03:20.234571 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1554/3113] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:20 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:21.258226 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-52695d45-6e94-4919-a016-8a6c44136446 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:21.259425 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-52695d45-6e94-4919-a016-8a6c44136446 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:21.266359 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52695d45-6e94-4919-a016-8a6c44136446 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:21.266804 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52695d45-6e94-4919-a016-8a6c44136446 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:21.267564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52695d45-6e94-4919-a016-8a6c44136446 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:21.267997 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52695d45-6e94-4919-a016-8a6c44136446 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:21.336910 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-52695d45-6e94-4919-a016-8a6c44136446 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:21.345318 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-52695d45-6e94-4919-a016-8a6c44136446 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.093621 Apr 06 17:03:21.345874 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1560/3114] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:21 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:22.364264 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d89647c8-2956-4eb6-9d9a-14015156faac tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:22.364906 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d89647c8-2956-4eb6-9d9a-14015156faac tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:22.372147 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d89647c8-2956-4eb6-9d9a-14015156faac tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:22.372604 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d89647c8-2956-4eb6-9d9a-14015156faac tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:22.373425 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d89647c8-2956-4eb6-9d9a-14015156faac tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:22.373869 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d89647c8-2956-4eb6-9d9a-14015156faac tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:22.435738 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d89647c8-2956-4eb6-9d9a-14015156faac tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:22.448753 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d89647c8-2956-4eb6-9d9a-14015156faac tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.088196 Apr 06 17:03:22.449599 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1555/3115] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:22 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:23.475489 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d493b5ee-f06f-4b4d-9a94-6fa954923430 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:23.476373 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d493b5ee-f06f-4b4d-9a94-6fa954923430 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:23.484080 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d493b5ee-f06f-4b4d-9a94-6fa954923430 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:23.484526 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d493b5ee-f06f-4b4d-9a94-6fa954923430 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:23.485326 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d493b5ee-f06f-4b4d-9a94-6fa954923430 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:23.485761 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d493b5ee-f06f-4b4d-9a94-6fa954923430 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:23.555591 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d493b5ee-f06f-4b4d-9a94-6fa954923430 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:23.564029 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d493b5ee-f06f-4b4d-9a94-6fa954923430 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.095096 Apr 06 17:03:23.564607 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1561/3116] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:23 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:24.586456 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-baf75eff-6f1e-421a-b92c-dd5f4ed25a98 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:24.587333 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-baf75eff-6f1e-421a-b92c-dd5f4ed25a98 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:24.594176 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-baf75eff-6f1e-421a-b92c-dd5f4ed25a98 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:24.594630 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-baf75eff-6f1e-421a-b92c-dd5f4ed25a98 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:24.595400 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-baf75eff-6f1e-421a-b92c-dd5f4ed25a98 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:24.595856 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-baf75eff-6f1e-421a-b92c-dd5f4ed25a98 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:24.658577 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-baf75eff-6f1e-421a-b92c-dd5f4ed25a98 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:24.667022 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-baf75eff-6f1e-421a-b92c-dd5f4ed25a98 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.086129 Apr 06 17:03:24.667594 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1556/3117] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:24 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:25.688223 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-533a2570-809f-4034-a307-fd48b81a42bd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:25.689282 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-533a2570-809f-4034-a307-fd48b81a42bd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:25.698950 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-533a2570-809f-4034-a307-fd48b81a42bd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:25.699399 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-533a2570-809f-4034-a307-fd48b81a42bd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:25.700156 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-533a2570-809f-4034-a307-fd48b81a42bd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:25.700613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-533a2570-809f-4034-a307-fd48b81a42bd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:25.766964 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-533a2570-809f-4034-a307-fd48b81a42bd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:25.775933 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-533a2570-809f-4034-a307-fd48b81a42bd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.094007 Apr 06 17:03:25.776509 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1562/3118] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:25 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:25.909495 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:03:25.910435 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 17:03:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:03:26.798085 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8ab94c4d-8887-451c-a936-e123b9facf94 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:26.799151 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8ab94c4d-8887-451c-a936-e123b9facf94 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:26.808677 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ab94c4d-8887-451c-a936-e123b9facf94 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:26.809228 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ab94c4d-8887-451c-a936-e123b9facf94 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:26.810003 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ab94c4d-8887-451c-a936-e123b9facf94 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:26.810440 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ab94c4d-8887-451c-a936-e123b9facf94 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:26.871029 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8ab94c4d-8887-451c-a936-e123b9facf94 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:26.879044 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8ab94c4d-8887-451c-a936-e123b9facf94 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.088058 Apr 06 17:03:26.879602 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1557/3119] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:26 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:27.900239 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6794f9c7-c272-422b-9715-ee2f4a95a0b2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:27.901508 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6794f9c7-c272-422b-9715-ee2f4a95a0b2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:27.912034 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6794f9c7-c272-422b-9715-ee2f4a95a0b2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:27.912757 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6794f9c7-c272-422b-9715-ee2f4a95a0b2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:27.914058 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6794f9c7-c272-422b-9715-ee2f4a95a0b2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:27.914759 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6794f9c7-c272-422b-9715-ee2f4a95a0b2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:27.974523 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6794f9c7-c272-422b-9715-ee2f4a95a0b2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:27.982945 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6794f9c7-c272-422b-9715-ee2f4a95a0b2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.089242 Apr 06 17:03:27.983515 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1563/3120] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:27 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:29.001879 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-617d36a2-3c29-4bcf-b024-232f2161f719 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:29.002750 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-617d36a2-3c29-4bcf-b024-232f2161f719 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:29.011103 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-617d36a2-3c29-4bcf-b024-232f2161f719 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:29.011659 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-617d36a2-3c29-4bcf-b024-232f2161f719 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:29.012599 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-617d36a2-3c29-4bcf-b024-232f2161f719 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:29.013168 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-617d36a2-3c29-4bcf-b024-232f2161f719 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:29.075475 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-617d36a2-3c29-4bcf-b024-232f2161f719 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:29.084495 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-617d36a2-3c29-4bcf-b024-232f2161f719 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.087616 Apr 06 17:03:29.085146 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1558/3121] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:28 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:30.105865 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-db8fb702-748f-4981-904d-f66238cfada9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:30.106867 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-db8fb702-748f-4981-904d-f66238cfada9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:30.114938 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db8fb702-748f-4981-904d-f66238cfada9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:30.115381 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db8fb702-748f-4981-904d-f66238cfada9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:30.116135 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db8fb702-748f-4981-904d-f66238cfada9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:30.116574 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db8fb702-748f-4981-904d-f66238cfada9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:30.194895 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-db8fb702-748f-4981-904d-f66238cfada9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:30.204083 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-db8fb702-748f-4981-904d-f66238cfada9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.104084 Apr 06 17:03:30.204639 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1564/3122] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:30 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:31.225416 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-90bfbe01-f526-4f24-903d-6cf7e0c841a8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:31.226356 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-90bfbe01-f526-4f24-903d-6cf7e0c841a8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:31.238280 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90bfbe01-f526-4f24-903d-6cf7e0c841a8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:31.239054 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90bfbe01-f526-4f24-903d-6cf7e0c841a8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:31.240339 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90bfbe01-f526-4f24-903d-6cf7e0c841a8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:31.241140 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90bfbe01-f526-4f24-903d-6cf7e0c841a8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:31.303736 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-90bfbe01-f526-4f24-903d-6cf7e0c841a8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:31.313369 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-90bfbe01-f526-4f24-903d-6cf7e0c841a8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.094306 Apr 06 17:03:31.313975 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1559/3123] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:31 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:32.331375 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-752c53f3-6f9d-442f-8dda-58bff1bef07c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:32.332495 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-752c53f3-6f9d-442f-8dda-58bff1bef07c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:32.341312 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-752c53f3-6f9d-442f-8dda-58bff1bef07c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:32.341958 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-752c53f3-6f9d-442f-8dda-58bff1bef07c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:32.342735 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-752c53f3-6f9d-442f-8dda-58bff1bef07c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:32.343176 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-752c53f3-6f9d-442f-8dda-58bff1bef07c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:32.426940 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-752c53f3-6f9d-442f-8dda-58bff1bef07c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:32.439851 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-752c53f3-6f9d-442f-8dda-58bff1bef07c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.112722 Apr 06 17:03:32.440798 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1565/3124] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:32 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:33.464352 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f2bea8fa-2ff8-454b-a456-02173f7fc629 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:33.465402 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f2bea8fa-2ff8-454b-a456-02173f7fc629 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:33.472027 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2bea8fa-2ff8-454b-a456-02173f7fc629 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:33.472483 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2bea8fa-2ff8-454b-a456-02173f7fc629 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:33.473284 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2bea8fa-2ff8-454b-a456-02173f7fc629 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:33.473722 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2bea8fa-2ff8-454b-a456-02173f7fc629 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:33.541598 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f2bea8fa-2ff8-454b-a456-02173f7fc629 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:33.554232 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f2bea8fa-2ff8-454b-a456-02173f7fc629 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.096125 Apr 06 17:03:33.555030 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1560/3125] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:33 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:34.576148 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7d228281-3f66-4745-ba8c-8125bdd3bb1c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:34.576904 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7d228281-3f66-4745-ba8c-8125bdd3bb1c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:34.585463 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d228281-3f66-4745-ba8c-8125bdd3bb1c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:34.585977 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d228281-3f66-4745-ba8c-8125bdd3bb1c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:34.586935 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d228281-3f66-4745-ba8c-8125bdd3bb1c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:34.587454 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7d228281-3f66-4745-ba8c-8125bdd3bb1c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:34.662161 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7d228281-3f66-4745-ba8c-8125bdd3bb1c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:34.670918 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7d228281-3f66-4745-ba8c-8125bdd3bb1c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.101075 Apr 06 17:03:34.671509 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1566/3126] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:34 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:35.697788 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8f06564b-53b4-403d-a68d-b1cc44bf265b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:35.698795 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8f06564b-53b4-403d-a68d-b1cc44bf265b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:35.709625 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f06564b-53b4-403d-a68d-b1cc44bf265b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:35.710360 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f06564b-53b4-403d-a68d-b1cc44bf265b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:35.711578 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f06564b-53b4-403d-a68d-b1cc44bf265b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:35.712366 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f06564b-53b4-403d-a68d-b1cc44bf265b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:35.777068 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8f06564b-53b4-403d-a68d-b1cc44bf265b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:35.785548 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8f06564b-53b4-403d-a68d-b1cc44bf265b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.094388 Apr 06 17:03:35.786120 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1561/3127] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:35 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:36.816748 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-16575a26-d1cd-489b-b514-00eeaa984cba tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:36.817944 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-16575a26-d1cd-489b-b514-00eeaa984cba tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:36.828099 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16575a26-d1cd-489b-b514-00eeaa984cba tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:36.828552 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16575a26-d1cd-489b-b514-00eeaa984cba tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:36.829363 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16575a26-d1cd-489b-b514-00eeaa984cba tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:36.829798 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-16575a26-d1cd-489b-b514-00eeaa984cba tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:36.899329 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-16575a26-d1cd-489b-b514-00eeaa984cba tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:36.912080 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-16575a26-d1cd-489b-b514-00eeaa984cba tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.101847 Apr 06 17:03:36.913081 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1567/3128] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:36 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:37.935557 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-019e31de-91a9-4714-b22e-e0cbe13d3d6e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:37.936446 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-019e31de-91a9-4714-b22e-e0cbe13d3d6e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:37.943228 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-019e31de-91a9-4714-b22e-e0cbe13d3d6e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:37.943675 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-019e31de-91a9-4714-b22e-e0cbe13d3d6e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:37.944428 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-019e31de-91a9-4714-b22e-e0cbe13d3d6e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:37.944897 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-019e31de-91a9-4714-b22e-e0cbe13d3d6e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:38.006784 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-019e31de-91a9-4714-b22e-e0cbe13d3d6e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:38.015422 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-019e31de-91a9-4714-b22e-e0cbe13d3d6e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.086300 Apr 06 17:03:38.016000 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1562/3129] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:37 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:38.155757 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:03:38.156676 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 17:03:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:03:39.035359 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5f65bd1e-476b-48b6-9fca-c880e0ad4484 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:39.036057 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5f65bd1e-476b-48b6-9fca-c880e0ad4484 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:39.045516 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f65bd1e-476b-48b6-9fca-c880e0ad4484 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:39.045966 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f65bd1e-476b-48b6-9fca-c880e0ad4484 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:39.046731 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f65bd1e-476b-48b6-9fca-c880e0ad4484 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:39.047164 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f65bd1e-476b-48b6-9fca-c880e0ad4484 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:39.110640 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5f65bd1e-476b-48b6-9fca-c880e0ad4484 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:39.119271 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5f65bd1e-476b-48b6-9fca-c880e0ad4484 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.089623 Apr 06 17:03:39.119846 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1568/3130] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:39 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:40.145060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0a34861c-b3a8-4afc-b0c9-8a7f1a2c0d92 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:40.146138 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0a34861c-b3a8-4afc-b0c9-8a7f1a2c0d92 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:40.156188 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a34861c-b3a8-4afc-b0c9-8a7f1a2c0d92 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:40.156630 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a34861c-b3a8-4afc-b0c9-8a7f1a2c0d92 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:40.157423 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a34861c-b3a8-4afc-b0c9-8a7f1a2c0d92 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:40.157851 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a34861c-b3a8-4afc-b0c9-8a7f1a2c0d92 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:40.218923 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0a34861c-b3a8-4afc-b0c9-8a7f1a2c0d92 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:40.226877 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0a34861c-b3a8-4afc-b0c9-8a7f1a2c0d92 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.088936 Apr 06 17:03:40.227438 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1563/3131] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:40 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:41.247421 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8040ecdd-2247-45ac-8be9-0301958f2d43 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:41.248229 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8040ecdd-2247-45ac-8be9-0301958f2d43 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:41.257178 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8040ecdd-2247-45ac-8be9-0301958f2d43 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:41.257793 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8040ecdd-2247-45ac-8be9-0301958f2d43 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:41.258817 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8040ecdd-2247-45ac-8be9-0301958f2d43 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:41.259418 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8040ecdd-2247-45ac-8be9-0301958f2d43 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:41.320818 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8040ecdd-2247-45ac-8be9-0301958f2d43 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:41.329409 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8040ecdd-2247-45ac-8be9-0301958f2d43 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.088440 Apr 06 17:03:41.329957 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1569/3132] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:41 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:42.347222 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-13ee8d1f-a3b9-462f-8de1-2642f84028ac tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:42.347859 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-13ee8d1f-a3b9-462f-8de1-2642f84028ac tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:42.354432 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13ee8d1f-a3b9-462f-8de1-2642f84028ac tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:42.354888 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13ee8d1f-a3b9-462f-8de1-2642f84028ac tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:42.355661 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13ee8d1f-a3b9-462f-8de1-2642f84028ac tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:42.356474 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13ee8d1f-a3b9-462f-8de1-2642f84028ac tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:42.416375 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-13ee8d1f-a3b9-462f-8de1-2642f84028ac tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:42.428497 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-13ee8d1f-a3b9-462f-8de1-2642f84028ac tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.085180 Apr 06 17:03:42.429450 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1564/3133] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:42 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:43.453795 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-52f90c2e-b931-4e3d-b1ef-7b0e836bf70a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:43.454737 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-52f90c2e-b931-4e3d-b1ef-7b0e836bf70a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:43.465550 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52f90c2e-b931-4e3d-b1ef-7b0e836bf70a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:43.466298 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52f90c2e-b931-4e3d-b1ef-7b0e836bf70a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:43.467574 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52f90c2e-b931-4e3d-b1ef-7b0e836bf70a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:43.468567 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-52f90c2e-b931-4e3d-b1ef-7b0e836bf70a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:43.535563 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-52f90c2e-b931-4e3d-b1ef-7b0e836bf70a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:43.547470 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-52f90c2e-b931-4e3d-b1ef-7b0e836bf70a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.100766 Apr 06 17:03:43.548043 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1570/3134] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:43 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:44.049243 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:03:44.049636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 17:03:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:03:44.568635 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-80bcc572-f744-48a3-bc12-d976ec15a8d4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:44.569674 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-80bcc572-f744-48a3-bc12-d976ec15a8d4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:44.579258 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80bcc572-f744-48a3-bc12-d976ec15a8d4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:44.579706 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80bcc572-f744-48a3-bc12-d976ec15a8d4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:44.580464 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80bcc572-f744-48a3-bc12-d976ec15a8d4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:44.580959 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80bcc572-f744-48a3-bc12-d976ec15a8d4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:44.645424 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-80bcc572-f744-48a3-bc12-d976ec15a8d4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:44.653514 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-80bcc572-f744-48a3-bc12-d976ec15a8d4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.091463 Apr 06 17:03:44.654081 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1565/3135] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:44 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:45.674668 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6f945c3a-1742-4c26-ad54-e61504846169 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:45.675623 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6f945c3a-1742-4c26-ad54-e61504846169 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:45.685902 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f945c3a-1742-4c26-ad54-e61504846169 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:45.686905 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f945c3a-1742-4c26-ad54-e61504846169 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:45.687594 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f945c3a-1742-4c26-ad54-e61504846169 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:45.688025 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6f945c3a-1742-4c26-ad54-e61504846169 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:45.750750 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6f945c3a-1742-4c26-ad54-e61504846169 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:45.759494 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6f945c3a-1742-4c26-ad54-e61504846169 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.091981 Apr 06 17:03:45.760058 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1571/3136] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:45 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:46.783616 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5d0e9fc8-9bde-4841-9462-02cd44ff6aed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:46.784515 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5d0e9fc8-9bde-4841-9462-02cd44ff6aed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:46.794341 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d0e9fc8-9bde-4841-9462-02cd44ff6aed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:46.795021 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d0e9fc8-9bde-4841-9462-02cd44ff6aed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:46.796121 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d0e9fc8-9bde-4841-9462-02cd44ff6aed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:46.796777 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d0e9fc8-9bde-4841-9462-02cd44ff6aed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:46.858900 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5d0e9fc8-9bde-4841-9462-02cd44ff6aed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:46.870119 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5d0e9fc8-9bde-4841-9462-02cd44ff6aed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.093814 Apr 06 17:03:46.870692 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1566/3137] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:46 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:47.891892 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9946c97d-68b5-4525-8b6d-66547f841f25 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:47.892994 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9946c97d-68b5-4525-8b6d-66547f841f25 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:47.903620 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9946c97d-68b5-4525-8b6d-66547f841f25 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:47.904430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9946c97d-68b5-4525-8b6d-66547f841f25 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:47.905858 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9946c97d-68b5-4525-8b6d-66547f841f25 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:47.906388 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9946c97d-68b5-4525-8b6d-66547f841f25 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:47.982602 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9946c97d-68b5-4525-8b6d-66547f841f25 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:47.994216 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9946c97d-68b5-4525-8b6d-66547f841f25 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.108981 Apr 06 17:03:47.994929 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1572/3138] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:47 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:49.017740 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c8938c7c-92a5-43ef-82de-deb418f4568a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:49.018743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c8938c7c-92a5-43ef-82de-deb418f4568a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:49.029861 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8938c7c-92a5-43ef-82de-deb418f4568a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:49.030904 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8938c7c-92a5-43ef-82de-deb418f4568a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:49.032019 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8938c7c-92a5-43ef-82de-deb418f4568a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:49.032707 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8938c7c-92a5-43ef-82de-deb418f4568a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:49.109177 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c8938c7c-92a5-43ef-82de-deb418f4568a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:49.117361 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c8938c7c-92a5-43ef-82de-deb418f4568a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.106059 Apr 06 17:03:49.117924 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1567/3139] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:49 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:50.137498 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-add458e7-ba42-4468-b078-396aab33e616 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:50.138121 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-add458e7-ba42-4468-b078-396aab33e616 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:50.145317 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-add458e7-ba42-4468-b078-396aab33e616 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:50.145776 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-add458e7-ba42-4468-b078-396aab33e616 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:50.146544 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-add458e7-ba42-4468-b078-396aab33e616 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:50.147000 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-add458e7-ba42-4468-b078-396aab33e616 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:50.209673 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-add458e7-ba42-4468-b078-396aab33e616 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:50.220611 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-add458e7-ba42-4468-b078-396aab33e616 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.089500 Apr 06 17:03:50.221218 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1573/3140] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:50 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:51.247401 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-30e66922-727d-45c1-8a59-d36cfd86ccd9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:51.248376 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-30e66922-727d-45c1-8a59-d36cfd86ccd9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:51.256037 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30e66922-727d-45c1-8a59-d36cfd86ccd9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:51.256512 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30e66922-727d-45c1-8a59-d36cfd86ccd9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:51.257310 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30e66922-727d-45c1-8a59-d36cfd86ccd9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:51.257743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30e66922-727d-45c1-8a59-d36cfd86ccd9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:51.319048 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-30e66922-727d-45c1-8a59-d36cfd86ccd9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:51.328200 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-30e66922-727d-45c1-8a59-d36cfd86ccd9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.087011 Apr 06 17:03:51.339079 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1568/3141] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:51 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:52.349756 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ca99de81-612f-475d-869e-1582a46a1d35 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:52.350368 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ca99de81-612f-475d-869e-1582a46a1d35 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:52.360242 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca99de81-612f-475d-869e-1582a46a1d35 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:52.360722 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca99de81-612f-475d-869e-1582a46a1d35 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:52.361487 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca99de81-612f-475d-869e-1582a46a1d35 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:52.361921 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ca99de81-612f-475d-869e-1582a46a1d35 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:52.423244 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ca99de81-612f-475d-869e-1582a46a1d35 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:52.432060 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ca99de81-612f-475d-869e-1582a46a1d35 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.088659 Apr 06 17:03:52.432628 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1574/3142] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:52 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:53.458400 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0869cb9e-5b5a-451a-ad79-6726bb1b8604 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:53.459510 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0869cb9e-5b5a-451a-ad79-6726bb1b8604 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:53.469676 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0869cb9e-5b5a-451a-ad79-6726bb1b8604 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:53.470138 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0869cb9e-5b5a-451a-ad79-6726bb1b8604 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:53.470881 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0869cb9e-5b5a-451a-ad79-6726bb1b8604 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:53.471336 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0869cb9e-5b5a-451a-ad79-6726bb1b8604 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:53.537745 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0869cb9e-5b5a-451a-ad79-6726bb1b8604 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:53.546066 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0869cb9e-5b5a-451a-ad79-6726bb1b8604 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.094575 Apr 06 17:03:53.546865 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1569/3143] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:53 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:54.563639 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-db37ccda-23b1-43d7-bd1f-0376345aafbe tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:54.564253 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-db37ccda-23b1-43d7-bd1f-0376345aafbe tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:54.571174 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db37ccda-23b1-43d7-bd1f-0376345aafbe tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:54.571629 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db37ccda-23b1-43d7-bd1f-0376345aafbe tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:54.572395 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db37ccda-23b1-43d7-bd1f-0376345aafbe tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:54.572861 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-db37ccda-23b1-43d7-bd1f-0376345aafbe tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:54.643653 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-db37ccda-23b1-43d7-bd1f-0376345aafbe tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:54.654280 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-db37ccda-23b1-43d7-bd1f-0376345aafbe tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.094319 Apr 06 17:03:54.655171 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1575/3144] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:54 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:55.676360 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5df969ab-6429-44ab-9889-5d0f59bddf6e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:55.677475 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5df969ab-6429-44ab-9889-5d0f59bddf6e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:55.688127 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5df969ab-6429-44ab-9889-5d0f59bddf6e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:55.688580 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5df969ab-6429-44ab-9889-5d0f59bddf6e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:55.689383 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5df969ab-6429-44ab-9889-5d0f59bddf6e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:55.689814 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5df969ab-6429-44ab-9889-5d0f59bddf6e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:55.759985 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5df969ab-6429-44ab-9889-5d0f59bddf6e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:55.769178 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5df969ab-6429-44ab-9889-5d0f59bddf6e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.099808 Apr 06 17:03:55.769767 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1570/3145] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:55 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:56.790472 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f0b363d6-4069-4291-98d1-a57a14e3f3d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:56.791502 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f0b363d6-4069-4291-98d1-a57a14e3f3d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:56.800398 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0b363d6-4069-4291-98d1-a57a14e3f3d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:56.800879 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0b363d6-4069-4291-98d1-a57a14e3f3d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:56.801650 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0b363d6-4069-4291-98d1-a57a14e3f3d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:56.802084 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f0b363d6-4069-4291-98d1-a57a14e3f3d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:56.872642 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f0b363d6-4069-4291-98d1-a57a14e3f3d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:56.881229 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f0b363d6-4069-4291-98d1-a57a14e3f3d7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.097587 Apr 06 17:03:56.881831 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1576/3146] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:56 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:57.905699 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-86fd3ec3-56a2-4eff-94bb-c4f15958a7fd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:57.906675 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-86fd3ec3-56a2-4eff-94bb-c4f15958a7fd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:57.913744 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86fd3ec3-56a2-4eff-94bb-c4f15958a7fd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:57.914187 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86fd3ec3-56a2-4eff-94bb-c4f15958a7fd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:57.914946 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86fd3ec3-56a2-4eff-94bb-c4f15958a7fd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:57.915372 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86fd3ec3-56a2-4eff-94bb-c4f15958a7fd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:57.974267 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-86fd3ec3-56a2-4eff-94bb-c4f15958a7fd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:57.982669 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-86fd3ec3-56a2-4eff-94bb-c4f15958a7fd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.083449 Apr 06 17:03:57.983230 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1571/3147] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:57 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:03:59.003540 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c2c80f80-3f5d-4beb-9570-6d937bd2ff15 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:03:59.004581 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c2c80f80-3f5d-4beb-9570-6d937bd2ff15 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:03:59.015163 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2c80f80-3f5d-4beb-9570-6d937bd2ff15 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:59.016048 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2c80f80-3f5d-4beb-9570-6d937bd2ff15 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:59.016815 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2c80f80-3f5d-4beb-9570-6d937bd2ff15 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:03:59.017244 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2c80f80-3f5d-4beb-9570-6d937bd2ff15 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:03:59.083850 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c2c80f80-3f5d-4beb-9570-6d937bd2ff15 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:03:59.091879 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c2c80f80-3f5d-4beb-9570-6d937bd2ff15 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.094784 Apr 06 17:03:59.092429 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1577/3148] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:03:58 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:00.111075 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c7a6d47b-567a-4220-9c6e-bba55de7e846 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:00.111916 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c7a6d47b-567a-4220-9c6e-bba55de7e846 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:00.119847 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7a6d47b-567a-4220-9c6e-bba55de7e846 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:00.120379 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7a6d47b-567a-4220-9c6e-bba55de7e846 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:00.121342 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7a6d47b-567a-4220-9c6e-bba55de7e846 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:00.121859 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7a6d47b-567a-4220-9c6e-bba55de7e846 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:00.182677 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c7a6d47b-567a-4220-9c6e-bba55de7e846 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:00.191380 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c7a6d47b-567a-4220-9c6e-bba55de7e846 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.085541 Apr 06 17:04:00.191959 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1572/3149] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:00 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:01.268619 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-42d0a47c-776c-46c2-820c-bd4632d58f75 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:01.269264 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-42d0a47c-776c-46c2-820c-bd4632d58f75 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:01.275441 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42d0a47c-776c-46c2-820c-bd4632d58f75 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:01.275896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42d0a47c-776c-46c2-820c-bd4632d58f75 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:01.276657 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42d0a47c-776c-46c2-820c-bd4632d58f75 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:01.277102 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42d0a47c-776c-46c2-820c-bd4632d58f75 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:01.341308 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-42d0a47c-776c-46c2-820c-bd4632d58f75 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:01.350373 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-42d0a47c-776c-46c2-820c-bd4632d58f75 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.144144 Apr 06 17:04:01.350950 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1578/3150] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:01 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:02.368397 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-891418d7-5acd-480e-869e-ac52e0d9267a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:02.369044 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-891418d7-5acd-480e-869e-ac52e0d9267a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:02.379414 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-891418d7-5acd-480e-869e-ac52e0d9267a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:02.380082 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-891418d7-5acd-480e-869e-ac52e0d9267a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:02.381476 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-891418d7-5acd-480e-869e-ac52e0d9267a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:02.382154 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-891418d7-5acd-480e-869e-ac52e0d9267a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:02.449780 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-891418d7-5acd-480e-869e-ac52e0d9267a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:02.458700 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-891418d7-5acd-480e-869e-ac52e0d9267a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.094883 Apr 06 17:04:02.459277 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1573/3151] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:02 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:03.485708 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3a8b44d3-0a4c-43ec-91a9-ebbd94ca4b80 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:03.486662 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3a8b44d3-0a4c-43ec-91a9-ebbd94ca4b80 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:03.497495 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a8b44d3-0a4c-43ec-91a9-ebbd94ca4b80 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:03.498246 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a8b44d3-0a4c-43ec-91a9-ebbd94ca4b80 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:03.499552 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a8b44d3-0a4c-43ec-91a9-ebbd94ca4b80 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:03.500435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a8b44d3-0a4c-43ec-91a9-ebbd94ca4b80 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:03.574048 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3a8b44d3-0a4c-43ec-91a9-ebbd94ca4b80 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:03.585871 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3a8b44d3-0a4c-43ec-91a9-ebbd94ca4b80 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.107067 Apr 06 17:04:03.586507 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1579/3152] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:03 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:04.611026 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bebbbdea-7a1f-4ff7-83b4-0092c1f9340f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:04.611932 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bebbbdea-7a1f-4ff7-83b4-0092c1f9340f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:04.622483 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bebbbdea-7a1f-4ff7-83b4-0092c1f9340f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:04.623227 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bebbbdea-7a1f-4ff7-83b4-0092c1f9340f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:04.624493 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bebbbdea-7a1f-4ff7-83b4-0092c1f9340f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:04.625258 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bebbbdea-7a1f-4ff7-83b4-0092c1f9340f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:04.683718 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-bebbbdea-7a1f-4ff7-83b4-0092c1f9340f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:04.694923 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bebbbdea-7a1f-4ff7-83b4-0092c1f9340f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.090785 Apr 06 17:04:04.695654 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1574/3153] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:04 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:05.715921 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f33d1fdd-50e9-4b50-97f9-b74256e596ce tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:05.716936 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f33d1fdd-50e9-4b50-97f9-b74256e596ce tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:05.727798 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f33d1fdd-50e9-4b50-97f9-b74256e596ce tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:05.728525 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f33d1fdd-50e9-4b50-97f9-b74256e596ce tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:05.729878 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f33d1fdd-50e9-4b50-97f9-b74256e596ce tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:05.730579 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f33d1fdd-50e9-4b50-97f9-b74256e596ce tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:05.792348 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f33d1fdd-50e9-4b50-97f9-b74256e596ce tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:05.801423 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f33d1fdd-50e9-4b50-97f9-b74256e596ce tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.092107 Apr 06 17:04:05.801997 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1580/3154] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:05 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:06.823373 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fcf051de-c967-476d-a1ed-71849c28971e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:06.824339 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fcf051de-c967-476d-a1ed-71849c28971e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:06.835742 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcf051de-c967-476d-a1ed-71849c28971e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:06.837071 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcf051de-c967-476d-a1ed-71849c28971e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:06.839385 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcf051de-c967-476d-a1ed-71849c28971e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:06.840743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcf051de-c967-476d-a1ed-71849c28971e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:06.906714 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fcf051de-c967-476d-a1ed-71849c28971e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:06.915787 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fcf051de-c967-476d-a1ed-71849c28971e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.098936 Apr 06 17:04:06.922388 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1575/3155] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:06 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:07.938223 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c659ce06-a3ba-435e-b70d-28ee04a0c258 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:07.939727 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c659ce06-a3ba-435e-b70d-28ee04a0c258 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:07.950520 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c659ce06-a3ba-435e-b70d-28ee04a0c258 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:07.951256 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c659ce06-a3ba-435e-b70d-28ee04a0c258 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:07.952532 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c659ce06-a3ba-435e-b70d-28ee04a0c258 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:07.953308 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c659ce06-a3ba-435e-b70d-28ee04a0c258 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:08.017245 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c659ce06-a3ba-435e-b70d-28ee04a0c258 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:08.025558 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c659ce06-a3ba-435e-b70d-28ee04a0c258 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.094049 Apr 06 17:04:08.026124 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1581/3156] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:07 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:09.046404 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1624f955-a548-46bc-bf5f-f0f61a81504d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:09.047839 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1624f955-a548-46bc-bf5f-f0f61a81504d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:09.058636 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1624f955-a548-46bc-bf5f-f0f61a81504d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:09.059369 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1624f955-a548-46bc-bf5f-f0f61a81504d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:09.060639 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1624f955-a548-46bc-bf5f-f0f61a81504d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:09.061408 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1624f955-a548-46bc-bf5f-f0f61a81504d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:09.121398 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1624f955-a548-46bc-bf5f-f0f61a81504d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:09.132924 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1624f955-a548-46bc-bf5f-f0f61a81504d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.092937 Apr 06 17:04:09.133591 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1576/3157] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:09 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:10.159392 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a15b785b-52e3-4fc3-9fd5-52ab89478250 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:10.160067 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a15b785b-52e3-4fc3-9fd5-52ab89478250 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:10.170855 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a15b785b-52e3-4fc3-9fd5-52ab89478250 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:10.171502 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a15b785b-52e3-4fc3-9fd5-52ab89478250 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:10.172735 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a15b785b-52e3-4fc3-9fd5-52ab89478250 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:10.173248 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a15b785b-52e3-4fc3-9fd5-52ab89478250 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:10.238584 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a15b785b-52e3-4fc3-9fd5-52ab89478250 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:10.246887 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a15b785b-52e3-4fc3-9fd5-52ab89478250 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.093974 Apr 06 17:04:10.247462 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1582/3158] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:10 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:11.268179 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9fab657e-a4ac-4b4f-86da-289031efa771 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:11.269213 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9fab657e-a4ac-4b4f-86da-289031efa771 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:11.280036 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9fab657e-a4ac-4b4f-86da-289031efa771 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:11.280839 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9fab657e-a4ac-4b4f-86da-289031efa771 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:11.282024 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9fab657e-a4ac-4b4f-86da-289031efa771 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:11.282668 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9fab657e-a4ac-4b4f-86da-289031efa771 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:11.352569 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9fab657e-a4ac-4b4f-86da-289031efa771 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:11.361026 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9fab657e-a4ac-4b4f-86da-289031efa771 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.099293 Apr 06 17:04:11.361594 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1577/3159] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:11 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:12.382826 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5609be74-f74f-4447-8ea6-2f1491ecf136 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:12.383834 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5609be74-f74f-4447-8ea6-2f1491ecf136 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:12.393274 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5609be74-f74f-4447-8ea6-2f1491ecf136 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:12.393757 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5609be74-f74f-4447-8ea6-2f1491ecf136 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:12.394493 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5609be74-f74f-4447-8ea6-2f1491ecf136 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:12.394958 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5609be74-f74f-4447-8ea6-2f1491ecf136 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:12.466332 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5609be74-f74f-4447-8ea6-2f1491ecf136 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:12.474190 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5609be74-f74f-4447-8ea6-2f1491ecf136 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.098155 Apr 06 17:04:12.474799 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1583/3160] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:12 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:13.496200 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-883bb8d9-08a7-4a10-9dbe-0d1ede123846 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:13.501321 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-883bb8d9-08a7-4a10-9dbe-0d1ede123846 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:13.507866 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-883bb8d9-08a7-4a10-9dbe-0d1ede123846 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:13.508542 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-883bb8d9-08a7-4a10-9dbe-0d1ede123846 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:13.509797 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-883bb8d9-08a7-4a10-9dbe-0d1ede123846 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:13.510457 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-883bb8d9-08a7-4a10-9dbe-0d1ede123846 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:13.584012 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-883bb8d9-08a7-4a10-9dbe-0d1ede123846 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:13.592400 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-883bb8d9-08a7-4a10-9dbe-0d1ede123846 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.102677 Apr 06 17:04:13.593019 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1578/3161] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:13 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:14.612915 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-63d8c2b5-958e-43a7-85b9-61d05920808a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:14.613510 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-63d8c2b5-958e-43a7-85b9-61d05920808a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:14.620413 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63d8c2b5-958e-43a7-85b9-61d05920808a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:14.620887 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63d8c2b5-958e-43a7-85b9-61d05920808a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:14.621635 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63d8c2b5-958e-43a7-85b9-61d05920808a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:14.622062 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-63d8c2b5-958e-43a7-85b9-61d05920808a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:14.691006 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-63d8c2b5-958e-43a7-85b9-61d05920808a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:14.699343 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-63d8c2b5-958e-43a7-85b9-61d05920808a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.091731 Apr 06 17:04:14.699902 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1584/3162] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:14 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:15.717198 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9445e6c7-d079-4aba-ab99-bf676a9ab2d1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:15.717831 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9445e6c7-d079-4aba-ab99-bf676a9ab2d1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:15.724842 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9445e6c7-d079-4aba-ab99-bf676a9ab2d1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:15.725253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9445e6c7-d079-4aba-ab99-bf676a9ab2d1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:15.726020 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9445e6c7-d079-4aba-ab99-bf676a9ab2d1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:15.726447 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9445e6c7-d079-4aba-ab99-bf676a9ab2d1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:15.789757 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9445e6c7-d079-4aba-ab99-bf676a9ab2d1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:15.798589 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9445e6c7-d079-4aba-ab99-bf676a9ab2d1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.085192 Apr 06 17:04:15.799120 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1579/3163] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:15 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:16.819096 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-855eda74-a49a-4eba-8e5f-373cea094221 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:16.819897 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-855eda74-a49a-4eba-8e5f-373cea094221 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:16.828668 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-855eda74-a49a-4eba-8e5f-373cea094221 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:16.829472 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-855eda74-a49a-4eba-8e5f-373cea094221 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:16.830257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-855eda74-a49a-4eba-8e5f-373cea094221 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:16.830695 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-855eda74-a49a-4eba-8e5f-373cea094221 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:16.891907 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-855eda74-a49a-4eba-8e5f-373cea094221 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:16.900036 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-855eda74-a49a-4eba-8e5f-373cea094221 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.086626 Apr 06 17:04:16.900605 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1585/3164] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:16 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:17.921440 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d6d5ec5e-0bcd-4054-9126-7d7ae9abddab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:17.922397 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d6d5ec5e-0bcd-4054-9126-7d7ae9abddab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:17.929464 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6d5ec5e-0bcd-4054-9126-7d7ae9abddab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:17.929902 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6d5ec5e-0bcd-4054-9126-7d7ae9abddab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:17.930678 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6d5ec5e-0bcd-4054-9126-7d7ae9abddab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:17.931115 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6d5ec5e-0bcd-4054-9126-7d7ae9abddab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:18.002879 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d6d5ec5e-0bcd-4054-9126-7d7ae9abddab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:18.011450 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d6d5ec5e-0bcd-4054-9126-7d7ae9abddab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.096731 Apr 06 17:04:18.012018 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1580/3165] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:17 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:19.029129 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-88f7fe48-006c-4300-aef1-c87f541d15aa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:19.029799 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-88f7fe48-006c-4300-aef1-c87f541d15aa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:19.036525 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88f7fe48-006c-4300-aef1-c87f541d15aa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:19.037002 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88f7fe48-006c-4300-aef1-c87f541d15aa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:19.037769 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88f7fe48-006c-4300-aef1-c87f541d15aa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:19.038208 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88f7fe48-006c-4300-aef1-c87f541d15aa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:19.101522 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-88f7fe48-006c-4300-aef1-c87f541d15aa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:19.110486 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-88f7fe48-006c-4300-aef1-c87f541d15aa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.085361 Apr 06 17:04:19.111052 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1586/3166] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:19 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:20.129496 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0a04d726-6fdf-4bc7-9146-9f11a2641390 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:20.130131 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0a04d726-6fdf-4bc7-9146-9f11a2641390 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:20.139565 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a04d726-6fdf-4bc7-9146-9f11a2641390 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:20.140174 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a04d726-6fdf-4bc7-9146-9f11a2641390 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:20.141313 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a04d726-6fdf-4bc7-9146-9f11a2641390 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:20.141842 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a04d726-6fdf-4bc7-9146-9f11a2641390 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:20.208215 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0a04d726-6fdf-4bc7-9146-9f11a2641390 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:20.216593 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0a04d726-6fdf-4bc7-9146-9f11a2641390 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.092599 Apr 06 17:04:20.217184 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1581/3167] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:20 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:21.236199 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9d416967-bbe0-4817-a5da-4e8c4dbace8c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:21.236908 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9d416967-bbe0-4817-a5da-4e8c4dbace8c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:21.244674 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d416967-bbe0-4817-a5da-4e8c4dbace8c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:21.245295 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d416967-bbe0-4817-a5da-4e8c4dbace8c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:21.246248 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d416967-bbe0-4817-a5da-4e8c4dbace8c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:21.246777 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d416967-bbe0-4817-a5da-4e8c4dbace8c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:21.320437 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9d416967-bbe0-4817-a5da-4e8c4dbace8c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:21.329351 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9d416967-bbe0-4817-a5da-4e8c4dbace8c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.097576 Apr 06 17:04:21.329922 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1587/3168] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:21 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:22.348599 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b4d11ce9-f756-437d-a845-a0b2c0633ab7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:22.349312 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b4d11ce9-f756-437d-a845-a0b2c0633ab7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:22.356601 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4d11ce9-f756-437d-a845-a0b2c0633ab7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:22.357078 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4d11ce9-f756-437d-a845-a0b2c0633ab7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:22.357829 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4d11ce9-f756-437d-a845-a0b2c0633ab7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:22.358257 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4d11ce9-f756-437d-a845-a0b2c0633ab7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:22.422141 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b4d11ce9-f756-437d-a845-a0b2c0633ab7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:22.434395 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b4d11ce9-f756-437d-a845-a0b2c0633ab7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.089875 Apr 06 17:04:22.435161 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1582/3169] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:22 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:23.457495 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-49cb8ca0-d517-4479-a4f2-41457cc34caa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:23.458456 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-49cb8ca0-d517-4479-a4f2-41457cc34caa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:23.469206 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49cb8ca0-d517-4479-a4f2-41457cc34caa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:23.469968 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49cb8ca0-d517-4479-a4f2-41457cc34caa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:23.471371 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49cb8ca0-d517-4479-a4f2-41457cc34caa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:23.471834 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-49cb8ca0-d517-4479-a4f2-41457cc34caa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:23.535047 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-49cb8ca0-d517-4479-a4f2-41457cc34caa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:23.543264 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-49cb8ca0-d517-4479-a4f2-41457cc34caa tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.092347 Apr 06 17:04:23.543832 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1588/3170] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:23 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:24.564895 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-53bd5a81-a6f4-4c8d-b60d-07193a9206ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:24.566484 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-53bd5a81-a6f4-4c8d-b60d-07193a9206ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:24.577364 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53bd5a81-a6f4-4c8d-b60d-07193a9206ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:24.578216 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53bd5a81-a6f4-4c8d-b60d-07193a9206ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:24.579492 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53bd5a81-a6f4-4c8d-b60d-07193a9206ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:24.580214 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53bd5a81-a6f4-4c8d-b60d-07193a9206ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:24.641348 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-53bd5a81-a6f4-4c8d-b60d-07193a9206ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:24.649527 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-53bd5a81-a6f4-4c8d-b60d-07193a9206ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.091177 Apr 06 17:04:24.650122 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1583/3171] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:24 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:25.674243 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-93788e74-2d90-4846-8aa2-aaab48f76d16 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:25.675476 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-93788e74-2d90-4846-8aa2-aaab48f76d16 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:25.686317 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93788e74-2d90-4846-8aa2-aaab48f76d16 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:25.687071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93788e74-2d90-4846-8aa2-aaab48f76d16 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:25.688343 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93788e74-2d90-4846-8aa2-aaab48f76d16 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:25.689262 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-93788e74-2d90-4846-8aa2-aaab48f76d16 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:25.752185 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-93788e74-2d90-4846-8aa2-aaab48f76d16 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:25.760524 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-93788e74-2d90-4846-8aa2-aaab48f76d16 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.092873 Apr 06 17:04:25.761131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1589/3172] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:25 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:26.781554 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4a141a3c-91dd-4040-b71d-3a58c2de8a35 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:26.782524 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4a141a3c-91dd-4040-b71d-3a58c2de8a35 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:26.793548 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a141a3c-91dd-4040-b71d-3a58c2de8a35 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:26.794282 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a141a3c-91dd-4040-b71d-3a58c2de8a35 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:26.795536 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a141a3c-91dd-4040-b71d-3a58c2de8a35 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:26.796251 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a141a3c-91dd-4040-b71d-3a58c2de8a35 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:26.858148 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4a141a3c-91dd-4040-b71d-3a58c2de8a35 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:26.867500 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4a141a3c-91dd-4040-b71d-3a58c2de8a35 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.092577 Apr 06 17:04:26.868082 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1584/3173] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:26 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:27.887966 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-253747e8-4fa2-4945-931a-900933d054ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:27.888754 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-253747e8-4fa2-4945-931a-900933d054ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:27.897818 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-253747e8-4fa2-4945-931a-900933d054ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:27.898271 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-253747e8-4fa2-4945-931a-900933d054ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:27.899079 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-253747e8-4fa2-4945-931a-900933d054ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:27.899520 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-253747e8-4fa2-4945-931a-900933d054ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:27.972602 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-253747e8-4fa2-4945-931a-900933d054ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:27.981948 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-253747e8-4fa2-4945-931a-900933d054ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.100404 Apr 06 17:04:27.982519 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1590/3174] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:27 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:29.001654 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d556715c-c09e-4af6-bfa3-9fb265d9c9b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:29.002315 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d556715c-c09e-4af6-bfa3-9fb265d9c9b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:29.009366 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d556715c-c09e-4af6-bfa3-9fb265d9c9b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:29.009811 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d556715c-c09e-4af6-bfa3-9fb265d9c9b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:29.010569 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d556715c-c09e-4af6-bfa3-9fb265d9c9b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:29.010995 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d556715c-c09e-4af6-bfa3-9fb265d9c9b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:29.077711 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d556715c-c09e-4af6-bfa3-9fb265d9c9b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:29.086144 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d556715c-c09e-4af6-bfa3-9fb265d9c9b1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.088381 Apr 06 17:04:29.086724 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1585/3175] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:28 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:30.109988 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eba8ea9f-e926-424a-bee3-8c8a216015a0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:30.110968 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eba8ea9f-e926-424a-bee3-8c8a216015a0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:30.119105 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eba8ea9f-e926-424a-bee3-8c8a216015a0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:30.119564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eba8ea9f-e926-424a-bee3-8c8a216015a0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:30.120332 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eba8ea9f-e926-424a-bee3-8c8a216015a0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:30.120802 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eba8ea9f-e926-424a-bee3-8c8a216015a0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:30.181931 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-eba8ea9f-e926-424a-bee3-8c8a216015a0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:30.190372 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eba8ea9f-e926-424a-bee3-8c8a216015a0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.088023 Apr 06 17:04:30.190958 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1591/3176] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:30 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:31.212393 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-13ca9440-6888-4857-8dc7-6848f845d75b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:31.213582 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-13ca9440-6888-4857-8dc7-6848f845d75b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:31.224390 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13ca9440-6888-4857-8dc7-6848f845d75b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:31.224882 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13ca9440-6888-4857-8dc7-6848f845d75b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:31.225652 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13ca9440-6888-4857-8dc7-6848f845d75b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:31.226085 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13ca9440-6888-4857-8dc7-6848f845d75b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:31.296215 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-13ca9440-6888-4857-8dc7-6848f845d75b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:31.304625 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-13ca9440-6888-4857-8dc7-6848f845d75b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.099434 Apr 06 17:04:31.305238 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1586/3177] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:31 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:32.325086 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f32b1974-d59f-48e7-8d55-27dcbb9be0d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:32.325998 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f32b1974-d59f-48e7-8d55-27dcbb9be0d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:32.332983 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f32b1974-d59f-48e7-8d55-27dcbb9be0d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:32.333436 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f32b1974-d59f-48e7-8d55-27dcbb9be0d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:32.334247 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f32b1974-d59f-48e7-8d55-27dcbb9be0d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:32.334684 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f32b1974-d59f-48e7-8d55-27dcbb9be0d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:32.407934 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f32b1974-d59f-48e7-8d55-27dcbb9be0d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:32.417681 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f32b1974-d59f-48e7-8d55-27dcbb9be0d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.099042 Apr 06 17:04:32.418504 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1592/3178] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:32 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:33.439613 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-30b2f7c2-75b5-4d8f-ba05-9b3aebb1c760 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:33.440576 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-30b2f7c2-75b5-4d8f-ba05-9b3aebb1c760 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:33.449586 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30b2f7c2-75b5-4d8f-ba05-9b3aebb1c760 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:33.450073 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30b2f7c2-75b5-4d8f-ba05-9b3aebb1c760 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:33.450850 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30b2f7c2-75b5-4d8f-ba05-9b3aebb1c760 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:33.451288 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30b2f7c2-75b5-4d8f-ba05-9b3aebb1c760 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:33.519345 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-30b2f7c2-75b5-4d8f-ba05-9b3aebb1c760 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:33.533364 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-30b2f7c2-75b5-4d8f-ba05-9b3aebb1c760 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.100101 Apr 06 17:04:33.534240 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1587/3179] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:33 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:34.559871 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bdd5dcdd-ac0c-4703-8ad5-f61203dad107 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:34.560939 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bdd5dcdd-ac0c-4703-8ad5-f61203dad107 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:34.571637 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdd5dcdd-ac0c-4703-8ad5-f61203dad107 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:34.572381 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdd5dcdd-ac0c-4703-8ad5-f61203dad107 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:34.573679 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdd5dcdd-ac0c-4703-8ad5-f61203dad107 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:34.574405 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bdd5dcdd-ac0c-4703-8ad5-f61203dad107 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:34.637895 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-bdd5dcdd-ac0c-4703-8ad5-f61203dad107 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:34.645952 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bdd5dcdd-ac0c-4703-8ad5-f61203dad107 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.092798 Apr 06 17:04:34.646514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1593/3180] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:34 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:35.667579 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9ec73705-e277-4e20-aee9-4bb57f8af437 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:35.668550 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9ec73705-e277-4e20-aee9-4bb57f8af437 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:35.681882 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ec73705-e277-4e20-aee9-4bb57f8af437 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:35.682645 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ec73705-e277-4e20-aee9-4bb57f8af437 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:35.683952 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ec73705-e277-4e20-aee9-4bb57f8af437 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:35.684855 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ec73705-e277-4e20-aee9-4bb57f8af437 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:35.748031 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9ec73705-e277-4e20-aee9-4bb57f8af437 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:35.756835 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9ec73705-e277-4e20-aee9-4bb57f8af437 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.096197 Apr 06 17:04:35.757435 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1588/3181] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:35 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:36.777797 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c6c221a7-e817-485e-b972-5ef74d99ca00 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:36.778776 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c6c221a7-e817-485e-b972-5ef74d99ca00 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:36.789790 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6c221a7-e817-485e-b972-5ef74d99ca00 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:36.790530 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6c221a7-e817-485e-b972-5ef74d99ca00 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:36.791760 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6c221a7-e817-485e-b972-5ef74d99ca00 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:36.792442 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c6c221a7-e817-485e-b972-5ef74d99ca00 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:36.857911 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c6c221a7-e817-485e-b972-5ef74d99ca00 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:36.868017 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c6c221a7-e817-485e-b972-5ef74d99ca00 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.096818 Apr 06 17:04:36.868596 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1594/3182] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:36 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:37.889853 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1f0feb4f-3e61-40e5-871c-62468de1ead0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:37.890850 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1f0feb4f-3e61-40e5-871c-62468de1ead0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:37.901757 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f0feb4f-3e61-40e5-871c-62468de1ead0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:37.902516 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f0feb4f-3e61-40e5-871c-62468de1ead0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:37.903778 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f0feb4f-3e61-40e5-871c-62468de1ead0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:37.904500 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f0feb4f-3e61-40e5-871c-62468de1ead0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:37.970867 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1f0feb4f-3e61-40e5-871c-62468de1ead0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:37.979967 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1f0feb4f-3e61-40e5-871c-62468de1ead0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.096707 Apr 06 17:04:37.980539 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1589/3183] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:37 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:38.999836 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e4eb74f2-2679-4d57-a0fa-99852aa2aa5e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:39.000656 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e4eb74f2-2679-4d57-a0fa-99852aa2aa5e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:39.009803 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4eb74f2-2679-4d57-a0fa-99852aa2aa5e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:39.010405 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4eb74f2-2679-4d57-a0fa-99852aa2aa5e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:39.011424 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4eb74f2-2679-4d57-a0fa-99852aa2aa5e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:39.012130 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4eb74f2-2679-4d57-a0fa-99852aa2aa5e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:39.073748 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e4eb74f2-2679-4d57-a0fa-99852aa2aa5e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:39.082138 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e4eb74f2-2679-4d57-a0fa-99852aa2aa5e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.087660 Apr 06 17:04:39.082985 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1595/3184] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:38 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:40.099781 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6acbb388-df4b-4e6b-afdb-314cd438a649 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:40.100429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6acbb388-df4b-4e6b-afdb-314cd438a649 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:40.108139 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6acbb388-df4b-4e6b-afdb-314cd438a649 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:40.108613 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6acbb388-df4b-4e6b-afdb-314cd438a649 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:40.109493 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6acbb388-df4b-4e6b-afdb-314cd438a649 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:40.109839 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6acbb388-df4b-4e6b-afdb-314cd438a649 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:40.225737 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6acbb388-df4b-4e6b-afdb-314cd438a649 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:40.235160 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6acbb388-df4b-4e6b-afdb-314cd438a649 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.139300 Apr 06 17:04:40.235753 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1590/3185] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:40 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:41.253694 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-965a729d-10cb-4814-a0e3-90569bade62d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:41.254260 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-965a729d-10cb-4814-a0e3-90569bade62d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:41.261019 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-965a729d-10cb-4814-a0e3-90569bade62d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:41.261468 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-965a729d-10cb-4814-a0e3-90569bade62d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:41.262236 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-965a729d-10cb-4814-a0e3-90569bade62d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:41.262670 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-965a729d-10cb-4814-a0e3-90569bade62d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:41.326185 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-965a729d-10cb-4814-a0e3-90569bade62d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:41.334802 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-965a729d-10cb-4814-a0e3-90569bade62d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.085053 Apr 06 17:04:41.335381 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1596/3186] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:41 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:42.352388 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b22c0cd5-0777-41a2-a1db-0455fdd09ef3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:42.353028 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b22c0cd5-0777-41a2-a1db-0455fdd09ef3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:42.360251 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b22c0cd5-0777-41a2-a1db-0455fdd09ef3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:42.360782 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b22c0cd5-0777-41a2-a1db-0455fdd09ef3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:42.361965 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b22c0cd5-0777-41a2-a1db-0455fdd09ef3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:42.362575 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b22c0cd5-0777-41a2-a1db-0455fdd09ef3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:42.433822 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b22c0cd5-0777-41a2-a1db-0455fdd09ef3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:42.442620 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b22c0cd5-0777-41a2-a1db-0455fdd09ef3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.094511 Apr 06 17:04:42.443204 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1591/3187] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:42 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:43.465605 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f939a83a-1d9b-4c8a-87a2-9c6bc3d8b758 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:43.466613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f939a83a-1d9b-4c8a-87a2-9c6bc3d8b758 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:43.477537 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f939a83a-1d9b-4c8a-87a2-9c6bc3d8b758 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:43.478285 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f939a83a-1d9b-4c8a-87a2-9c6bc3d8b758 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:43.479558 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f939a83a-1d9b-4c8a-87a2-9c6bc3d8b758 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:43.480283 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f939a83a-1d9b-4c8a-87a2-9c6bc3d8b758 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:43.550153 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f939a83a-1d9b-4c8a-87a2-9c6bc3d8b758 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:43.558521 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f939a83a-1d9b-4c8a-87a2-9c6bc3d8b758 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.099400 Apr 06 17:04:43.559100 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1597/3188] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:43 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:44.579599 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-08fb27ec-a4f0-4df9-ba50-9cd46e400a74 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:44.580807 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-08fb27ec-a4f0-4df9-ba50-9cd46e400a74 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:44.591669 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08fb27ec-a4f0-4df9-ba50-9cd46e400a74 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:44.592303 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08fb27ec-a4f0-4df9-ba50-9cd46e400a74 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:44.593673 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08fb27ec-a4f0-4df9-ba50-9cd46e400a74 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:44.594386 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08fb27ec-a4f0-4df9-ba50-9cd46e400a74 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:44.656943 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-08fb27ec-a4f0-4df9-ba50-9cd46e400a74 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:44.667149 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-08fb27ec-a4f0-4df9-ba50-9cd46e400a74 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.094188 Apr 06 17:04:44.667746 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1592/3189] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:44 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:45.688576 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7a655f8b-6c71-498f-b6e1-8d9f42e13e2f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:45.689714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7a655f8b-6c71-498f-b6e1-8d9f42e13e2f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:45.701123 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a655f8b-6c71-498f-b6e1-8d9f42e13e2f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:45.701860 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a655f8b-6c71-498f-b6e1-8d9f42e13e2f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:45.703135 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a655f8b-6c71-498f-b6e1-8d9f42e13e2f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:45.703854 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a655f8b-6c71-498f-b6e1-8d9f42e13e2f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:45.767753 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7a655f8b-6c71-498f-b6e1-8d9f42e13e2f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:45.776334 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7a655f8b-6c71-498f-b6e1-8d9f42e13e2f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.094332 Apr 06 17:04:45.776927 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1598/3190] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:45 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:46.798080 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4cc19ae8-be5a-468e-85c0-414d1844220c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:46.799070 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4cc19ae8-be5a-468e-85c0-414d1844220c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:46.809763 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cc19ae8-be5a-468e-85c0-414d1844220c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:46.810504 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cc19ae8-be5a-468e-85c0-414d1844220c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:46.811759 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cc19ae8-be5a-468e-85c0-414d1844220c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:46.812471 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cc19ae8-be5a-468e-85c0-414d1844220c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:46.877538 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4cc19ae8-be5a-468e-85c0-414d1844220c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:46.886137 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4cc19ae8-be5a-468e-85c0-414d1844220c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.094717 Apr 06 17:04:46.886722 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1593/3191] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:46 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:47.907549 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1b89e997-54c3-4307-b423-23d17aa18dc2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:47.908525 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1b89e997-54c3-4307-b423-23d17aa18dc2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:47.919853 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b89e997-54c3-4307-b423-23d17aa18dc2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:47.920572 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b89e997-54c3-4307-b423-23d17aa18dc2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:47.921905 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b89e997-54c3-4307-b423-23d17aa18dc2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:47.922634 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1b89e997-54c3-4307-b423-23d17aa18dc2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:48.037715 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-1b89e997-54c3-4307-b423-23d17aa18dc2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:48.046085 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1b89e997-54c3-4307-b423-23d17aa18dc2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.145106 Apr 06 17:04:48.046665 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1599/3192] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:47 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:49.067601 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d22a8822-147a-41a0-95a7-4e1ecab9abc6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:49.068701 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d22a8822-147a-41a0-95a7-4e1ecab9abc6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:49.075894 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d22a8822-147a-41a0-95a7-4e1ecab9abc6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:49.076399 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d22a8822-147a-41a0-95a7-4e1ecab9abc6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:49.077297 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d22a8822-147a-41a0-95a7-4e1ecab9abc6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:49.077781 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d22a8822-147a-41a0-95a7-4e1ecab9abc6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:49.147779 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d22a8822-147a-41a0-95a7-4e1ecab9abc6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:49.159320 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d22a8822-147a-41a0-95a7-4e1ecab9abc6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.098079 Apr 06 17:04:49.160182 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1594/3193] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:49 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:50.180458 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c854cfc7-ba9d-4ce5-800e-68f69b14b283 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:50.181183 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c854cfc7-ba9d-4ce5-800e-68f69b14b283 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:50.188979 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c854cfc7-ba9d-4ce5-800e-68f69b14b283 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:50.189517 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c854cfc7-ba9d-4ce5-800e-68f69b14b283 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:50.190418 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c854cfc7-ba9d-4ce5-800e-68f69b14b283 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:50.190931 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c854cfc7-ba9d-4ce5-800e-68f69b14b283 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:50.260644 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c854cfc7-ba9d-4ce5-800e-68f69b14b283 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:50.269574 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c854cfc7-ba9d-4ce5-800e-68f69b14b283 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.095105 Apr 06 17:04:50.270207 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1600/3194] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:50 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:51.290533 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ffc3b7bc-786b-4725-b2a5-1b9d244a12b0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:51.291343 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ffc3b7bc-786b-4725-b2a5-1b9d244a12b0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:51.299605 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffc3b7bc-786b-4725-b2a5-1b9d244a12b0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:51.300170 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffc3b7bc-786b-4725-b2a5-1b9d244a12b0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:51.301184 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffc3b7bc-786b-4725-b2a5-1b9d244a12b0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:51.301723 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffc3b7bc-786b-4725-b2a5-1b9d244a12b0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:51.372704 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ffc3b7bc-786b-4725-b2a5-1b9d244a12b0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:51.380972 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ffc3b7bc-786b-4725-b2a5-1b9d244a12b0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.096336 Apr 06 17:04:51.381703 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1595/3195] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:51 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:52.398132 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3e9a1503-47e4-476b-856a-f71df5132da4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:52.398739 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3e9a1503-47e4-476b-856a-f71df5132da4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:52.405552 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e9a1503-47e4-476b-856a-f71df5132da4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:52.406000 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e9a1503-47e4-476b-856a-f71df5132da4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:52.406763 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e9a1503-47e4-476b-856a-f71df5132da4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:52.407197 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3e9a1503-47e4-476b-856a-f71df5132da4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:52.476816 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3e9a1503-47e4-476b-856a-f71df5132da4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:52.485743 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3e9a1503-47e4-476b-856a-f71df5132da4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.091578 Apr 06 17:04:52.486315 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1601/3196] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:52 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:53.506563 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-90a07cbd-acb1-47ef-9aef-4ac2f253cb26 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:53.507451 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-90a07cbd-acb1-47ef-9aef-4ac2f253cb26 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:53.514871 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90a07cbd-acb1-47ef-9aef-4ac2f253cb26 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:53.515377 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90a07cbd-acb1-47ef-9aef-4ac2f253cb26 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:53.516234 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90a07cbd-acb1-47ef-9aef-4ac2f253cb26 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:53.516710 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90a07cbd-acb1-47ef-9aef-4ac2f253cb26 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:53.589318 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-90a07cbd-acb1-47ef-9aef-4ac2f253cb26 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:53.597227 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-90a07cbd-acb1-47ef-9aef-4ac2f253cb26 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.097298 Apr 06 17:04:53.597800 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1596/3197] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:53 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:54.615961 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5bf47ce9-eaf6-4e87-a431-ddf29c13c81b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:54.616550 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5bf47ce9-eaf6-4e87-a431-ddf29c13c81b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:54.624044 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5bf47ce9-eaf6-4e87-a431-ddf29c13c81b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:54.624549 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5bf47ce9-eaf6-4e87-a431-ddf29c13c81b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:54.625345 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5bf47ce9-eaf6-4e87-a431-ddf29c13c81b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:54.625775 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5bf47ce9-eaf6-4e87-a431-ddf29c13c81b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:54.694378 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5bf47ce9-eaf6-4e87-a431-ddf29c13c81b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:54.703317 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5bf47ce9-eaf6-4e87-a431-ddf29c13c81b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.091312 Apr 06 17:04:54.703886 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1602/3198] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:54 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:55.724719 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-79fb8561-0a33-4f7f-bea8-5c0b3ff45aed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:55.726575 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-79fb8561-0a33-4f7f-bea8-5c0b3ff45aed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:55.736197 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79fb8561-0a33-4f7f-bea8-5c0b3ff45aed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:55.736654 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79fb8561-0a33-4f7f-bea8-5c0b3ff45aed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:55.737469 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79fb8561-0a33-4f7f-bea8-5c0b3ff45aed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:55.737903 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79fb8561-0a33-4f7f-bea8-5c0b3ff45aed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:55.798608 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-79fb8561-0a33-4f7f-bea8-5c0b3ff45aed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:55.807012 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-79fb8561-0a33-4f7f-bea8-5c0b3ff45aed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.089545 Apr 06 17:04:55.807567 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1597/3199] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:55 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:56.831981 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ef2ed85c-976c-4ae5-a8bf-5cb9eff00850 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:56.832879 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ef2ed85c-976c-4ae5-a8bf-5cb9eff00850 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:56.840995 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef2ed85c-976c-4ae5-a8bf-5cb9eff00850 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:56.841448 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef2ed85c-976c-4ae5-a8bf-5cb9eff00850 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:56.842213 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef2ed85c-976c-4ae5-a8bf-5cb9eff00850 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:56.842628 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef2ed85c-976c-4ae5-a8bf-5cb9eff00850 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:56.905872 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ef2ed85c-976c-4ae5-a8bf-5cb9eff00850 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:56.914365 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ef2ed85c-976c-4ae5-a8bf-5cb9eff00850 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.088041 Apr 06 17:04:56.914948 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1603/3200] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:56 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:57.932843 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2a102d87-16ce-45ec-8fe2-afa9f6d35c58 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:57.933545 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2a102d87-16ce-45ec-8fe2-afa9f6d35c58 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:57.941446 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a102d87-16ce-45ec-8fe2-afa9f6d35c58 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:57.941993 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a102d87-16ce-45ec-8fe2-afa9f6d35c58 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:57.942887 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a102d87-16ce-45ec-8fe2-afa9f6d35c58 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:57.943401 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a102d87-16ce-45ec-8fe2-afa9f6d35c58 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:58.007039 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2a102d87-16ce-45ec-8fe2-afa9f6d35c58 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:58.015139 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2a102d87-16ce-45ec-8fe2-afa9f6d35c58 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.087015 Apr 06 17:04:58.015721 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1598/3201] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:57 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:04:59.036174 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3762fc52-4f5e-4906-9039-1f67723a6abf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:04:59.037289 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3762fc52-4f5e-4906-9039-1f67723a6abf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:04:59.047853 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3762fc52-4f5e-4906-9039-1f67723a6abf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:59.048594 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3762fc52-4f5e-4906-9039-1f67723a6abf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:59.049913 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3762fc52-4f5e-4906-9039-1f67723a6abf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:04:59.050638 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3762fc52-4f5e-4906-9039-1f67723a6abf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:04:59.113807 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3762fc52-4f5e-4906-9039-1f67723a6abf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:04:59.121974 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3762fc52-4f5e-4906-9039-1f67723a6abf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.092557 Apr 06 17:04:59.122578 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1604/3202] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:04:59 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:00.138928 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-434aaa05-4cf9-4c5c-94e0-7c9c25ad1039 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:00.139630 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-434aaa05-4cf9-4c5c-94e0-7c9c25ad1039 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:00.146330 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-434aaa05-4cf9-4c5c-94e0-7c9c25ad1039 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:00.146769 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-434aaa05-4cf9-4c5c-94e0-7c9c25ad1039 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:00.147532 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-434aaa05-4cf9-4c5c-94e0-7c9c25ad1039 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:00.147967 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-434aaa05-4cf9-4c5c-94e0-7c9c25ad1039 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:00.214708 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-434aaa05-4cf9-4c5c-94e0-7c9c25ad1039 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:00.222548 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-434aaa05-4cf9-4c5c-94e0-7c9c25ad1039 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.087785 Apr 06 17:05:00.223119 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1599/3203] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:00 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:01.240108 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e9ee4670-2086-42cb-bfee-f7529812061f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:01.240822 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e9ee4670-2086-42cb-bfee-f7529812061f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:01.247960 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9ee4670-2086-42cb-bfee-f7529812061f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:01.248419 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9ee4670-2086-42cb-bfee-f7529812061f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:01.249181 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9ee4670-2086-42cb-bfee-f7529812061f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:01.249669 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e9ee4670-2086-42cb-bfee-f7529812061f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:01.320068 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e9ee4670-2086-42cb-bfee-f7529812061f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:01.329709 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e9ee4670-2086-42cb-bfee-f7529812061f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.093557 Apr 06 17:05:01.330531 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1605/3204] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:01 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:02.348819 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5b73416d-a9d5-4d88-97fc-241bdf0815f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:02.349393 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5b73416d-a9d5-4d88-97fc-241bdf0815f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:02.359379 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b73416d-a9d5-4d88-97fc-241bdf0815f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:02.359986 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b73416d-a9d5-4d88-97fc-241bdf0815f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:02.361137 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b73416d-a9d5-4d88-97fc-241bdf0815f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:02.361716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b73416d-a9d5-4d88-97fc-241bdf0815f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:02.432020 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5b73416d-a9d5-4d88-97fc-241bdf0815f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:02.440132 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5b73416d-a9d5-4d88-97fc-241bdf0815f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.095871 Apr 06 17:05:02.440710 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1600/3205] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:02 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:03.462182 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dd52933b-7b70-4955-9a37-6c034bdcff87 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:03.464404 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dd52933b-7b70-4955-9a37-6c034bdcff87 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:03.474907 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd52933b-7b70-4955-9a37-6c034bdcff87 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:03.475664 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd52933b-7b70-4955-9a37-6c034bdcff87 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:03.476985 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd52933b-7b70-4955-9a37-6c034bdcff87 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:03.477716 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dd52933b-7b70-4955-9a37-6c034bdcff87 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:03.544038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-dd52933b-7b70-4955-9a37-6c034bdcff87 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:03.552593 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dd52933b-7b70-4955-9a37-6c034bdcff87 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.098381 Apr 06 17:05:03.553208 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1606/3206] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:03 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:04.575364 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3e928d78-0def-43b7-b96b-e16787a60ba4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:04.576356 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3e928d78-0def-43b7-b96b-e16787a60ba4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:04.587064 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e928d78-0def-43b7-b96b-e16787a60ba4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:04.587696 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e928d78-0def-43b7-b96b-e16787a60ba4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:04.589150 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e928d78-0def-43b7-b96b-e16787a60ba4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:04.589596 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e928d78-0def-43b7-b96b-e16787a60ba4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:04.657952 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-3e928d78-0def-43b7-b96b-e16787a60ba4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:04.666706 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3e928d78-0def-43b7-b96b-e16787a60ba4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.098597 Apr 06 17:05:04.667293 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1601/3207] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:04 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:05.688082 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e2d224d9-71a1-4430-b590-8540c16f6d93 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:05.689197 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e2d224d9-71a1-4430-b590-8540c16f6d93 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:05.699259 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2d224d9-71a1-4430-b590-8540c16f6d93 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:05.699713 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2d224d9-71a1-4430-b590-8540c16f6d93 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:05.700484 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2d224d9-71a1-4430-b590-8540c16f6d93 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:05.700964 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e2d224d9-71a1-4430-b590-8540c16f6d93 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:05.768082 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e2d224d9-71a1-4430-b590-8540c16f6d93 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:05.776496 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e2d224d9-71a1-4430-b590-8540c16f6d93 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.094976 Apr 06 17:05:05.777103 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1607/3208] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:05 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:06.802283 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-940320e1-300f-4744-93bf-f6f62636f5bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:06.803237 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-940320e1-300f-4744-93bf-f6f62636f5bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:06.811544 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-940320e1-300f-4744-93bf-f6f62636f5bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:06.811999 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-940320e1-300f-4744-93bf-f6f62636f5bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:06.812833 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-940320e1-300f-4744-93bf-f6f62636f5bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:06.813271 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-940320e1-300f-4744-93bf-f6f62636f5bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:06.880177 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-940320e1-300f-4744-93bf-f6f62636f5bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:06.888962 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-940320e1-300f-4744-93bf-f6f62636f5bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.093303 Apr 06 17:05:06.889503 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1602/3209] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:06 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:07.911275 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7c620ac1-5aff-4ba7-919b-8971195e114a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:07.912252 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7c620ac1-5aff-4ba7-919b-8971195e114a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:07.920928 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c620ac1-5aff-4ba7-919b-8971195e114a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:07.921384 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c620ac1-5aff-4ba7-919b-8971195e114a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:07.922155 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c620ac1-5aff-4ba7-919b-8971195e114a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:07.922586 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7c620ac1-5aff-4ba7-919b-8971195e114a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:07.984116 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7c620ac1-5aff-4ba7-919b-8971195e114a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:07.992195 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7c620ac1-5aff-4ba7-919b-8971195e114a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.088318 Apr 06 17:05:07.992790 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1608/3210] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:07 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:09.013360 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-acbb0e5a-d713-4f0b-86d9-38774fcf50a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:09.014374 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-acbb0e5a-d713-4f0b-86d9-38774fcf50a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:09.025232 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-acbb0e5a-d713-4f0b-86d9-38774fcf50a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:09.025995 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-acbb0e5a-d713-4f0b-86d9-38774fcf50a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:09.027338 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-acbb0e5a-d713-4f0b-86d9-38774fcf50a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:09.027777 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-acbb0e5a-d713-4f0b-86d9-38774fcf50a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:09.088991 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-acbb0e5a-d713-4f0b-86d9-38774fcf50a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:09.101777 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-acbb0e5a-d713-4f0b-86d9-38774fcf50a9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.094590 Apr 06 17:05:09.102540 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1603/3211] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:09 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:10.121661 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0a26b13c-adb0-42d9-ae47-bd6b8bd399df tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:10.122439 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0a26b13c-adb0-42d9-ae47-bd6b8bd399df tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:10.130839 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a26b13c-adb0-42d9-ae47-bd6b8bd399df tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:10.131408 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a26b13c-adb0-42d9-ae47-bd6b8bd399df tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:10.132362 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a26b13c-adb0-42d9-ae47-bd6b8bd399df tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:10.132957 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0a26b13c-adb0-42d9-ae47-bd6b8bd399df tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:10.193696 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0a26b13c-adb0-42d9-ae47-bd6b8bd399df tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:10.203205 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0a26b13c-adb0-42d9-ae47-bd6b8bd399df tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.086576 Apr 06 17:05:10.203775 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1609/3212] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:10 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:11.224589 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7d56b4ec-c762-4de8-8a68-60cbe1a9e0f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:11.225585 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7d56b4ec-c762-4de8-8a68-60cbe1a9e0f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:11.236834 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d56b4ec-c762-4de8-8a68-60cbe1a9e0f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:11.237575 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d56b4ec-c762-4de8-8a68-60cbe1a9e0f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:11.238835 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d56b4ec-c762-4de8-8a68-60cbe1a9e0f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:11.239726 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d56b4ec-c762-4de8-8a68-60cbe1a9e0f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:11.319196 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7d56b4ec-c762-4de8-8a68-60cbe1a9e0f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:11.328454 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7d56b4ec-c762-4de8-8a68-60cbe1a9e0f6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.110280 Apr 06 17:05:11.329288 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1604/3213] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:11 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:12.346101 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-19e2454f-948f-47b4-aa05-75982e176741 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:12.346717 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-19e2454f-948f-47b4-aa05-75982e176741 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:12.353558 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19e2454f-948f-47b4-aa05-75982e176741 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:12.354010 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19e2454f-948f-47b4-aa05-75982e176741 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:12.354774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19e2454f-948f-47b4-aa05-75982e176741 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:12.355789 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-19e2454f-948f-47b4-aa05-75982e176741 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:12.428592 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-19e2454f-948f-47b4-aa05-75982e176741 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:12.440858 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-19e2454f-948f-47b4-aa05-75982e176741 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.098520 Apr 06 17:05:12.441613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1610/3214] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:12 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:13.467945 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6865c8b4-352a-4dad-a484-c902e7703fa1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:13.468535 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6865c8b4-352a-4dad-a484-c902e7703fa1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:13.474934 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6865c8b4-352a-4dad-a484-c902e7703fa1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:13.475387 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6865c8b4-352a-4dad-a484-c902e7703fa1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:13.476172 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6865c8b4-352a-4dad-a484-c902e7703fa1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:13.476592 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6865c8b4-352a-4dad-a484-c902e7703fa1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:13.554086 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6865c8b4-352a-4dad-a484-c902e7703fa1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:13.561994 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6865c8b4-352a-4dad-a484-c902e7703fa1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.100230 Apr 06 17:05:13.562555 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1605/3215] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:13 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:14.581359 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-319c846a-1a18-457e-8574-b1ca8202fc28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:14.582012 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-319c846a-1a18-457e-8574-b1ca8202fc28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:14.589137 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-319c846a-1a18-457e-8574-b1ca8202fc28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:14.589728 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-319c846a-1a18-457e-8574-b1ca8202fc28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:14.590298 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-319c846a-1a18-457e-8574-b1ca8202fc28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:14.590735 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-319c846a-1a18-457e-8574-b1ca8202fc28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:14.651753 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-319c846a-1a18-457e-8574-b1ca8202fc28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:14.660230 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-319c846a-1a18-457e-8574-b1ca8202fc28 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.083553 Apr 06 17:05:14.660826 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1611/3216] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:14 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:15.681634 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b269aa39-a177-460d-abd4-19742d31962d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:15.682603 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b269aa39-a177-460d-abd4-19742d31962d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:15.690815 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b269aa39-a177-460d-abd4-19742d31962d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:15.691268 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b269aa39-a177-460d-abd4-19742d31962d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:15.692036 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b269aa39-a177-460d-abd4-19742d31962d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:15.692469 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b269aa39-a177-460d-abd4-19742d31962d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:15.755150 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b269aa39-a177-460d-abd4-19742d31962d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:15.763413 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b269aa39-a177-460d-abd4-19742d31962d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.088439 Apr 06 17:05:15.768837 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1606/3217] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:15 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:16.784454 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2bd5526c-bfc5-4f7c-8aad-f23ba0b5638d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:16.785347 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2bd5526c-bfc5-4f7c-8aad-f23ba0b5638d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:16.796018 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bd5526c-bfc5-4f7c-8aad-f23ba0b5638d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:16.796634 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bd5526c-bfc5-4f7c-8aad-f23ba0b5638d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:16.797442 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bd5526c-bfc5-4f7c-8aad-f23ba0b5638d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:16.797879 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bd5526c-bfc5-4f7c-8aad-f23ba0b5638d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:16.868564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2bd5526c-bfc5-4f7c-8aad-f23ba0b5638d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:16.877129 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2bd5526c-bfc5-4f7c-8aad-f23ba0b5638d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.098943 Apr 06 17:05:16.877710 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1612/3218] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:16 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:17.904777 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-41f94ca6-062f-4cd4-8db9-9251d604adf3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:17.906354 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-41f94ca6-062f-4cd4-8db9-9251d604adf3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:17.915003 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41f94ca6-062f-4cd4-8db9-9251d604adf3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:17.915459 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41f94ca6-062f-4cd4-8db9-9251d604adf3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:17.916233 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41f94ca6-062f-4cd4-8db9-9251d604adf3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:17.916674 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41f94ca6-062f-4cd4-8db9-9251d604adf3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:17.983792 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-41f94ca6-062f-4cd4-8db9-9251d604adf3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:17.992185 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-41f94ca6-062f-4cd4-8db9-9251d604adf3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.093865 Apr 06 17:05:17.992799 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1607/3219] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:17 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:19.009736 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b2239535-34e5-4158-b292-bb767d635d65 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:19.010350 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b2239535-34e5-4158-b292-bb767d635d65 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:19.017846 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2239535-34e5-4158-b292-bb767d635d65 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:19.018302 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2239535-34e5-4158-b292-bb767d635d65 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:19.019071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2239535-34e5-4158-b292-bb767d635d65 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:19.019508 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b2239535-34e5-4158-b292-bb767d635d65 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:19.091858 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b2239535-34e5-4158-b292-bb767d635d65 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:19.100864 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b2239535-34e5-4158-b292-bb767d635d65 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.095035 Apr 06 17:05:19.101456 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1613/3220] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:19 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:20.122304 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-817148f3-619e-4077-bab2-2565db66c5ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:20.122972 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-817148f3-619e-4077-bab2-2565db66c5ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:20.130371 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-817148f3-619e-4077-bab2-2565db66c5ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:20.130815 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-817148f3-619e-4077-bab2-2565db66c5ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:20.131580 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-817148f3-619e-4077-bab2-2565db66c5ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:20.132012 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-817148f3-619e-4077-bab2-2565db66c5ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:20.202410 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-817148f3-619e-4077-bab2-2565db66c5ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:20.214521 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-817148f3-619e-4077-bab2-2565db66c5ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.098369 Apr 06 17:05:20.215105 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1608/3221] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:20 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:05:21.235939 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3d66f436-4fb8-488b-b8ee-935b58706557 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:21.236729 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3d66f436-4fb8-488b-b8ee-935b58706557 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:21.245804 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d66f436-4fb8-488b-b8ee-935b58706557 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:21.246434 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d66f436-4fb8-488b-b8ee-935b58706557 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:21.247606 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d66f436-4fb8-488b-b8ee-935b58706557 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:21.248234 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3d66f436-4fb8-488b-b8ee-935b58706557 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:21.318678 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3d66f436-4fb8-488b-b8ee-935b58706557 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:21.326888 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3d66f436-4fb8-488b-b8ee-935b58706557 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.096853 Apr 06 17:05:21.327473 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1614/3222] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:21 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:22.345504 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d60c0fd0-9b94-4f63-9c38-4354e7f52226 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:22.346111 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d60c0fd0-9b94-4f63-9c38-4354e7f52226 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:22.352929 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d60c0fd0-9b94-4f63-9c38-4354e7f52226 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:22.353378 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d60c0fd0-9b94-4f63-9c38-4354e7f52226 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:22.354133 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d60c0fd0-9b94-4f63-9c38-4354e7f52226 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:22.354560 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d60c0fd0-9b94-4f63-9c38-4354e7f52226 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:22.415375 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d60c0fd0-9b94-4f63-9c38-4354e7f52226 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:22.423397 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d60c0fd0-9b94-4f63-9c38-4354e7f52226 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.082748 Apr 06 17:05:22.423960 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1609/3223] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:22 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:23.445672 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-922ae8da-9788-4991-8ab4-0bf209ff2dd5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:23.446757 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-922ae8da-9788-4991-8ab4-0bf209ff2dd5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:23.455909 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-922ae8da-9788-4991-8ab4-0bf209ff2dd5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:23.456357 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-922ae8da-9788-4991-8ab4-0bf209ff2dd5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:23.457182 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-922ae8da-9788-4991-8ab4-0bf209ff2dd5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:23.457607 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-922ae8da-9788-4991-8ab4-0bf209ff2dd5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:23.527278 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-922ae8da-9788-4991-8ab4-0bf209ff2dd5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:23.535743 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-922ae8da-9788-4991-8ab4-0bf209ff2dd5 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.097845 Apr 06 17:05:23.536316 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1615/3224] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:23 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:24.556300 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-64ffdc5b-75e3-40bf-9b2a-585259fe4a6b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:24.557308 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-64ffdc5b-75e3-40bf-9b2a-585259fe4a6b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:24.566307 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64ffdc5b-75e3-40bf-9b2a-585259fe4a6b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:24.566753 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64ffdc5b-75e3-40bf-9b2a-585259fe4a6b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:24.567513 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64ffdc5b-75e3-40bf-9b2a-585259fe4a6b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:24.567948 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64ffdc5b-75e3-40bf-9b2a-585259fe4a6b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:24.638393 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-64ffdc5b-75e3-40bf-9b2a-585259fe4a6b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:24.648085 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-64ffdc5b-75e3-40bf-9b2a-585259fe4a6b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.098287 Apr 06 17:05:24.648643 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1610/3225] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:24 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:25.669815 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9345b283-babe-46cc-b262-3980594ca169 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:25.670877 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9345b283-babe-46cc-b262-3980594ca169 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:25.678425 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9345b283-babe-46cc-b262-3980594ca169 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:25.678883 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9345b283-babe-46cc-b262-3980594ca169 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:25.679644 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9345b283-babe-46cc-b262-3980594ca169 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:25.680078 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9345b283-babe-46cc-b262-3980594ca169 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:25.747151 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9345b283-babe-46cc-b262-3980594ca169 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:25.755529 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9345b283-babe-46cc-b262-3980594ca169 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.092266 Apr 06 17:05:25.756098 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1616/3226] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:25 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:26.776750 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bf15e753-3b49-4f18-9600-d345c77ef3ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:26.777728 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bf15e753-3b49-4f18-9600-d345c77ef3ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:26.786274 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf15e753-3b49-4f18-9600-d345c77ef3ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:26.786732 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf15e753-3b49-4f18-9600-d345c77ef3ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:26.787494 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf15e753-3b49-4f18-9600-d345c77ef3ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:26.787925 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf15e753-3b49-4f18-9600-d345c77ef3ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:26.848478 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-bf15e753-3b49-4f18-9600-d345c77ef3ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:26.857332 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bf15e753-3b49-4f18-9600-d345c77ef3ea tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.087168 Apr 06 17:05:26.857892 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1611/3227] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:26 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:27.883565 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7e1f6ec5-a2fd-426d-9869-c06d99dea3cf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:27.884615 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7e1f6ec5-a2fd-426d-9869-c06d99dea3cf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:27.893974 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e1f6ec5-a2fd-426d-9869-c06d99dea3cf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:27.894424 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e1f6ec5-a2fd-426d-9869-c06d99dea3cf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:27.895188 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e1f6ec5-a2fd-426d-9869-c06d99dea3cf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:27.895622 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7e1f6ec5-a2fd-426d-9869-c06d99dea3cf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:27.956281 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7e1f6ec5-a2fd-426d-9869-c06d99dea3cf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:27.964549 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7e1f6ec5-a2fd-426d-9869-c06d99dea3cf tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.087598 Apr 06 17:05:27.965137 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1617/3228] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:27 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:28.988418 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a0541822-8fa9-4fa6-a1ba-7b88f3b5c873 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:28.989089 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a0541822-8fa9-4fa6-a1ba-7b88f3b5c873 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:28.995454 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0541822-8fa9-4fa6-a1ba-7b88f3b5c873 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:28.995898 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0541822-8fa9-4fa6-a1ba-7b88f3b5c873 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:28.996650 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0541822-8fa9-4fa6-a1ba-7b88f3b5c873 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:28.997119 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0541822-8fa9-4fa6-a1ba-7b88f3b5c873 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:29.057350 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a0541822-8fa9-4fa6-a1ba-7b88f3b5c873 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:29.065544 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a0541822-8fa9-4fa6-a1ba-7b88f3b5c873 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.082103 Apr 06 17:05:29.066102 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1612/3229] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:28 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:30.084155 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-708dff5a-eda3-4e4d-b086-159de9a531ba tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:30.084865 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-708dff5a-eda3-4e4d-b086-159de9a531ba tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:30.091706 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-708dff5a-eda3-4e4d-b086-159de9a531ba tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:30.092182 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-708dff5a-eda3-4e4d-b086-159de9a531ba tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:30.092984 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-708dff5a-eda3-4e4d-b086-159de9a531ba tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:30.093410 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-708dff5a-eda3-4e4d-b086-159de9a531ba tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:30.165066 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-708dff5a-eda3-4e4d-b086-159de9a531ba tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:30.176674 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-708dff5a-eda3-4e4d-b086-159de9a531ba tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.096709 Apr 06 17:05:30.177289 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1618/3230] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:30 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:31.197334 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ee2a2654-f5b0-47ac-a552-741d18ff8388 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:31.198352 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ee2a2654-f5b0-47ac-a552-741d18ff8388 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:31.209408 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee2a2654-f5b0-47ac-a552-741d18ff8388 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:31.210167 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee2a2654-f5b0-47ac-a552-741d18ff8388 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:31.211431 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee2a2654-f5b0-47ac-a552-741d18ff8388 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:31.212152 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee2a2654-f5b0-47ac-a552-741d18ff8388 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:31.279812 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ee2a2654-f5b0-47ac-a552-741d18ff8388 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:31.289724 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ee2a2654-f5b0-47ac-a552-741d18ff8388 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.099160 Apr 06 17:05:31.290298 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1613/3231] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:31 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:32.307876 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-534a45c4-bf52-4957-b5c5-3f39319df074 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:32.308643 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-534a45c4-bf52-4957-b5c5-3f39319df074 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:32.316457 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-534a45c4-bf52-4957-b5c5-3f39319df074 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:32.316937 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-534a45c4-bf52-4957-b5c5-3f39319df074 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:32.317704 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-534a45c4-bf52-4957-b5c5-3f39319df074 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:32.318148 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-534a45c4-bf52-4957-b5c5-3f39319df074 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:32.385503 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-534a45c4-bf52-4957-b5c5-3f39319df074 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:32.393842 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-534a45c4-bf52-4957-b5c5-3f39319df074 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.091013 Apr 06 17:05:32.394405 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1619/3232] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:32 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:32.959934 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:05:32.960201 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 17:05:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:05:33.413357 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9a89f660-492b-4621-a64d-ba8180298047 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:33.414025 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9a89f660-492b-4621-a64d-ba8180298047 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:33.422521 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a89f660-492b-4621-a64d-ba8180298047 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:33.423173 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a89f660-492b-4621-a64d-ba8180298047 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:33.424506 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a89f660-492b-4621-a64d-ba8180298047 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:33.425637 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a89f660-492b-4621-a64d-ba8180298047 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:33.501110 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9a89f660-492b-4621-a64d-ba8180298047 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:33.509907 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9a89f660-492b-4621-a64d-ba8180298047 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.101994 Apr 06 17:05:33.510483 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1614/3233] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:33 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:34.531741 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ea7e8989-bb98-4292-8824-31f3ca397bd6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:34.532310 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ea7e8989-bb98-4292-8824-31f3ca397bd6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:34.539479 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea7e8989-bb98-4292-8824-31f3ca397bd6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:34.539933 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea7e8989-bb98-4292-8824-31f3ca397bd6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:34.540674 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea7e8989-bb98-4292-8824-31f3ca397bd6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:34.541149 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ea7e8989-bb98-4292-8824-31f3ca397bd6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:34.604346 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ea7e8989-bb98-4292-8824-31f3ca397bd6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:34.615276 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ea7e8989-bb98-4292-8824-31f3ca397bd6 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.087494 Apr 06 17:05:34.615888 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1620/3234] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:34 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:35.638591 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a6adead2-e4f6-48c9-99bc-e88c6b25129c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:35.639582 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a6adead2-e4f6-48c9-99bc-e88c6b25129c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:35.650690 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6adead2-e4f6-48c9-99bc-e88c6b25129c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:35.651469 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6adead2-e4f6-48c9-99bc-e88c6b25129c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:35.652754 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6adead2-e4f6-48c9-99bc-e88c6b25129c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:35.653519 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6adead2-e4f6-48c9-99bc-e88c6b25129c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:35.734626 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a6adead2-e4f6-48c9-99bc-e88c6b25129c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:35.743469 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a6adead2-e4f6-48c9-99bc-e88c6b25129c tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.111319 Apr 06 17:05:35.745758 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1615/3235] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:35 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:36.762677 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-81fd624f-6eaf-4351-9e06-6711a1bffc70 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:36.763360 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-81fd624f-6eaf-4351-9e06-6711a1bffc70 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:36.770485 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81fd624f-6eaf-4351-9e06-6711a1bffc70 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:36.770934 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81fd624f-6eaf-4351-9e06-6711a1bffc70 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:36.771694 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81fd624f-6eaf-4351-9e06-6711a1bffc70 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:36.772126 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81fd624f-6eaf-4351-9e06-6711a1bffc70 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:36.832723 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-81fd624f-6eaf-4351-9e06-6711a1bffc70 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:36.840704 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-81fd624f-6eaf-4351-9e06-6711a1bffc70 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.082029 Apr 06 17:05:36.841290 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1621/3236] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:36 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:37.862627 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4863fefa-857d-4401-a62f-912075cfd9f9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:37.863586 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4863fefa-857d-4401-a62f-912075cfd9f9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:37.874170 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4863fefa-857d-4401-a62f-912075cfd9f9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:37.874925 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4863fefa-857d-4401-a62f-912075cfd9f9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:37.876166 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4863fefa-857d-4401-a62f-912075cfd9f9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:37.877041 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4863fefa-857d-4401-a62f-912075cfd9f9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:37.936839 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4863fefa-857d-4401-a62f-912075cfd9f9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:37.945549 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4863fefa-857d-4401-a62f-912075cfd9f9 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.090307 Apr 06 17:05:37.946129 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1616/3237] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:37 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:38.968205 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9d2a3468-3de8-47db-a7e0-42007aa2e1e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:38.969072 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9d2a3468-3de8-47db-a7e0-42007aa2e1e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:38.980522 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d2a3468-3de8-47db-a7e0-42007aa2e1e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:38.981339 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d2a3468-3de8-47db-a7e0-42007aa2e1e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:38.982631 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d2a3468-3de8-47db-a7e0-42007aa2e1e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:38.983330 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9d2a3468-3de8-47db-a7e0-42007aa2e1e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:39.055628 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9d2a3468-3de8-47db-a7e0-42007aa2e1e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:39.067756 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9d2a3468-3de8-47db-a7e0-42007aa2e1e8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.106647 Apr 06 17:05:39.068605 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1622/3238] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:38 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:40.089628 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-37028df8-42fb-4cc3-9dad-9e556bdbbba0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:40.090188 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-37028df8-42fb-4cc3-9dad-9e556bdbbba0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:40.097165 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37028df8-42fb-4cc3-9dad-9e556bdbbba0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:40.097618 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37028df8-42fb-4cc3-9dad-9e556bdbbba0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:40.098401 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37028df8-42fb-4cc3-9dad-9e556bdbbba0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:40.098834 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37028df8-42fb-4cc3-9dad-9e556bdbbba0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:40.170992 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-37028df8-42fb-4cc3-9dad-9e556bdbbba0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:40.180659 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-37028df8-42fb-4cc3-9dad-9e556bdbbba0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.094709 Apr 06 17:05:40.181601 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1617/3239] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:40 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:41.201691 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fc79f7ff-e69a-42ea-857d-8947cb13bbf4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:41.202368 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fc79f7ff-e69a-42ea-857d-8947cb13bbf4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:41.210182 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc79f7ff-e69a-42ea-857d-8947cb13bbf4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:41.210636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc79f7ff-e69a-42ea-857d-8947cb13bbf4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:41.211405 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc79f7ff-e69a-42ea-857d-8947cb13bbf4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:41.211843 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fc79f7ff-e69a-42ea-857d-8947cb13bbf4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:41.274476 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fc79f7ff-e69a-42ea-857d-8947cb13bbf4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:41.282748 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fc79f7ff-e69a-42ea-857d-8947cb13bbf4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.087680 Apr 06 17:05:41.283325 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1623/3240] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:41 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:42.299733 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9cd06309-468e-4068-aa35-d8e6a55fb1e3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:42.300387 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9cd06309-468e-4068-aa35-d8e6a55fb1e3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:42.306898 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9cd06309-468e-4068-aa35-d8e6a55fb1e3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:42.307349 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9cd06309-468e-4068-aa35-d8e6a55fb1e3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:42.308142 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9cd06309-468e-4068-aa35-d8e6a55fb1e3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:42.308597 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9cd06309-468e-4068-aa35-d8e6a55fb1e3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:42.371468 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9cd06309-468e-4068-aa35-d8e6a55fb1e3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:42.380366 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9cd06309-468e-4068-aa35-d8e6a55fb1e3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.084573 Apr 06 17:05:42.380983 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1618/3241] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:42 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:43.401911 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d3d6d782-0bbe-401c-a14c-867f962b5e18 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:43.402721 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d3d6d782-0bbe-401c-a14c-867f962b5e18 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:43.413553 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3d6d782-0bbe-401c-a14c-867f962b5e18 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:43.414312 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3d6d782-0bbe-401c-a14c-867f962b5e18 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:43.415583 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3d6d782-0bbe-401c-a14c-867f962b5e18 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:43.416316 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3d6d782-0bbe-401c-a14c-867f962b5e18 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:43.480382 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d3d6d782-0bbe-401c-a14c-867f962b5e18 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:43.488518 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d3d6d782-0bbe-401c-a14c-867f962b5e18 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.093239 Apr 06 17:05:43.489118 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1624/3242] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:43 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:44.510280 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-32ae77bc-51b5-4dec-ab5e-8b692b637322 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:44.511274 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-32ae77bc-51b5-4dec-ab5e-8b692b637322 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:44.520895 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32ae77bc-51b5-4dec-ab5e-8b692b637322 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:44.521339 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32ae77bc-51b5-4dec-ab5e-8b692b637322 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:44.522109 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32ae77bc-51b5-4dec-ab5e-8b692b637322 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:44.522534 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32ae77bc-51b5-4dec-ab5e-8b692b637322 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:44.598013 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-32ae77bc-51b5-4dec-ab5e-8b692b637322 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:44.611293 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-32ae77bc-51b5-4dec-ab5e-8b692b637322 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.107512 Apr 06 17:05:44.612076 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1619/3243] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:44 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:45.636045 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-61b285a3-800a-44ed-b85d-01bf3d935c36 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:45.636839 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-61b285a3-800a-44ed-b85d-01bf3d935c36 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:45.645171 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61b285a3-800a-44ed-b85d-01bf3d935c36 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:45.645616 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61b285a3-800a-44ed-b85d-01bf3d935c36 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:45.646374 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61b285a3-800a-44ed-b85d-01bf3d935c36 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:45.646808 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-61b285a3-800a-44ed-b85d-01bf3d935c36 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:45.720112 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-61b285a3-800a-44ed-b85d-01bf3d935c36 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:45.728810 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-61b285a3-800a-44ed-b85d-01bf3d935c36 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.097670 Apr 06 17:05:45.729371 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1625/3244] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:45 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:46.750600 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cf683715-89bc-451f-8107-dc015f4175b3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:46.751566 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cf683715-89bc-451f-8107-dc015f4175b3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:46.762658 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf683715-89bc-451f-8107-dc015f4175b3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:46.763428 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf683715-89bc-451f-8107-dc015f4175b3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:46.764638 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf683715-89bc-451f-8107-dc015f4175b3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:46.765396 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf683715-89bc-451f-8107-dc015f4175b3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:46.833227 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-cf683715-89bc-451f-8107-dc015f4175b3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:46.841284 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cf683715-89bc-451f-8107-dc015f4175b3 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.097254 Apr 06 17:05:46.841842 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1620/3245] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:46 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:47.863604 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ce2fddf7-eee3-4dc4-92e8-0be0e237cfe2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:47.864609 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ce2fddf7-eee3-4dc4-92e8-0be0e237cfe2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:47.875469 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce2fddf7-eee3-4dc4-92e8-0be0e237cfe2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:47.876222 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce2fddf7-eee3-4dc4-92e8-0be0e237cfe2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:47.877683 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce2fddf7-eee3-4dc4-92e8-0be0e237cfe2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:47.878395 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ce2fddf7-eee3-4dc4-92e8-0be0e237cfe2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:47.945212 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ce2fddf7-eee3-4dc4-92e8-0be0e237cfe2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:47.953984 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ce2fddf7-eee3-4dc4-92e8-0be0e237cfe2 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.097474 Apr 06 17:05:47.954562 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1626/3246] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:47 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:48.974636 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b30820d7-6dc0-46bf-8f35-5089337ce168 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:48.975508 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b30820d7-6dc0-46bf-8f35-5089337ce168 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:48.986252 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b30820d7-6dc0-46bf-8f35-5089337ce168 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:48.987138 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b30820d7-6dc0-46bf-8f35-5089337ce168 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:48.988242 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b30820d7-6dc0-46bf-8f35-5089337ce168 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:48.988703 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b30820d7-6dc0-46bf-8f35-5089337ce168 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:49.063978 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b30820d7-6dc0-46bf-8f35-5089337ce168 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:49.074393 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b30820d7-6dc0-46bf-8f35-5089337ce168 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.106404 Apr 06 17:05:49.075155 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1621/3247] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:48 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:50.100421 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-732eaa6b-292e-4858-aa7d-2299fe5c8d94 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:50.101057 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-732eaa6b-292e-4858-aa7d-2299fe5c8d94 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:50.108155 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-732eaa6b-292e-4858-aa7d-2299fe5c8d94 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:50.108610 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-732eaa6b-292e-4858-aa7d-2299fe5c8d94 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:50.109409 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-732eaa6b-292e-4858-aa7d-2299fe5c8d94 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:50.109843 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-732eaa6b-292e-4858-aa7d-2299fe5c8d94 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:50.170042 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-732eaa6b-292e-4858-aa7d-2299fe5c8d94 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:50.178681 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-732eaa6b-292e-4858-aa7d-2299fe5c8d94 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.083606 Apr 06 17:05:50.179233 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1627/3248] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:50 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:51.195791 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f5623171-2747-41b1-8243-0e7e6a78676f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:51.196382 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f5623171-2747-41b1-8243-0e7e6a78676f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:51.203253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5623171-2747-41b1-8243-0e7e6a78676f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:51.203710 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5623171-2747-41b1-8243-0e7e6a78676f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:51.204483 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5623171-2747-41b1-8243-0e7e6a78676f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:51.204957 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5623171-2747-41b1-8243-0e7e6a78676f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:51.267567 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f5623171-2747-41b1-8243-0e7e6a78676f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:51.279418 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f5623171-2747-41b1-8243-0e7e6a78676f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.087280 Apr 06 17:05:51.280303 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1622/3249] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:51 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:52.298151 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c2d6b943-9aea-441a-82d5-3897713ba4b0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:52.298757 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c2d6b943-9aea-441a-82d5-3897713ba4b0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:52.305820 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2d6b943-9aea-441a-82d5-3897713ba4b0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:52.306271 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2d6b943-9aea-441a-82d5-3897713ba4b0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:52.307048 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2d6b943-9aea-441a-82d5-3897713ba4b0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:52.307479 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c2d6b943-9aea-441a-82d5-3897713ba4b0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:52.371826 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c2d6b943-9aea-441a-82d5-3897713ba4b0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:52.380467 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c2d6b943-9aea-441a-82d5-3897713ba4b0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.086266 Apr 06 17:05:52.381076 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1628/3250] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:52 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:53.400779 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4574a05f-ff62-451d-9af1-191e66126dec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:53.401563 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4574a05f-ff62-451d-9af1-191e66126dec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:53.411739 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4574a05f-ff62-451d-9af1-191e66126dec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:53.412418 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4574a05f-ff62-451d-9af1-191e66126dec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:53.413565 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4574a05f-ff62-451d-9af1-191e66126dec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:53.414175 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4574a05f-ff62-451d-9af1-191e66126dec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:53.484533 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4574a05f-ff62-451d-9af1-191e66126dec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:53.493423 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4574a05f-ff62-451d-9af1-191e66126dec tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.098238 Apr 06 17:05:53.494008 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1623/3251] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:53 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:54.518000 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c421e523-5577-4d58-acc0-d5b5a976f7d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:54.519112 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c421e523-5577-4d58-acc0-d5b5a976f7d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:54.529697 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c421e523-5577-4d58-acc0-d5b5a976f7d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:54.530441 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c421e523-5577-4d58-acc0-d5b5a976f7d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:54.531699 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c421e523-5577-4d58-acc0-d5b5a976f7d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:54.532431 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c421e523-5577-4d58-acc0-d5b5a976f7d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:54.594600 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c421e523-5577-4d58-acc0-d5b5a976f7d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:54.602850 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c421e523-5577-4d58-acc0-d5b5a976f7d0 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.091358 Apr 06 17:05:54.603416 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1629/3252] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:54 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:55.625127 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-45404caf-f1de-4a2e-bee7-d1355a4182c7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:55.626090 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-45404caf-f1de-4a2e-bee7-d1355a4182c7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:55.637092 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45404caf-f1de-4a2e-bee7-d1355a4182c7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:55.637823 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45404caf-f1de-4a2e-bee7-d1355a4182c7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:55.639066 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45404caf-f1de-4a2e-bee7-d1355a4182c7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:55.639734 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45404caf-f1de-4a2e-bee7-d1355a4182c7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:55.701693 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-45404caf-f1de-4a2e-bee7-d1355a4182c7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:55.709784 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-45404caf-f1de-4a2e-bee7-d1355a4182c7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.091274 Apr 06 17:05:55.710347 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1624/3253] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:55 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:56.731221 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e6c3f9ce-467c-45cb-b0df-d982f8fd8527 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:56.732214 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e6c3f9ce-467c-45cb-b0df-d982f8fd8527 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:56.743039 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6c3f9ce-467c-45cb-b0df-d982f8fd8527 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:56.743804 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6c3f9ce-467c-45cb-b0df-d982f8fd8527 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:56.745132 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6c3f9ce-467c-45cb-b0df-d982f8fd8527 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:56.745868 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e6c3f9ce-467c-45cb-b0df-d982f8fd8527 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:56.809765 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e6c3f9ce-467c-45cb-b0df-d982f8fd8527 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:56.818123 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e6c3f9ce-467c-45cb-b0df-d982f8fd8527 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.093733 Apr 06 17:05:56.818688 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1630/3254] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:56 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:57.839796 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9b5e63a0-9a87-4a32-a4de-7e2beb9559a1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:57.840883 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9b5e63a0-9a87-4a32-a4de-7e2beb9559a1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:57.851927 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b5e63a0-9a87-4a32-a4de-7e2beb9559a1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:57.852715 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b5e63a0-9a87-4a32-a4de-7e2beb9559a1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:57.854010 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b5e63a0-9a87-4a32-a4de-7e2beb9559a1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:57.854738 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b5e63a0-9a87-4a32-a4de-7e2beb9559a1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:57.924635 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9b5e63a0-9a87-4a32-a4de-7e2beb9559a1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:57.933566 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9b5e63a0-9a87-4a32-a4de-7e2beb9559a1 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.100397 Apr 06 17:05:57.934123 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1625/3255] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:57 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:05:58.953923 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b143ffd9-96f1-4500-8074-201caa053e07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:05:58.954651 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b143ffd9-96f1-4500-8074-201caa053e07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:05:58.963146 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b143ffd9-96f1-4500-8074-201caa053e07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:58.963709 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b143ffd9-96f1-4500-8074-201caa053e07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:58.964666 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b143ffd9-96f1-4500-8074-201caa053e07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:05:58.965254 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b143ffd9-96f1-4500-8074-201caa053e07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:05:59.028735 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b143ffd9-96f1-4500-8074-201caa053e07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:05:59.036864 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b143ffd9-96f1-4500-8074-201caa053e07 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.087876 Apr 06 17:05:59.037432 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1631/3256] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:05:58 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:06:00.054334 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0dd561aa-586c-4438-8f6f-5d9c417f4827 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:06:00.054975 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0dd561aa-586c-4438-8f6f-5d9c417f4827 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:06:00.061795 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dd561aa-586c-4438-8f6f-5d9c417f4827 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:00.062236 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dd561aa-586c-4438-8f6f-5d9c417f4827 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:00.063003 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dd561aa-586c-4438-8f6f-5d9c417f4827 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:00.063440 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dd561aa-586c-4438-8f6f-5d9c417f4827 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:00.131174 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0dd561aa-586c-4438-8f6f-5d9c417f4827 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:06:00.139252 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0dd561aa-586c-4438-8f6f-5d9c417f4827 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.089222 Apr 06 17:06:00.139817 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1626/3257] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:06:00 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:06:01.160448 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a2307a86-e13d-4055-b1d1-a84805506f50 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:06:01.161096 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a2307a86-e13d-4055-b1d1-a84805506f50 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:06:01.167885 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2307a86-e13d-4055-b1d1-a84805506f50 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:01.168339 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2307a86-e13d-4055-b1d1-a84805506f50 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:01.169147 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2307a86-e13d-4055-b1d1-a84805506f50 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:01.169590 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2307a86-e13d-4055-b1d1-a84805506f50 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:01.232331 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a2307a86-e13d-4055-b1d1-a84805506f50 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:06:01.240475 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a2307a86-e13d-4055-b1d1-a84805506f50 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.086581 Apr 06 17:06:01.241078 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1632/3258] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:06:01 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:06:02.266735 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-60ac95d4-664a-4390-b28e-5b3c0d80c93d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:06:02.267708 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-60ac95d4-664a-4390-b28e-5b3c0d80c93d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:06:02.275178 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60ac95d4-664a-4390-b28e-5b3c0d80c93d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:02.275635 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60ac95d4-664a-4390-b28e-5b3c0d80c93d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:02.276409 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60ac95d4-664a-4390-b28e-5b3c0d80c93d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:02.276886 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60ac95d4-664a-4390-b28e-5b3c0d80c93d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:02.340643 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-60ac95d4-664a-4390-b28e-5b3c0d80c93d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:06:02.353025 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-60ac95d4-664a-4390-b28e-5b3c0d80c93d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.092532 Apr 06 17:06:02.353844 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1627/3259] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:06:02 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:06:03.376601 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-dc3701ac-36c9-44fd-9f1d-29bb9cfe028e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:06:03.377193 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-dc3701ac-36c9-44fd-9f1d-29bb9cfe028e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:06:03.384526 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc3701ac-36c9-44fd-9f1d-29bb9cfe028e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:03.385027 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc3701ac-36c9-44fd-9f1d-29bb9cfe028e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:03.385779 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc3701ac-36c9-44fd-9f1d-29bb9cfe028e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:03.386204 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-dc3701ac-36c9-44fd-9f1d-29bb9cfe028e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:03.447420 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-dc3701ac-36c9-44fd-9f1d-29bb9cfe028e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:06:03.459853 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-dc3701ac-36c9-44fd-9f1d-29bb9cfe028e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.089249 Apr 06 17:06:03.460726 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1633/3260] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:06:03 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:06:04.482091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-07ea4a6b-8477-4f09-9bef-cd19bbd9b6bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:06:04.483058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-07ea4a6b-8477-4f09-9bef-cd19bbd9b6bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:06:04.492397 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07ea4a6b-8477-4f09-9bef-cd19bbd9b6bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:04.492889 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07ea4a6b-8477-4f09-9bef-cd19bbd9b6bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:04.493653 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07ea4a6b-8477-4f09-9bef-cd19bbd9b6bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:04.494091 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07ea4a6b-8477-4f09-9bef-cd19bbd9b6bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:04.563894 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-07ea4a6b-8477-4f09-9bef-cd19bbd9b6bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:06:04.572334 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-07ea4a6b-8477-4f09-9bef-cd19bbd9b6bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.097205 Apr 06 17:06:04.572940 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1628/3261] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:06:04 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:06:05.593817 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fbd0f136-55b9-4ca6-a2e7-51e9ac0eea32 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:06:05.594807 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fbd0f136-55b9-4ca6-a2e7-51e9ac0eea32 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:06:05.605837 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbd0f136-55b9-4ca6-a2e7-51e9ac0eea32 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:05.606591 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbd0f136-55b9-4ca6-a2e7-51e9ac0eea32 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:05.607862 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbd0f136-55b9-4ca6-a2e7-51e9ac0eea32 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:05.608586 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fbd0f136-55b9-4ca6-a2e7-51e9ac0eea32 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:05.675396 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fbd0f136-55b9-4ca6-a2e7-51e9ac0eea32 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:06:05.684468 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fbd0f136-55b9-4ca6-a2e7-51e9ac0eea32 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.097353 Apr 06 17:06:05.685085 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1634/3262] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:06:05 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:06:06.706847 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-73d2ef1f-d3ec-4a7d-b2ce-50248d3e011b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:06:06.708175 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-73d2ef1f-d3ec-4a7d-b2ce-50248d3e011b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:06:06.719593 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73d2ef1f-d3ec-4a7d-b2ce-50248d3e011b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:06.720340 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73d2ef1f-d3ec-4a7d-b2ce-50248d3e011b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:06.721652 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73d2ef1f-d3ec-4a7d-b2ce-50248d3e011b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:06.722376 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73d2ef1f-d3ec-4a7d-b2ce-50248d3e011b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:06.784834 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-73d2ef1f-d3ec-4a7d-b2ce-50248d3e011b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:06:06.793697 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-73d2ef1f-d3ec-4a7d-b2ce-50248d3e011b tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 200 len: 1368 microversion: 2.1 time: 0.093918 Apr 06 17:06:06.794238 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1629/3263] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:06:06 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:06:06.811084 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-83a453ca-5c87-49ac-bd98-c145cf115d4f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '.version_select at 0x7fa9cf1441f0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:06:06.843802 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-83a453ca-5c87-49ac-bd98-c145cf115d4f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1869411350" status: 202 len: 0 microversion: 2.1 time: 0.036319 Apr 06 17:06:06.844552 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1635/3264] 10.222.0.64 () {58 vars in 1220 bytes} [Wed Apr 6 17:06:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1869411350 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 06 17:06:07.717050 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-684c5ac9-01f2-4d83-ba28-69a6c6fd5d24 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Action: 'create', calling method: .version_select at 0x7fa9cac84dc0>, body: {"keypair": {"name": "tempest-keypair-1278443319"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:06:07.732367 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-684c5ac9-01f2-4d83-ba28-69a6c6fd5d24 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Getting quotas for project 025f673d99964de4820b8ba487f95cad. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 17:06:07.736535 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-684c5ac9-01f2-4d83-ba28-69a6c6fd5d24 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Getting quotas for user 20b497ce12aa400091fc7cbbc6a2d15b and project 025f673d99964de4820b8ba487f95cad. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 17:06:08.475717 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-684c5ac9-01f2-4d83-ba28-69a6c6fd5d24 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Getting quotas for project 025f673d99964de4820b8ba487f95cad. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 17:06:08.479403 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-684c5ac9-01f2-4d83-ba28-69a6c6fd5d24 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Getting quotas for user 20b497ce12aa400091fc7cbbc6a2d15b and project 025f673d99964de4820b8ba487f95cad. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 17:06:08.493402 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-684c5ac9-01f2-4d83-ba28-69a6c6fd5d24 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.780329 Apr 06 17:06:08.494008 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1630/3265] 10.222.0.64 () {60 vars in 1157 bytes} [Wed Apr 6 17:06:07 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:06:09.834790 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6b260e5e-3c1c-4617-93fa-0f38947b8099 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-970488290", "imageRef": "c217dd2b-7679-4860-b2e6-01a967f654df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58c32a0b-0da9-4f8e-b8ec-c234aabcb43d"}], "security_groups": [{"name": "tempest-securitygroup--1589540979"}], "key_name": "tempest-keypair-1278443319", "user_data": "}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:06:09.936751 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-6b260e5e-3c1c-4617-93fa-0f38947b8099 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] validate_networks() for [('58c32a0b-0da9-4f8e-b8ec-c234aabcb43d', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 06 17:06:10.362731 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-6b260e5e-3c1c-4617-93fa-0f38947b8099 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 06 17:06:10.364232 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-6b260e5e-3c1c-4617-93fa-0f38947b8099 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 06 17:06:10.364797 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-6b260e5e-3c1c-4617-93fa-0f38947b8099 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 06 17:06:10.365261 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-6b260e5e-3c1c-4617-93fa-0f38947b8099 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 06 17:06:10.365676 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-6b260e5e-3c1c-4617-93fa-0f38947b8099 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 06 17:06:10.375671 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b260e5e-3c1c-4617-93fa-0f38947b8099 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:10.376115 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b260e5e-3c1c-4617-93fa-0f38947b8099 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:10.376952 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b260e5e-3c1c-4617-93fa-0f38947b8099 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:10.377385 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6b260e5e-3c1c-4617-93fa-0f38947b8099 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:10.394457 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-6b260e5e-3c1c-4617-93fa-0f38947b8099 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Getting quotas for project 025f673d99964de4820b8ba487f95cad. Resources: {'instances', 'cores', 'ram'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 17:06:10.398849 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-6b260e5e-3c1c-4617-93fa-0f38947b8099 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Getting quotas for user 20b497ce12aa400091fc7cbbc6a2d15b and project 025f673d99964de4820b8ba487f95cad. Resources: {'instances', 'cores', 'ram'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 17:06:10.410092 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6b260e5e-3c1c-4617-93fa-0f38947b8099 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 06 17:06:10.412668 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6b260e5e-3c1c-4617-93fa-0f38947b8099 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c217dd2b-7679-4860-b2e6-01a967f654df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 06 17:06:10.463605 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6b260e5e-3c1c-4617-93fa-0f38947b8099 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.633490 Apr 06 17:06:10.464448 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1636/3266] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Apr 6 17:06:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 06 17:06:10.475291 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fd7595d3-f5db-45fd-85de-5cace6a923ed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:06:10.475878 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fd7595d3-f5db-45fd-85de-5cace6a923ed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:06:10.529706 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fd7595d3-f5db-45fd-85de-5cace6a923ed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:06:10.536235 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fd7595d3-f5db-45fd-85de-5cace6a923ed tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32" status: 200 len: 1237 microversion: 2.1 time: 0.065860 Apr 06 17:06:10.544750 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1631/3267] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:06:10 2022] GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:06:11.555259 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-984f1dbf-8385-4d99-b1a4-c78875d1e49d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:06:11.556232 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-984f1dbf-8385-4d99-b1a4-c78875d1e49d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:06:11.564255 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-984f1dbf-8385-4d99-b1a4-c78875d1e49d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:11.564899 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-984f1dbf-8385-4d99-b1a4-c78875d1e49d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:11.565952 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-984f1dbf-8385-4d99-b1a4-c78875d1e49d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:11.566770 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-984f1dbf-8385-4d99-b1a4-c78875d1e49d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:11.630392 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-984f1dbf-8385-4d99-b1a4-c78875d1e49d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:06:11.638589 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-984f1dbf-8385-4d99-b1a4-c78875d1e49d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32" status: 200 len: 1297 microversion: 2.1 time: 0.088929 Apr 06 17:06:11.639153 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1637/3268] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:06:11 2022] GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32 => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:06:12.655829 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7352c902-fe01-46f2-856d-a3949f63fb35 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:06:12.656444 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7352c902-fe01-46f2-856d-a3949f63fb35 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:06:12.662396 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7352c902-fe01-46f2-856d-a3949f63fb35 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:12.662849 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7352c902-fe01-46f2-856d-a3949f63fb35 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:12.664049 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7352c902-fe01-46f2-856d-a3949f63fb35 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:12.664492 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7352c902-fe01-46f2-856d-a3949f63fb35 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:12.878613 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-7352c902-fe01-46f2-856d-a3949f63fb35 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:06:12.887089 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7352c902-fe01-46f2-856d-a3949f63fb35 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32" status: 200 len: 1363 microversion: 2.1 time: 0.235232 Apr 06 17:06:12.887786 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1632/3269] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:06:12 2022] GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:06:13.243370 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-cee6c328-4702-4797-a8ce-81495528d295 req-d6e3f0ea-d049-4eb0-bbfd-aee17189593f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f22100d-961b-4402-83d5-a18988d88c32", "tag": "2a9f60f2-6640-4b8f-bab1-379a2e3d163a"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:06:13.251639 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cee6c328-4702-4797-a8ce-81495528d295 req-d6e3f0ea-d049-4eb0-bbfd-aee17189593f service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:13.252082 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-cee6c328-4702-4797-a8ce-81495528d295 req-d6e3f0ea-d049-4eb0-bbfd-aee17189593f service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:13.263833 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-cee6c328-4702-4797-a8ce-81495528d295 req-d6e3f0ea-d049-4eb0-bbfd-aee17189593f service nova] Creating event network-changed:2a9f60f2-6640-4b8f-bab1-379a2e3d163a for instance 6f22100d-961b-4402-83d5-a18988d88c32 on hv-cinder-83684 Apr 06 17:06:13.269147 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-cee6c328-4702-4797-a8ce-81495528d295 req-d6e3f0ea-d049-4eb0-bbfd-aee17189593f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113565 Apr 06 17:06:13.269767 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1638/3270] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:06:13.907052 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8a026721-7a10-4a5a-b72b-e2371fef42b8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:06:13.907659 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8a026721-7a10-4a5a-b72b-e2371fef42b8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:06:13.916743 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a026721-7a10-4a5a-b72b-e2371fef42b8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:13.917501 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a026721-7a10-4a5a-b72b-e2371fef42b8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:13.918771 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a026721-7a10-4a5a-b72b-e2371fef42b8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:13.919482 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a026721-7a10-4a5a-b72b-e2371fef42b8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:14.079660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8a026721-7a10-4a5a-b72b-e2371fef42b8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:06:14.088962 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8a026721-7a10-4a5a-b72b-e2371fef42b8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32" status: 200 len: 1363 microversion: 2.1 time: 0.187764 Apr 06 17:06:14.089605 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1633/3271] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:06:13 2022] GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:06:15.108016 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fdb47c2f-bb01-4546-92a3-07061c1185fb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:06:15.108736 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fdb47c2f-bb01-4546-92a3-07061c1185fb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:06:15.115275 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdb47c2f-bb01-4546-92a3-07061c1185fb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:15.115780 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdb47c2f-bb01-4546-92a3-07061c1185fb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:15.116552 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdb47c2f-bb01-4546-92a3-07061c1185fb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:15.116999 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fdb47c2f-bb01-4546-92a3-07061c1185fb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:15.255356 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fdb47c2f-bb01-4546-92a3-07061c1185fb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:06:15.263067 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fdb47c2f-bb01-4546-92a3-07061c1185fb tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32" status: 200 len: 1363 microversion: 2.1 time: 0.160183 Apr 06 17:06:15.263695 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1639/3272] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:06:15 2022] GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:06:16.285005 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-26f5d0b8-8e9a-4ef1-acd0-8d2238ff9d13 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:06:16.285997 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-26f5d0b8-8e9a-4ef1-acd0-8d2238ff9d13 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:06:16.294187 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26f5d0b8-8e9a-4ef1-acd0-8d2238ff9d13 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:16.294643 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26f5d0b8-8e9a-4ef1-acd0-8d2238ff9d13 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:16.295413 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26f5d0b8-8e9a-4ef1-acd0-8d2238ff9d13 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:16.295849 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26f5d0b8-8e9a-4ef1-acd0-8d2238ff9d13 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:16.450262 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-26f5d0b8-8e9a-4ef1-acd0-8d2238ff9d13 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:06:16.457839 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-26f5d0b8-8e9a-4ef1-acd0-8d2238ff9d13 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32" status: 200 len: 1363 microversion: 2.1 time: 0.179451 Apr 06 17:06:16.458398 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1634/3273] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:06:16 2022] GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:06:17.480362 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f96f9a70-d478-4a7d-b724-9439e1198526 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:06:17.481552 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f96f9a70-d478-4a7d-b724-9439e1198526 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:06:17.492580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f96f9a70-d478-4a7d-b724-9439e1198526 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:17.493198 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f96f9a70-d478-4a7d-b724-9439e1198526 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:17.494013 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f96f9a70-d478-4a7d-b724-9439e1198526 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:17.494476 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f96f9a70-d478-4a7d-b724-9439e1198526 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:17.631799 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f96f9a70-d478-4a7d-b724-9439e1198526 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:06:17.640138 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f96f9a70-d478-4a7d-b724-9439e1198526 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32" status: 200 len: 1363 microversion: 2.1 time: 0.168126 Apr 06 17:06:17.640737 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1640/3274] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:06:17 2022] GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:06:17.723307 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-62fcdb98-ee9c-4cf7-a5d9-c3fb883bf4d9 req-69963510-8927-469e-8cf6-ba68d9e56e48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f22100d-961b-4402-83d5-a18988d88c32", "name": "network-vif-plugged", "status": "completed", "tag": "2a9f60f2-6640-4b8f-bab1-379a2e3d163a"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:06:17.732272 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-62fcdb98-ee9c-4cf7-a5d9-c3fb883bf4d9 req-69963510-8927-469e-8cf6-ba68d9e56e48 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:17.732657 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-62fcdb98-ee9c-4cf7-a5d9-c3fb883bf4d9 req-69963510-8927-469e-8cf6-ba68d9e56e48 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:17.743580 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-62fcdb98-ee9c-4cf7-a5d9-c3fb883bf4d9 req-69963510-8927-469e-8cf6-ba68d9e56e48 service nova] Creating event network-vif-plugged:2a9f60f2-6640-4b8f-bab1-379a2e3d163a for instance 6f22100d-961b-4402-83d5-a18988d88c32 on hv-cinder-83684 Apr 06 17:06:17.747182 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: ERROR oslo.messaging._drivers.impl_rabbit [req-62fcdb98-ee9c-4cf7-a5d9-c3fb883bf4d9 req-69963510-8927-469e-8cf6-ba68d9e56e48 service nova] [6c744826-37ea-4b6c-ab68-302880531280] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 06 17:06:18.661279 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-abff8ae1-7d25-4c7e-bc4f-cf30587a0668 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:06:18.662211 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-abff8ae1-7d25-4c7e-bc4f-cf30587a0668 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:06:18.669676 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abff8ae1-7d25-4c7e-bc4f-cf30587a0668 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:18.670128 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abff8ae1-7d25-4c7e-bc4f-cf30587a0668 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:18.671066 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abff8ae1-7d25-4c7e-bc4f-cf30587a0668 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:18.671514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-abff8ae1-7d25-4c7e-bc4f-cf30587a0668 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:18.755305 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [req-62fcdb98-ee9c-4cf7-a5d9-c3fb883bf4d9 req-69963510-8927-469e-8cf6-ba68d9e56e48 service nova] [6c744826-37ea-4b6c-ab68-302880531280] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 39438. Apr 06 17:06:18.759618 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-62fcdb98-ee9c-4cf7-a5d9-c3fb883bf4d9 req-69963510-8927-469e-8cf6-ba68d9e56e48 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.092813 Apr 06 17:06:18.760236 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1635/3275] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:06:18.809403 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-abff8ae1-7d25-4c7e-bc4f-cf30587a0668 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:06:18.817155 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-abff8ae1-7d25-4c7e-bc4f-cf30587a0668 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32" status: 200 len: 1363 microversion: 2.1 time: 0.161952 Apr 06 17:06:18.817746 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1641/3276] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:06:18 2022] GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:06:19.836050 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6b1543eb-bada-4b54-9c27-5ee280ed0723 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:06:19.836891 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6b1543eb-bada-4b54-9c27-5ee280ed0723 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:06:19.843693 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b1543eb-bada-4b54-9c27-5ee280ed0723 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:19.844144 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b1543eb-bada-4b54-9c27-5ee280ed0723 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:19.844976 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b1543eb-bada-4b54-9c27-5ee280ed0723 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:19.845402 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b1543eb-bada-4b54-9c27-5ee280ed0723 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:19.992749 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6b1543eb-bada-4b54-9c27-5ee280ed0723 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:06:20.002795 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6b1543eb-bada-4b54-9c27-5ee280ed0723 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32" status: 200 len: 1363 microversion: 2.1 time: 0.171472 Apr 06 17:06:20.003442 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1636/3277] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:06:19 2022] GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:06:21.026660 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6bbfb88b-044c-4d5f-9816-963ad9ef5a4a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:06:21.028067 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6bbfb88b-044c-4d5f-9816-963ad9ef5a4a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:06:21.038798 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bbfb88b-044c-4d5f-9816-963ad9ef5a4a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:21.039474 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bbfb88b-044c-4d5f-9816-963ad9ef5a4a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:21.040772 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bbfb88b-044c-4d5f-9816-963ad9ef5a4a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:21.041564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6bbfb88b-044c-4d5f-9816-963ad9ef5a4a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:21.183718 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6bbfb88b-044c-4d5f-9816-963ad9ef5a4a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:06:21.191165 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6bbfb88b-044c-4d5f-9816-963ad9ef5a4a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32" status: 200 len: 1549 microversion: 2.1 time: 0.171317 Apr 06 17:06:21.191739 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1642/3278] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:06:21 2022] GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32 => generated 1549 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:06:21.210385 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-76fcb914-a7c2-4a6e-a0d8-7e915d488698 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:06:21.211145 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-76fcb914-a7c2-4a6e-a0d8-7e915d488698 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:06:21.219009 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76fcb914-a7c2-4a6e-a0d8-7e915d488698 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:21.219466 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76fcb914-a7c2-4a6e-a0d8-7e915d488698 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:21.220228 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76fcb914-a7c2-4a6e-a0d8-7e915d488698 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:21.220660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76fcb914-a7c2-4a6e-a0d8-7e915d488698 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:21.316455 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-76fcb914-a7c2-4a6e-a0d8-7e915d488698 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112173 Apr 06 17:06:21.317285 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1637/3279] 10.222.0.64 () {58 vars in 1274 bytes} [Wed Apr 6 17:06:21 2022] GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:06:22.597383 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-8f289344-3aab-48e1-b01f-91ab72a98e3e req-2876a361-d33d-4a94-8f52-de9d1c681717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f22100d-961b-4402-83d5-a18988d88c32", "tag": "2a9f60f2-6640-4b8f-bab1-379a2e3d163a"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:06:22.607079 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8f289344-3aab-48e1-b01f-91ab72a98e3e req-2876a361-d33d-4a94-8f52-de9d1c681717 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:22.607791 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-8f289344-3aab-48e1-b01f-91ab72a98e3e req-2876a361-d33d-4a94-8f52-de9d1c681717 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:22.619381 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-8f289344-3aab-48e1-b01f-91ab72a98e3e req-2876a361-d33d-4a94-8f52-de9d1c681717 service nova] Creating event network-changed:2a9f60f2-6640-4b8f-bab1-379a2e3d163a for instance 6f22100d-961b-4402-83d5-a18988d88c32 on hv-cinder-83684 Apr 06 17:06:22.624598 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-8f289344-3aab-48e1-b01f-91ab72a98e3e req-2876a361-d33d-4a94-8f52-de9d1c681717 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030852 Apr 06 17:06:22.625189 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1643/3280] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:06:45.921764 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:06:45.922443 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 17:06:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:06:56.473878 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-534f0b77-ae1e-4d1d-bfdd-b09172d45c8d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:06:56.474751 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-534f0b77-ae1e-4d1d-bfdd-b09172d45c8d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:06:56.485355 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-534f0b77-ae1e-4d1d-bfdd-b09172d45c8d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:56.485938 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-534f0b77-ae1e-4d1d-bfdd-b09172d45c8d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:56.486915 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-534f0b77-ae1e-4d1d-bfdd-b09172d45c8d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:06:56.487478 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-534f0b77-ae1e-4d1d-bfdd-b09172d45c8d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:06:56.511330 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-534f0b77-ae1e-4d1d-bfdd-b09172d45c8d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32/ips" status: 200 len: 146 microversion: 2.1 time: 0.043424 Apr 06 17:06:56.511925 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1638/3281] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Apr 6 17:06:56 2022] GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:08:07.858194 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-412e9fe5-acbb-42b6-9fb3-1aee7f004d1e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:08:07.858775 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-412e9fe5-acbb-42b6-9fb3-1aee7f004d1e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 4be6d0c6-2b22-40ab-b5b9-0f738db81efe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:08:07.865737 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-412e9fe5-acbb-42b6-9fb3-1aee7f004d1e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:07.866025 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-412e9fe5-acbb-42b6-9fb3-1aee7f004d1e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:07.866797 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-412e9fe5-acbb-42b6-9fb3-1aee7f004d1e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:07.867227 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-412e9fe5-acbb-42b6-9fb3-1aee7f004d1e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:07.898639 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-412e9fe5-acbb-42b6-9fb3-1aee7f004d1e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 4be6d0c6-2b22-40ab-b5b9-0f738db81efe] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 06 17:08:07.980697 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-412e9fe5-acbb-42b6-9fb3-1aee7f004d1e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe" status: 204 len: 0 microversion: 2.1 time: 0.130100 Apr 06 17:08:07.981631 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1644/3282] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 17:08:07 2022] DELETE /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 06 17:08:07.990906 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-373977e0-6419-4257-8b25-78ab22597fa6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:08:07.991673 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-373977e0-6419-4257-8b25-78ab22597fa6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 4be6d0c6-2b22-40ab-b5b9-0f738db81efe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:08:07.997630 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-373977e0-6419-4257-8b25-78ab22597fa6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:07.998072 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-373977e0-6419-4257-8b25-78ab22597fa6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:07.998827 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-373977e0-6419-4257-8b25-78ab22597fa6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:07.999255 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-373977e0-6419-4257-8b25-78ab22597fa6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:08.329268 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-373977e0-6419-4257-8b25-78ab22597fa6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:08:08.338163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-373977e0-6419-4257-8b25-78ab22597fa6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe" status: 200 len: 1681 microversion: 2.1 time: 0.352185 Apr 06 17:08:08.338786 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1639/3283] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:08:07 2022] GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe => generated 1681 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:08:09.357852 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3fc92863-0dce-44ce-aa44-5d2db5a48ad0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:08:09.358563 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3fc92863-0dce-44ce-aa44-5d2db5a48ad0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 4be6d0c6-2b22-40ab-b5b9-0f738db81efe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:08:09.365568 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fc92863-0dce-44ce-aa44-5d2db5a48ad0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:09.366011 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fc92863-0dce-44ce-aa44-5d2db5a48ad0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:09.366795 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fc92863-0dce-44ce-aa44-5d2db5a48ad0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:09.367219 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3fc92863-0dce-44ce-aa44-5d2db5a48ad0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:09.433351 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3fc92863-0dce-44ce-aa44-5d2db5a48ad0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:08:09.440904 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3fc92863-0dce-44ce-aa44-5d2db5a48ad0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe" status: 200 len: 1613 microversion: 2.1 time: 0.087581 Apr 06 17:08:09.442367 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1645/3284] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:08:09 2022] GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe => generated 1613 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:08:09.497461 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-230cf242-4f8a-4931-9dcf-88561fb7971c req-6ed6b8a0-a730-47e8-a557-18e4dd7a0224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be6d0c6-2b22-40ab-b5b9-0f738db81efe", "name": "network-vif-deleted", "tag": "55e9d3e8-a34b-4403-8517-a838470f757e"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:08:09.505796 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-230cf242-4f8a-4931-9dcf-88561fb7971c req-6ed6b8a0-a730-47e8-a557-18e4dd7a0224 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:09.506241 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-230cf242-4f8a-4931-9dcf-88561fb7971c req-6ed6b8a0-a730-47e8-a557-18e4dd7a0224 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:09.517565 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-230cf242-4f8a-4931-9dcf-88561fb7971c req-6ed6b8a0-a730-47e8-a557-18e4dd7a0224 service nova] Creating event network-vif-deleted:55e9d3e8-a34b-4403-8517-a838470f757e for instance 4be6d0c6-2b22-40ab-b5b9-0f738db81efe on hv-cinder-83684 Apr 06 17:08:09.522837 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-230cf242-4f8a-4931-9dcf-88561fb7971c req-6ed6b8a0-a730-47e8-a557-18e4dd7a0224 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029058 Apr 06 17:08:09.523749 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1640/3285] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:08:10.460469 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-620ee8c8-99fa-4463-b2e6-4a2df8fcfeef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:08:10.461103 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-620ee8c8-99fa-4463-b2e6-4a2df8fcfeef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 4be6d0c6-2b22-40ab-b5b9-0f738db81efe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:08:10.469246 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-620ee8c8-99fa-4463-b2e6-4a2df8fcfeef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:10.469755 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-620ee8c8-99fa-4463-b2e6-4a2df8fcfeef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:10.470901 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-620ee8c8-99fa-4463-b2e6-4a2df8fcfeef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:10.471508 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-620ee8c8-99fa-4463-b2e6-4a2df8fcfeef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:10.488660 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-620ee8c8-99fa-4463-b2e6-4a2df8fcfeef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] HTTP exception thrown: Instance 4be6d0c6-2b22-40ab-b5b9-0f738db81efe could not be found. Apr 06 17:08:10.489362 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-620ee8c8-99fa-4463-b2e6-4a2df8fcfeef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Returning 404 to user: Instance 4be6d0c6-2b22-40ab-b5b9-0f738db81efe could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:08:10.490248 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-620ee8c8-99fa-4463-b2e6-4a2df8fcfeef tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe" status: 404 len: 111 microversion: 2.1 time: 0.035648 Apr 06 17:08:10.491036 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1646/3286] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:08:10 2022] GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:08:10.500141 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0f022768-89db-45a2-bb6c-70b479f2f924 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '.version_select at 0x7fa9ca1f3160>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:08:10.523420 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0f022768-89db-45a2-bb6c-70b479f2f924 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-337634090" status: 202 len: 0 microversion: 2.1 time: 0.027511 Apr 06 17:08:10.523982 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1641/3287] 10.222.0.64 () {58 vars in 1217 bytes} [Wed Apr 6 17:08:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-337634090 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 06 17:08:11.188174 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b8de1b07-034d-4b0c-93ab-b0c53367855d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Action: 'create', calling method: .version_select at 0x7fa9c9f48550>, body: {"keypair": {"name": "tempest-keypair-2068531710"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:08:11.204038 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-b8de1b07-034d-4b0c-93ab-b0c53367855d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Getting quotas for project a7b211944dc94094801aa5dd3d20a401. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 17:08:11.208787 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-b8de1b07-034d-4b0c-93ab-b0c53367855d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Getting quotas for user 22d0f09ff8c240a485a775d3c95d626b and project a7b211944dc94094801aa5dd3d20a401. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 17:08:11.634192 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-b8de1b07-034d-4b0c-93ab-b0c53367855d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Getting quotas for project a7b211944dc94094801aa5dd3d20a401. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 17:08:11.637859 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-b8de1b07-034d-4b0c-93ab-b0c53367855d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Getting quotas for user 22d0f09ff8c240a485a775d3c95d626b and project a7b211944dc94094801aa5dd3d20a401. Resources: {'key_pairs'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 17:08:11.650688 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b8de1b07-034d-4b0c-93ab-b0c53367855d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.466648 Apr 06 17:08:11.651273 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1647/3288] 10.222.0.64 () {60 vars in 1157 bytes} [Wed Apr 6 17:08:11 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:08:12.976658 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-45b2d5f1-9747-4186-a8b2-2c9ad08e4ff0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1606368985", "imageRef": "c217dd2b-7679-4860-b2e6-01a967f654df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "161b97e6-a667-4e80-ab79-6d47a727bfd9"}], "security_groups": [{"name": "tempest-securitygroup--145282064"}], "key_name": "tempest-keypair-2068531710", "user_data": "}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:08:13.081411 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-45b2d5f1-9747-4186-a8b2-2c9ad08e4ff0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] validate_networks() for [('161b97e6-a667-4e80-ab79-6d47a727bfd9', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 06 17:08:13.509899 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-45b2d5f1-9747-4186-a8b2-2c9ad08e4ff0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 06 17:08:13.510326 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-45b2d5f1-9747-4186-a8b2-2c9ad08e4ff0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 06 17:08:13.510800 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-45b2d5f1-9747-4186-a8b2-2c9ad08e4ff0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 06 17:08:13.511210 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-45b2d5f1-9747-4186-a8b2-2c9ad08e4ff0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 06 17:08:13.511620 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-45b2d5f1-9747-4186-a8b2-2c9ad08e4ff0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 06 17:08:13.521285 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45b2d5f1-9747-4186-a8b2-2c9ad08e4ff0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:13.521732 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45b2d5f1-9747-4186-a8b2-2c9ad08e4ff0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:13.522534 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45b2d5f1-9747-4186-a8b2-2c9ad08e4ff0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:13.523000 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45b2d5f1-9747-4186-a8b2-2c9ad08e4ff0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:13.539180 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-45b2d5f1-9747-4186-a8b2-2c9ad08e4ff0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Getting quotas for project a7b211944dc94094801aa5dd3d20a401. Resources: {'instances', 'cores', 'ram'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 17:08:13.543157 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-45b2d5f1-9747-4186-a8b2-2c9ad08e4ff0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Getting quotas for user 22d0f09ff8c240a485a775d3c95d626b and project a7b211944dc94094801aa5dd3d20a401. Resources: {'instances', 'cores', 'ram'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 17:08:13.554481 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-45b2d5f1-9747-4186-a8b2-2c9ad08e4ff0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 06 17:08:13.556883 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-45b2d5f1-9747-4186-a8b2-2c9ad08e4ff0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c217dd2b-7679-4860-b2e6-01a967f654df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 06 17:08:13.609677 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-45b2d5f1-9747-4186-a8b2-2c9ad08e4ff0 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.637067 Apr 06 17:08:13.611300 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1642/3289] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Apr 6 17:08:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 06 17:08:13.622032 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-47f91ab8-54aa-498d-9c3e-ca20648f2d25 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:08:13.622637 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-47f91ab8-54aa-498d-9c3e-ca20648f2d25 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:08:13.685091 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-47f91ab8-54aa-498d-9c3e-ca20648f2d25 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:08:13.692162 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-47f91ab8-54aa-498d-9c3e-ca20648f2d25 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8" status: 200 len: 1242 microversion: 2.1 time: 0.074526 Apr 06 17:08:13.692862 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1648/3290] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:08:13 2022] GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8 => generated 1242 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:08:14.709947 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-21ca7512-aeb9-4b2e-9026-9e4dd084c9bc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:08:14.711372 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-21ca7512-aeb9-4b2e-9026-9e4dd084c9bc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:08:14.719127 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21ca7512-aeb9-4b2e-9026-9e4dd084c9bc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:14.719665 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21ca7512-aeb9-4b2e-9026-9e4dd084c9bc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:14.720709 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21ca7512-aeb9-4b2e-9026-9e4dd084c9bc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:14.721371 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21ca7512-aeb9-4b2e-9026-9e4dd084c9bc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:14.802158 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-21ca7512-aeb9-4b2e-9026-9e4dd084c9bc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:08:14.810202 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-21ca7512-aeb9-4b2e-9026-9e4dd084c9bc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8" status: 200 len: 1302 microversion: 2.1 time: 0.104440 Apr 06 17:08:14.811555 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1643/3291] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:08:14 2022] GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8 => generated 1302 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:08:15.827786 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c606a84d-71d1-41d2-b2d6-31d5c4ef806d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:08:15.828385 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c606a84d-71d1-41d2-b2d6-31d5c4ef806d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:08:15.835297 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c606a84d-71d1-41d2-b2d6-31d5c4ef806d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:15.835752 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c606a84d-71d1-41d2-b2d6-31d5c4ef806d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:15.836530 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c606a84d-71d1-41d2-b2d6-31d5c4ef806d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:15.836972 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c606a84d-71d1-41d2-b2d6-31d5c4ef806d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:15.981774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c606a84d-71d1-41d2-b2d6-31d5c4ef806d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:08:15.991724 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c606a84d-71d1-41d2-b2d6-31d5c4ef806d tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8" status: 200 len: 1367 microversion: 2.1 time: 0.167820 Apr 06 17:08:15.992613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1649/3292] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:08:15 2022] GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:08:16.198649 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-76937f16-aca6-46b8-9b2d-2ed2188c0b14 req-0e8e4226-4384-4527-bd6b-7e82caf12226 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e13a396-e857-43f3-8d75-410c8b1324e8", "tag": "1c2f84ef-5460-42db-82bc-1d89c3d65604"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:08:16.211900 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-76937f16-aca6-46b8-9b2d-2ed2188c0b14 req-0e8e4226-4384-4527-bd6b-7e82caf12226 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:16.212720 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-76937f16-aca6-46b8-9b2d-2ed2188c0b14 req-0e8e4226-4384-4527-bd6b-7e82caf12226 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:16.225913 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-76937f16-aca6-46b8-9b2d-2ed2188c0b14 req-0e8e4226-4384-4527-bd6b-7e82caf12226 service nova] Creating event network-changed:1c2f84ef-5460-42db-82bc-1d89c3d65604 for instance 9e13a396-e857-43f3-8d75-410c8b1324e8 on hv-cinder-83684 Apr 06 17:08:16.232016 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-76937f16-aca6-46b8-9b2d-2ed2188c0b14 req-0e8e4226-4384-4527-bd6b-7e82caf12226 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036890 Apr 06 17:08:16.232895 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1644/3293] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:08:17.013875 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e4b766e6-d027-45a0-b5f6-5a5b1deda63b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:08:17.014847 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e4b766e6-d027-45a0-b5f6-5a5b1deda63b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:08:17.023491 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4b766e6-d027-45a0-b5f6-5a5b1deda63b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:17.023937 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4b766e6-d027-45a0-b5f6-5a5b1deda63b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:17.024723 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4b766e6-d027-45a0-b5f6-5a5b1deda63b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:17.025147 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e4b766e6-d027-45a0-b5f6-5a5b1deda63b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:17.173886 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e4b766e6-d027-45a0-b5f6-5a5b1deda63b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:08:17.182140 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e4b766e6-d027-45a0-b5f6-5a5b1deda63b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8" status: 200 len: 1367 microversion: 2.1 time: 0.174777 Apr 06 17:08:17.182703 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1650/3294] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:08:17 2022] GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:08:18.200451 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b31b7c6d-c4c3-41ce-b104-4986362188c8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:08:18.201415 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b31b7c6d-c4c3-41ce-b104-4986362188c8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:08:18.208496 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b31b7c6d-c4c3-41ce-b104-4986362188c8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:18.209100 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b31b7c6d-c4c3-41ce-b104-4986362188c8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:18.209900 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b31b7c6d-c4c3-41ce-b104-4986362188c8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:18.210361 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b31b7c6d-c4c3-41ce-b104-4986362188c8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:18.460577 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b31b7c6d-c4c3-41ce-b104-4986362188c8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:08:18.471965 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b31b7c6d-c4c3-41ce-b104-4986362188c8 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8" status: 200 len: 1367 microversion: 2.1 time: 0.276145 Apr 06 17:08:18.472530 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1645/3295] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:08:18 2022] GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8 => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:08:19.492827 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b7f5fdd0-ae7b-4980-9451-d5143c0f8126 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:08:19.493498 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b7f5fdd0-ae7b-4980-9451-d5143c0f8126 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:08:19.501271 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7f5fdd0-ae7b-4980-9451-d5143c0f8126 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:19.501808 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7f5fdd0-ae7b-4980-9451-d5143c0f8126 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:19.502682 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7f5fdd0-ae7b-4980-9451-d5143c0f8126 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:19.503190 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7f5fdd0-ae7b-4980-9451-d5143c0f8126 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:19.654762 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b7f5fdd0-ae7b-4980-9451-d5143c0f8126 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:08:19.663716 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b7f5fdd0-ae7b-4980-9451-d5143c0f8126 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8" status: 200 len: 1367 microversion: 2.1 time: 0.176947 Apr 06 17:08:19.664293 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1651/3296] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:08:19 2022] GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:08:20.681549 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d9bf3d65-60a5-4bb2-ab58-1f0e4244b5aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:08:20.682244 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d9bf3d65-60a5-4bb2-ab58-1f0e4244b5aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:08:20.690067 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9bf3d65-60a5-4bb2-ab58-1f0e4244b5aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:20.690606 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9bf3d65-60a5-4bb2-ab58-1f0e4244b5aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:20.691511 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9bf3d65-60a5-4bb2-ab58-1f0e4244b5aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:20.692024 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9bf3d65-60a5-4bb2-ab58-1f0e4244b5aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:20.826902 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d9bf3d65-60a5-4bb2-ab58-1f0e4244b5aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:08:20.834590 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d9bf3d65-60a5-4bb2-ab58-1f0e4244b5aa tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8" status: 200 len: 1367 microversion: 2.1 time: 0.157823 Apr 06 17:08:20.835329 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1646/3297] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:08:20 2022] GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:08:21.852735 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ffb38423-fae6-48a3-8472-cba1df3aeb47 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:08:21.853737 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ffb38423-fae6-48a3-8472-cba1df3aeb47 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:08:21.860810 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffb38423-fae6-48a3-8472-cba1df3aeb47 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:21.861257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffb38423-fae6-48a3-8472-cba1df3aeb47 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:21.862023 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffb38423-fae6-48a3-8472-cba1df3aeb47 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:21.862457 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ffb38423-fae6-48a3-8472-cba1df3aeb47 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:22.005606 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ffb38423-fae6-48a3-8472-cba1df3aeb47 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:08:22.013342 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ffb38423-fae6-48a3-8472-cba1df3aeb47 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8" status: 200 len: 1367 microversion: 2.1 time: 0.165218 Apr 06 17:08:22.013902 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1652/3298] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:08:21 2022] GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:08:22.327812 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-425d7c73-4144-4c56-88c4-180d0cdaaf90 req-24991560-876d-41fb-876b-bc9c4a5c764d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e13a396-e857-43f3-8d75-410c8b1324e8", "name": "network-vif-plugged", "status": "completed", "tag": "1c2f84ef-5460-42db-82bc-1d89c3d65604"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:08:22.337702 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-425d7c73-4144-4c56-88c4-180d0cdaaf90 req-24991560-876d-41fb-876b-bc9c4a5c764d service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:22.338143 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-425d7c73-4144-4c56-88c4-180d0cdaaf90 req-24991560-876d-41fb-876b-bc9c4a5c764d service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:22.351334 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-425d7c73-4144-4c56-88c4-180d0cdaaf90 req-24991560-876d-41fb-876b-bc9c4a5c764d service nova] Creating event network-vif-plugged:1c2f84ef-5460-42db-82bc-1d89c3d65604 for instance 9e13a396-e857-43f3-8d75-410c8b1324e8 on hv-cinder-83684 Apr 06 17:08:22.356962 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-425d7c73-4144-4c56-88c4-180d0cdaaf90 req-24991560-876d-41fb-876b-bc9c4a5c764d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032936 Apr 06 17:08:22.357544 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1647/3299] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:08:23.034752 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9a1541e5-48dd-4d72-8506-4c13c54a467e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:08:23.035790 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9a1541e5-48dd-4d72-8506-4c13c54a467e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:08:23.046889 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a1541e5-48dd-4d72-8506-4c13c54a467e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:23.047630 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a1541e5-48dd-4d72-8506-4c13c54a467e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:23.048943 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a1541e5-48dd-4d72-8506-4c13c54a467e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:23.049671 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9a1541e5-48dd-4d72-8506-4c13c54a467e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:23.187257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9a1541e5-48dd-4d72-8506-4c13c54a467e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:08:23.195385 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9a1541e5-48dd-4d72-8506-4c13c54a467e tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8" status: 200 len: 1367 microversion: 2.1 time: 0.167169 Apr 06 17:08:23.196020 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1653/3300] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:08:23 2022] GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:08:24.213809 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-62015de3-dd67-4f58-83fc-aa318c8afbf1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:08:24.214734 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-62015de3-dd67-4f58-83fc-aa318c8afbf1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:08:24.222352 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62015de3-dd67-4f58-83fc-aa318c8afbf1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:24.222862 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62015de3-dd67-4f58-83fc-aa318c8afbf1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:24.223819 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62015de3-dd67-4f58-83fc-aa318c8afbf1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:24.224275 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62015de3-dd67-4f58-83fc-aa318c8afbf1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:24.362455 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-62015de3-dd67-4f58-83fc-aa318c8afbf1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:08:24.373556 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-62015de3-dd67-4f58-83fc-aa318c8afbf1 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8" status: 200 len: 1367 microversion: 2.1 time: 0.164782 Apr 06 17:08:24.374342 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1648/3301] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:08:24 2022] GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:08:25.392804 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-23ac0697-9992-4cba-8963-e0e864767156 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:08:25.393402 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-23ac0697-9992-4cba-8963-e0e864767156 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:08:25.400181 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23ac0697-9992-4cba-8963-e0e864767156 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:25.400632 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23ac0697-9992-4cba-8963-e0e864767156 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:25.401500 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23ac0697-9992-4cba-8963-e0e864767156 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:25.401939 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-23ac0697-9992-4cba-8963-e0e864767156 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:25.544140 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-23ac0697-9992-4cba-8963-e0e864767156 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:08:25.552141 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-23ac0697-9992-4cba-8963-e0e864767156 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8" status: 200 len: 1557 microversion: 2.1 time: 0.163267 Apr 06 17:08:25.552717 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1654/3302] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:08:25 2022] GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8 => generated 1557 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:08:25.576891 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b67f9712-7e3c-4fb3-a14b-049f4480c634 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:08:25.577442 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b67f9712-7e3c-4fb3-a14b-049f4480c634 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:08:25.585612 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b67f9712-7e3c-4fb3-a14b-049f4480c634 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:25.586054 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b67f9712-7e3c-4fb3-a14b-049f4480c634 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:25.586807 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b67f9712-7e3c-4fb3-a14b-049f4480c634 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:25.587227 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b67f9712-7e3c-4fb3-a14b-049f4480c634 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:25.676817 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b67f9712-7e3c-4fb3-a14b-049f4480c634 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105723 Apr 06 17:08:25.677558 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1649/3303] 10.222.0.64 () {58 vars in 1274 bytes} [Wed Apr 6 17:08:25 2022] GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:08:26.985288 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-2a46c2f6-dfeb-41a7-85fe-83b763dd9b6a req-3e2b49a3-1f8b-439b-80aa-501cf2de11c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e13a396-e857-43f3-8d75-410c8b1324e8", "tag": "1c2f84ef-5460-42db-82bc-1d89c3d65604"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:08:26.993511 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2a46c2f6-dfeb-41a7-85fe-83b763dd9b6a req-3e2b49a3-1f8b-439b-80aa-501cf2de11c0 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:08:26.993942 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2a46c2f6-dfeb-41a7-85fe-83b763dd9b6a req-3e2b49a3-1f8b-439b-80aa-501cf2de11c0 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:08:27.004621 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-2a46c2f6-dfeb-41a7-85fe-83b763dd9b6a req-3e2b49a3-1f8b-439b-80aa-501cf2de11c0 service nova] Creating event network-changed:1c2f84ef-5460-42db-82bc-1d89c3d65604 for instance 9e13a396-e857-43f3-8d75-410c8b1324e8 on hv-cinder-83684 Apr 06 17:08:27.009952 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-2a46c2f6-dfeb-41a7-85fe-83b763dd9b6a req-3e2b49a3-1f8b-439b-80aa-501cf2de11c0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077871 Apr 06 17:08:27.010503 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1655/3304] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:08:52.970831 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:08:52.972086 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 17:08:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:09:01.177004 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cd212978-86d5-44c8-9a53-7db4a7f8cb23 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:09:01.177671 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cd212978-86d5-44c8-9a53-7db4a7f8cb23 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:09:01.184361 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd212978-86d5-44c8-9a53-7db4a7f8cb23 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:01.184872 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd212978-86d5-44c8-9a53-7db4a7f8cb23 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:01.185625 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd212978-86d5-44c8-9a53-7db4a7f8cb23 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:01.186052 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd212978-86d5-44c8-9a53-7db4a7f8cb23 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:01.209149 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cd212978-86d5-44c8-9a53-7db4a7f8cb23 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8/ips" status: 200 len: 150 microversion: 2.1 time: 0.036674 Apr 06 17:09:01.209674 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1650/3305] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Apr 6 17:09:01 2022] GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:09:04.231533 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: ERROR oslo.messaging._drivers.impl_rabbit [-] [98b694a4-ebf4-4aca-8059-be2b87c00e80] AMQP server on 10.222.0.64:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 06 17:09:04.235531 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-81fc3683-1b0e-40a3-ac7c-6ce07f5c8829 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:09:04.236188 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-81fc3683-1b0e-40a3-ac7c-6ce07f5c8829 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 51c2747f-a615-42e2-9fb6-13e355306395] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:09:04.243099 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81fc3683-1b0e-40a3-ac7c-6ce07f5c8829 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:04.243625 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81fc3683-1b0e-40a3-ac7c-6ce07f5c8829 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:04.244493 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81fc3683-1b0e-40a3-ac7c-6ce07f5c8829 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:04.245034 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81fc3683-1b0e-40a3-ac7c-6ce07f5c8829 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:04.269924 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e1e84f7b-de4b-4034-88b6-6f147043e568 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:09:04.270612 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-81fc3683-1b0e-40a3-ac7c-6ce07f5c8829 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 51c2747f-a615-42e2-9fb6-13e355306395] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 06 17:09:04.271082 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e1e84f7b-de4b-4034-88b6-6f147043e568 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:09:04.278236 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1e84f7b-de4b-4034-88b6-6f147043e568 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:04.278930 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1e84f7b-de4b-4034-88b6-6f147043e568 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:04.284265 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1e84f7b-de4b-4034-88b6-6f147043e568 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:04.284698 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1e84f7b-de4b-4034-88b6-6f147043e568 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:04.318859 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e1e84f7b-de4b-4034-88b6-6f147043e568 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 06 17:09:04.363191 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-81fc3683-1b0e-40a3-ac7c-6ce07f5c8829 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "DELETE /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395" status: 204 len: 0 microversion: 2.20 time: 0.132828 Apr 06 17:09:04.364266 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1656/3306] 10.222.0.64 () {60 vars in 1279 bytes} [Wed Apr 6 17:09:04 2022] DELETE /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 06 17:09:04.373985 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-377cbf7a-1181-4030-8080-f8a4b1309fab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:09:04.374838 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-377cbf7a-1181-4030-8080-f8a4b1309fab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 51c2747f-a615-42e2-9fb6-13e355306395] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:09:04.381658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-377cbf7a-1181-4030-8080-f8a4b1309fab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:04.382095 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-377cbf7a-1181-4030-8080-f8a4b1309fab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:04.382921 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-377cbf7a-1181-4030-8080-f8a4b1309fab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:04.383357 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-377cbf7a-1181-4030-8080-f8a4b1309fab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:04.404893 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e1e84f7b-de4b-4034-88b6-6f147043e568 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "DELETE /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 204 len: 0 microversion: 2.1 time: 0.139409 Apr 06 17:09:04.405932 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1651/3307] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 17:09:04 2022] DELETE /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 06 17:09:04.414527 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-43ecf71e-7ee7-4995-8c64-f9ca20f65fed tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:09:04.415361 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-43ecf71e-7ee7-4995-8c64-f9ca20f65fed tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:09:04.422640 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43ecf71e-7ee7-4995-8c64-f9ca20f65fed tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:04.423334 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43ecf71e-7ee7-4995-8c64-f9ca20f65fed tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:04.424201 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43ecf71e-7ee7-4995-8c64-f9ca20f65fed tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:04.424760 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43ecf71e-7ee7-4995-8c64-f9ca20f65fed tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:04.547443 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-377cbf7a-1181-4030-8080-f8a4b1309fab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:09:04.566435 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-377cbf7a-1181-4030-8080-f8a4b1309fab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:09:04.567989 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-377cbf7a-1181-4030-8080-f8a4b1309fab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:09:04.569221 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-377cbf7a-1181-4030-8080-f8a4b1309fab tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395" status: 200 len: 1722 microversion: 2.20 time: 0.200244 Apr 06 17:09:04.570528 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1657/3308] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:09:04 2022] GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:09:04.576382 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-43ecf71e-7ee7-4995-8c64-f9ca20f65fed tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:09:04.584599 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-43ecf71e-7ee7-4995-8c64-f9ca20f65fed tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1509 microversion: 2.1 time: 0.174270 Apr 06 17:09:04.585232 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1652/3309] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:09:04 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:09:05.591073 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2f09b423-b3df-4561-8b74-fb31e06616a7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:09:05.599295 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2f09b423-b3df-4561-8b74-fb31e06616a7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 51c2747f-a615-42e2-9fb6-13e355306395] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:09:05.603829 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6db8779e-e0a9-47ac-8470-a6ec6365a785 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:09:05.606205 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6db8779e-e0a9-47ac-8470-a6ec6365a785 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:09:05.619786 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6db8779e-e0a9-47ac-8470-a6ec6365a785 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:05.620401 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6db8779e-e0a9-47ac-8470-a6ec6365a785 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:05.622497 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6db8779e-e0a9-47ac-8470-a6ec6365a785 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:05.622941 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6db8779e-e0a9-47ac-8470-a6ec6365a785 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:05.628086 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f09b423-b3df-4561-8b74-fb31e06616a7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:05.629416 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f09b423-b3df-4561-8b74-fb31e06616a7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:05.632267 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f09b423-b3df-4561-8b74-fb31e06616a7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:05.633321 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2f09b423-b3df-4561-8b74-fb31e06616a7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:05.644505 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] [98b694a4-ebf4-4aca-8059-be2b87c00e80] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 39668. Apr 06 17:09:05.716229 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6db8779e-e0a9-47ac-8470-a6ec6365a785 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:09:05.730177 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6db8779e-e0a9-47ac-8470-a6ec6365a785 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 200 len: 1467 microversion: 2.1 time: 0.130421 Apr 06 17:09:05.741702 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1653/3310] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:09:05 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 1467 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:09:05.747097 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-8b93bc49-6845-43a4-a1cb-54ff988f6f72 req-034a94d2-054d-4308-b604-82026ef10724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07920c31-01c7-4ec0-9198-ce3ead787c39", "name": "network-vif-deleted", "tag": "d480f3dc-3944-438a-a904-2477bf3a6e11"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:09:05.760424 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8b93bc49-6845-43a4-a1cb-54ff988f6f72 req-034a94d2-054d-4308-b604-82026ef10724 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:05.763016 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8b93bc49-6845-43a4-a1cb-54ff988f6f72 req-034a94d2-054d-4308-b604-82026ef10724 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:05.791613 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-8b93bc49-6845-43a4-a1cb-54ff988f6f72 req-034a94d2-054d-4308-b604-82026ef10724 service nova] Creating event network-vif-deleted:d480f3dc-3944-438a-a904-2477bf3a6e11 for instance 07920c31-01c7-4ec0-9198-ce3ead787c39 on hv-cinder-83684 Apr 06 17:09:05.811644 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-8b93bc49-6845-43a4-a1cb-54ff988f6f72 req-034a94d2-054d-4308-b604-82026ef10724 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070249 Apr 06 17:09:05.814271 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1654/3311] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:09:05.867851 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2f09b423-b3df-4561-8b74-fb31e06616a7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:09:05.875984 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2f09b423-b3df-4561-8b74-fb31e06616a7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:09:05.877574 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2f09b423-b3df-4561-8b74-fb31e06616a7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2230d519a0bf4024ac9e8be3a4f5aeb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07f53a1a9c4463693fa2c0005504b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:09:05.878721 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2f09b423-b3df-4561-8b74-fb31e06616a7 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395" status: 200 len: 1722 microversion: 2.20 time: 0.291970 Apr 06 17:09:05.879254 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1658/3312] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:09:05 2022] GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395 => generated 1722 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 06 17:09:06.134455 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-cafb2acf-3186-43c1-b918-439f114793ed req-8057d2e4-4386-459f-80a0-9c34c645d6db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c2747f-a615-42e2-9fb6-13e355306395", "name": "network-vif-deleted", "tag": "ece5056b-f8ed-42bb-96c3-81d12b2f0317"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:09:06.143361 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-cafb2acf-3186-43c1-b918-439f114793ed req-8057d2e4-4386-459f-80a0-9c34c645d6db service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:06.143836 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-cafb2acf-3186-43c1-b918-439f114793ed req-8057d2e4-4386-459f-80a0-9c34c645d6db service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:06.155537 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-cafb2acf-3186-43c1-b918-439f114793ed req-8057d2e4-4386-459f-80a0-9c34c645d6db service nova] Creating event network-vif-deleted:ece5056b-f8ed-42bb-96c3-81d12b2f0317 for instance 51c2747f-a615-42e2-9fb6-13e355306395 on hv-cinder-83684 Apr 06 17:09:06.164290 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-cafb2acf-3186-43c1-b918-439f114793ed req-8057d2e4-4386-459f-80a0-9c34c645d6db service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036856 Apr 06 17:09:06.165424 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1655/3313] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:09:06.748556 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ff4c0209-1380-44a1-bf6e-7b5a5d70d384 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:09:06.749371 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ff4c0209-1380-44a1-bf6e-7b5a5d70d384 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: 07920c31-01c7-4ec0-9198-ce3ead787c39] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:09:06.756124 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff4c0209-1380-44a1-bf6e-7b5a5d70d384 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:06.756564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff4c0209-1380-44a1-bf6e-7b5a5d70d384 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:06.757375 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff4c0209-1380-44a1-bf6e-7b5a5d70d384 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:06.757813 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ff4c0209-1380-44a1-bf6e-7b5a5d70d384 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:06.771361 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-ff4c0209-1380-44a1-bf6e-7b5a5d70d384 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] HTTP exception thrown: Instance 07920c31-01c7-4ec0-9198-ce3ead787c39 could not be found. Apr 06 17:09:06.771982 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ff4c0209-1380-44a1-bf6e-7b5a5d70d384 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Returning 404 to user: Instance 07920c31-01c7-4ec0-9198-ce3ead787c39 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:09:06.772837 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ff4c0209-1380-44a1-bf6e-7b5a5d70d384 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39" status: 404 len: 111 microversion: 2.1 time: 0.028247 Apr 06 17:09:06.773379 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1659/3314] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:09:06 2022] GET /compute/v2.1/servers/07920c31-01c7-4ec0-9198-ce3ead787c39 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:09:06.782718 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b55838d4-48a9-4d90-89ce-9e5ccfa82584 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:09:06.783322 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b55838d4-48a9-4d90-89ce-9e5ccfa82584 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:09:06.789358 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b55838d4-48a9-4d90-89ce-9e5ccfa82584 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:06.789787 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b55838d4-48a9-4d90-89ce-9e5ccfa82584 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:06.790772 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b55838d4-48a9-4d90-89ce-9e5ccfa82584 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:06.791207 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b55838d4-48a9-4d90-89ce-9e5ccfa82584 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:06.817457 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b55838d4-48a9-4d90-89ce-9e5ccfa82584 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 06 17:09:06.911499 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b55838d4-48a9-4d90-89ce-9e5ccfa82584 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 204 len: 0 microversion: 2.1 time: 0.133090 Apr 06 17:09:06.912333 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1656/3315] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 17:09:06 2022] DELETE /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 06 17:09:06.922165 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ea68b8ab-a012-4011-882d-74d7f5a83bb6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:09:06.923025 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ea68b8ab-a012-4011-882d-74d7f5a83bb6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:09:06.930959 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea68b8ab-a012-4011-882d-74d7f5a83bb6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:06.931599 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea68b8ab-a012-4011-882d-74d7f5a83bb6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:06.932543 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea68b8ab-a012-4011-882d-74d7f5a83bb6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:06.932908 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea68b8ab-a012-4011-882d-74d7f5a83bb6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:07.043045 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-34b861df-b0f2-4407-b1cb-93e6fa1a620e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:09:07.044312 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-34b861df-b0f2-4407-b1cb-93e6fa1a620e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 51c2747f-a615-42e2-9fb6-13e355306395] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:09:07.052770 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34b861df-b0f2-4407-b1cb-93e6fa1a620e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:07.053918 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34b861df-b0f2-4407-b1cb-93e6fa1a620e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:07.054799 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34b861df-b0f2-4407-b1cb-93e6fa1a620e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:07.055330 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-34b861df-b0f2-4407-b1cb-93e6fa1a620e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:07.070414 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-34b861df-b0f2-4407-b1cb-93e6fa1a620e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] HTTP exception thrown: Instance 51c2747f-a615-42e2-9fb6-13e355306395 could not be found. Apr 06 17:09:07.071100 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-34b861df-b0f2-4407-b1cb-93e6fa1a620e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Returning 404 to user: Instance 51c2747f-a615-42e2-9fb6-13e355306395 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:09:07.072008 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-34b861df-b0f2-4407-b1cb-93e6fa1a620e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395" status: 404 len: 111 microversion: 2.20 time: 0.178434 Apr 06 17:09:07.073236 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1660/3316] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:09:06 2022] GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 06 17:09:07.079683 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ea68b8ab-a012-4011-882d-74d7f5a83bb6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:09:07.082608 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8d899be1-d0ea-4bfd-b8e7-7b4c977361cd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '.version_select at 0x7fa9cf1444c0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:09:07.087669 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ea68b8ab-a012-4011-882d-74d7f5a83bb6 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1523 microversion: 2.1 time: 0.170715 Apr 06 17:09:07.088440 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1657/3317] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:09:06 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:09:07.101434 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8d899be1-d0ea-4bfd-b8e7-7b4c977361cd tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-718255457" status: 204 len: 0 microversion: 2.20 time: 0.023485 Apr 06 17:09:07.102043 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1661/3318] 10.222.0.64 () {60 vars in 1258 bytes} [Wed Apr 6 17:09:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-718255457 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 06 17:09:08.105661 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ac4b280d-5b15-42c5-b4b6-6494a1f1c0e7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:09:08.106253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ac4b280d-5b15-42c5-b4b6-6494a1f1c0e7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:09:08.113148 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac4b280d-5b15-42c5-b4b6-6494a1f1c0e7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:08.113594 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac4b280d-5b15-42c5-b4b6-6494a1f1c0e7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:08.114385 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac4b280d-5b15-42c5-b4b6-6494a1f1c0e7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:08.114816 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac4b280d-5b15-42c5-b4b6-6494a1f1c0e7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:08.145227 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac4b280d-5b15-42c5-b4b6-6494a1f1c0e7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:08.145690 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac4b280d-5b15-42c5-b4b6-6494a1f1c0e7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:08.146131 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-ac4b280d-5b15-42c5-b4b6-6494a1f1c0e7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lazy-loading 'fault' on Instance uuid c42ef26f-42b4-4e28-a22b-48c9149966cc {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 06 17:09:08.196803 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ac4b280d-5b15-42c5-b4b6-6494a1f1c0e7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c31bf4706fc42d992d98d9c0da54f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c4762a201e43a1b7a5f755b26e5cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:09:08.197894 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-dde7ab2b-b613-43b6-9a53-7ec79d948316 req-6de3117f-f18f-40c8-af56-d1b14bf70a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42ef26f-42b4-4e28-a22b-48c9149966cc", "name": "network-vif-deleted", "tag": "bedf8854-58b7-4f53-a752-e82232e8ce14"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:09:08.205334 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ac4b280d-5b15-42c5-b4b6-6494a1f1c0e7 tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 200 len: 1312 microversion: 2.1 time: 0.104014 Apr 06 17:09:08.207148 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-dde7ab2b-b613-43b6-9a53-7ec79d948316 req-6de3117f-f18f-40c8-af56-d1b14bf70a26 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:08.207625 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-dde7ab2b-b613-43b6-9a53-7ec79d948316 req-6de3117f-f18f-40c8-af56-d1b14bf70a26 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:08.214547 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1658/3319] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:09:08 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 1312 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:09:08.219090 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-dde7ab2b-b613-43b6-9a53-7ec79d948316 req-6de3117f-f18f-40c8-af56-d1b14bf70a26 service nova] Creating event network-vif-deleted:bedf8854-58b7-4f53-a752-e82232e8ce14 for instance c42ef26f-42b4-4e28-a22b-48c9149966cc on hv-cinder-83684 Apr 06 17:09:08.224322 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-dde7ab2b-b613-43b6-9a53-7ec79d948316 req-6de3117f-f18f-40c8-af56-d1b14bf70a26 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030749 Apr 06 17:09:08.225141 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1662/3320] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:09:09.226654 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8299c2dd-3005-4431-a183-af92af2af8bb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:09:09.227969 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8299c2dd-3005-4431-a183-af92af2af8bb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] [instance: c42ef26f-42b4-4e28-a22b-48c9149966cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:09:09.238639 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8299c2dd-3005-4431-a183-af92af2af8bb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:09.239387 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8299c2dd-3005-4431-a183-af92af2af8bb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:09.240627 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8299c2dd-3005-4431-a183-af92af2af8bb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:09:09.241498 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8299c2dd-3005-4431-a183-af92af2af8bb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:09:09.259035 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-8299c2dd-3005-4431-a183-af92af2af8bb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] HTTP exception thrown: Instance c42ef26f-42b4-4e28-a22b-48c9149966cc could not be found. Apr 06 17:09:09.259613 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8299c2dd-3005-4431-a183-af92af2af8bb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] Returning 404 to user: Instance c42ef26f-42b4-4e28-a22b-48c9149966cc could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:09:09.260431 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8299c2dd-3005-4431-a183-af92af2af8bb tempest-ServerRescueNegativeTestJSON-421181408 tempest-ServerRescueNegativeTestJSON-421181408-project] 10.222.0.64 "GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc" status: 404 len: 111 microversion: 2.1 time: 0.040723 Apr 06 17:09:09.261017 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1659/3321] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:09:09 2022] GET /compute/v2.1/servers/c42ef26f-42b4-4e28-a22b-48c9149966cc => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:09:12.959822 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b2b2b1e3-d572-47fe-b11f-908532a74bf9 tempest-VolumesGetTestJSON-817512453 tempest-VolumesGetTestJSON-817512453-project] Action: 'create', calling method: .version_select at 0x7fa9c9f430d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-658034500", "metadata": {"Type": "work"}}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:11:04.557978 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b2b2b1e3-d572-47fe-b11f-908532a74bf9 tempest-VolumesGetTestJSON-817512453 tempest-VolumesGetTestJSON-817512453-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 111.712142 Apr 06 17:11:04.558847 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1663/3322] 10.222.0.64 () {60 vars in 1155 bytes} [Wed Apr 6 17:09:12 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 111714 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 06 17:12:04.069337 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:12:04.070544 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 17:12:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:12:11.564985 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:12:11.565954 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 17:12:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:12:12.986142 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:12:12.986899 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 17:12:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:12:23.187714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:12:23.189020 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 17:12:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:13:03.374649 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6af15540-3121-4b02-baeb-8e0f9975e3af] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 06 17:13:03.381177 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c2eeeff4-7a5e-4602-aa35-6ba4b2aae0cd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14f952c6-cee7-4527-8cb8-ebe806eb9c24"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:13:03.382748 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c2eeeff4-7a5e-4602-aa35-6ba4b2aae0cd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:03.389152 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: ERROR oslo.messaging._drivers.impl_rabbit [-] [98b694a4-ebf4-4aca-8059-be2b87c00e80] AMQP server on 10.222.0.64:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 06 17:13:03.391835 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2eeeff4-7a5e-4602-aa35-6ba4b2aae0cd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:03.392559 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2eeeff4-7a5e-4602-aa35-6ba4b2aae0cd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:03.393274 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3a84966a-6fe6-47d1-b9a2-1d5472cf44fd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45d61fb7-409f-4bad-85ab-d023ee1296ac"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:13:03.394398 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2eeeff4-7a5e-4602-aa35-6ba4b2aae0cd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:03.394802 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3a84966a-6fe6-47d1-b9a2-1d5472cf44fd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:03.394948 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2eeeff4-7a5e-4602-aa35-6ba4b2aae0cd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:03.408523 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a84966a-6fe6-47d1-b9a2-1d5472cf44fd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:03.409190 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a84966a-6fe6-47d1-b9a2-1d5472cf44fd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:03.410128 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a84966a-6fe6-47d1-b9a2-1d5472cf44fd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:03.410589 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a84966a-6fe6-47d1-b9a2-1d5472cf44fd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:04.383514 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] [6af15540-3121-4b02-baeb-8e0f9975e3af] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 39912. Apr 06 17:13:04.395809 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] [98b694a4-ebf4-4aca-8059-be2b87c00e80] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 39914. Apr 06 17:13:07.054018 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c2eeeff4-7a5e-4602-aa35-6ba4b2aae0cd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "POST /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.682156 Apr 06 17:13:07.055711 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1660/3323] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Apr 6 17:13:03 2022] POST /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8/os-volume_attachments => generated 194 bytes in 3685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:13:07.144205 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3a84966a-6fe6-47d1-b9a2-1d5472cf44fd tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "POST /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.758226 Apr 06 17:13:07.145213 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1664/3324] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Apr 6 17:13:03 2022] POST /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32/os-volume_attachments => generated 194 bytes in 3760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 17:13:07.762841 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-ca9350c7-ce0e-4983-8f7e-2ce06af2a252 req-ddc9fc5a-c61f-4c3d-9c1d-98ee4d657f61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330d17b1-0d7d-4519-8dc3-3210eb25aa3c", "name": "network-vif-deleted", "tag": "e267cfb2-7045-4a09-851f-05d45654d0a1"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:13:07.772032 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ca9350c7-ce0e-4983-8f7e-2ce06af2a252 req-ddc9fc5a-c61f-4c3d-9c1d-98ee4d657f61 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:07.772514 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ca9350c7-ce0e-4983-8f7e-2ce06af2a252 req-ddc9fc5a-c61f-4c3d-9c1d-98ee4d657f61 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:07.782514 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-ca9350c7-ce0e-4983-8f7e-2ce06af2a252 req-ddc9fc5a-c61f-4c3d-9c1d-98ee4d657f61 service nova] Creating event network-vif-deleted:e267cfb2-7045-4a09-851f-05d45654d0a1 for instance 330d17b1-0d7d-4519-8dc3-3210eb25aa3c on hv-cinder-83684 Apr 06 17:13:07.787466 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-ca9350c7-ce0e-4983-8f7e-2ce06af2a252 req-ddc9fc5a-c61f-4c3d-9c1d-98ee4d657f61 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227881 Apr 06 17:13:07.788471 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1661/3325] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:13:15.446389 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-888536f9-4139-4359-8e2e-f6cb11db9f60 req-e4aae60a-a9d2-4128-b90f-f6dfc6ce079c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d36d74-5240-44c1-8425-e1dedf7c6718", "name": "network-vif-deleted", "tag": "c7da763b-aba6-4b1e-ad62-c32222723c20"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:13:15.457126 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-888536f9-4139-4359-8e2e-f6cb11db9f60 req-e4aae60a-a9d2-4128-b90f-f6dfc6ce079c service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:15.457580 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-888536f9-4139-4359-8e2e-f6cb11db9f60 req-e4aae60a-a9d2-4128-b90f-f6dfc6ce079c service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:15.470304 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-888536f9-4139-4359-8e2e-f6cb11db9f60 req-e4aae60a-a9d2-4128-b90f-f6dfc6ce079c service nova] Creating event network-vif-deleted:c7da763b-aba6-4b1e-ad62-c32222723c20 for instance d5d36d74-5240-44c1-8425-e1dedf7c6718 on hv-cinder-83684 Apr 06 17:13:15.477437 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-888536f9-4139-4359-8e2e-f6cb11db9f60 req-e4aae60a-a9d2-4128-b90f-f6dfc6ce079c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035762 Apr 06 17:13:15.478567 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1665/3326] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:13:17.495843 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-5f6c06d5-dfca-47cd-8ff7-22905b0ab3fa req-fc14e9f8-3f1a-440e-97ab-39561436eb60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce", "name": "network-vif-deleted", "tag": "e5eff3a1-0302-4963-a5c6-4309ac8d884f"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:13:17.504646 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5f6c06d5-dfca-47cd-8ff7-22905b0ab3fa req-fc14e9f8-3f1a-440e-97ab-39561436eb60 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:17.505174 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5f6c06d5-dfca-47cd-8ff7-22905b0ab3fa req-fc14e9f8-3f1a-440e-97ab-39561436eb60 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:17.516668 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-5f6c06d5-dfca-47cd-8ff7-22905b0ab3fa req-fc14e9f8-3f1a-440e-97ab-39561436eb60 service nova] Creating event network-vif-deleted:e5eff3a1-0302-4963-a5c6-4309ac8d884f for instance c7aa5cc0-89e8-41d4-8017-8c3d7c6823ce on hv-cinder-83684 Apr 06 17:13:17.522323 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-5f6c06d5-dfca-47cd-8ff7-22905b0ab3fa req-fc14e9f8-3f1a-440e-97ab-39561436eb60 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030463 Apr 06 17:13:17.522910 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1662/3327] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:13:25.935679 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:13:25.936495 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 17:13:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:13:32.700972 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-27f5d4ab-042d-48b4-9a2f-646e3eda978f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:32.701903 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-27f5d4ab-042d-48b4-9a2f-646e3eda978f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:32.708537 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27f5d4ab-042d-48b4-9a2f-646e3eda978f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:32.709134 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27f5d4ab-042d-48b4-9a2f-646e3eda978f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:32.710305 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27f5d4ab-042d-48b4-9a2f-646e3eda978f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:32.711539 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-27f5d4ab-042d-48b4-9a2f-646e3eda978f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:32.801191 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-27f5d4ab-042d-48b4-9a2f-646e3eda978f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lazy-loading 'services' on Instance uuid 9e13a396-e857-43f3-8d75-410c8b1324e8 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 06 17:13:32.897148 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-27f5d4ab-042d-48b4-9a2f-646e3eda978f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "DELETE /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8/os-volume_attachments/14f952c6-cee7-4527-8cb8-ebe806eb9c24" status: 202 len: 0 microversion: 2.1 time: 0.200689 Apr 06 17:13:32.897745 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1666/3328] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Apr 6 17:13:32 2022] DELETE /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8/os-volume_attachments/14f952c6-cee7-4527-8cb8-ebe806eb9c24 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 06 17:13:32.908556 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-612fc549-2745-4e0a-9ab2-308cc97473bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:32.910003 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-612fc549-2745-4e0a-9ab2-308cc97473bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:32.916928 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-612fc549-2745-4e0a-9ab2-308cc97473bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:32.917625 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-612fc549-2745-4e0a-9ab2-308cc97473bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:32.918571 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-612fc549-2745-4e0a-9ab2-308cc97473bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:32.919280 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-612fc549-2745-4e0a-9ab2-308cc97473bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:32.964546 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-612fc549-2745-4e0a-9ab2-308cc97473bd tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061937 Apr 06 17:13:32.965213 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1663/3329] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 17:13:32 2022] GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:13:33.978362 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-1cbe19a6-6151-4543-b89e-9699d734ac38 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:33.979426 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-1cbe19a6-6151-4543-b89e-9699d734ac38 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:33.986697 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1cbe19a6-6151-4543-b89e-9699d734ac38 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:33.987143 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1cbe19a6-6151-4543-b89e-9699d734ac38 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:33.987904 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1cbe19a6-6151-4543-b89e-9699d734ac38 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:33.988334 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-1cbe19a6-6151-4543-b89e-9699d734ac38 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:34.018321 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-1cbe19a6-6151-4543-b89e-9699d734ac38 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044810 Apr 06 17:13:34.018894 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1667/3330] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 17:13:33 2022] GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:13:35.030193 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0b7ba1be-d78a-4ac9-b0ae-a8240a9c182a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:35.031555 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0b7ba1be-d78a-4ac9-b0ae-a8240a9c182a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:35.038006 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b7ba1be-d78a-4ac9-b0ae-a8240a9c182a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:35.038485 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b7ba1be-d78a-4ac9-b0ae-a8240a9c182a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:35.039257 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b7ba1be-d78a-4ac9-b0ae-a8240a9c182a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:35.039670 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b7ba1be-d78a-4ac9-b0ae-a8240a9c182a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:35.071942 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0b7ba1be-d78a-4ac9-b0ae-a8240a9c182a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045727 Apr 06 17:13:35.072915 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1664/3331] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 17:13:35 2022] GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:13:36.085309 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-855b670d-0ead-4d32-84cc-427f09e29c97 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:36.086760 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-855b670d-0ead-4d32-84cc-427f09e29c97 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:36.096866 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-855b670d-0ead-4d32-84cc-427f09e29c97 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:36.098064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-855b670d-0ead-4d32-84cc-427f09e29c97 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:36.099335 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-855b670d-0ead-4d32-84cc-427f09e29c97 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:36.100026 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-855b670d-0ead-4d32-84cc-427f09e29c97 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:36.138929 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-855b670d-0ead-4d32-84cc-427f09e29c97 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058105 Apr 06 17:13:36.139506 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1668/3332] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 17:13:36 2022] GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:13:37.151484 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-902adb0c-92bf-46d6-b6d7-bbd32a3f729a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:37.152413 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-902adb0c-92bf-46d6-b6d7-bbd32a3f729a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:37.159494 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-902adb0c-92bf-46d6-b6d7-bbd32a3f729a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:37.159937 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-902adb0c-92bf-46d6-b6d7-bbd32a3f729a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:37.160675 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-902adb0c-92bf-46d6-b6d7-bbd32a3f729a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:37.161168 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-902adb0c-92bf-46d6-b6d7-bbd32a3f729a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:37.192269 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-902adb0c-92bf-46d6-b6d7-bbd32a3f729a tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044764 Apr 06 17:13:37.192995 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1665/3333] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 17:13:37 2022] GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:13:38.177849 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:13:38.178456 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 17:13:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:13:38.207796 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-00960773-d357-4a6b-b8a1-8b4afb6f7bb5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:38.208717 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-00960773-d357-4a6b-b8a1-8b4afb6f7bb5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:38.215092 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00960773-d357-4a6b-b8a1-8b4afb6f7bb5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:38.215536 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00960773-d357-4a6b-b8a1-8b4afb6f7bb5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:38.216294 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00960773-d357-4a6b-b8a1-8b4afb6f7bb5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:38.216717 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-00960773-d357-4a6b-b8a1-8b4afb6f7bb5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:38.247769 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-00960773-d357-4a6b-b8a1-8b4afb6f7bb5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044873 Apr 06 17:13:38.248367 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1669/3334] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 17:13:38 2022] GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:13:38.992492 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-89df6516-712e-4aa4-b631-80b78965b34a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:38.993358 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-89df6516-712e-4aa4-b631-80b78965b34a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:38.999862 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89df6516-712e-4aa4-b631-80b78965b34a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:39.000299 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89df6516-712e-4aa4-b631-80b78965b34a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:39.001281 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89df6516-712e-4aa4-b631-80b78965b34a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:39.001725 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89df6516-712e-4aa4-b631-80b78965b34a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:39.033291 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-89df6516-712e-4aa4-b631-80b78965b34a tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044748 Apr 06 17:13:39.033846 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1666/3335] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 17:13:38 2022] GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:13:39.044199 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a4dab2c9-1606-4efc-ac2f-11f70f6df6bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:39.044692 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a4dab2c9-1606-4efc-ac2f-11f70f6df6bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:39.051441 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4dab2c9-1606-4efc-ac2f-11f70f6df6bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:39.051903 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4dab2c9-1606-4efc-ac2f-11f70f6df6bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:39.052729 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4dab2c9-1606-4efc-ac2f-11f70f6df6bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:39.053173 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a4dab2c9-1606-4efc-ac2f-11f70f6df6bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:39.081925 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a4dab2c9-1606-4efc-ac2f-11f70f6df6bc tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32/os-volume_attachments/45d61fb7-409f-4bad-85ab-d023ee1296ac" status: 200 len: 194 microversion: 2.1 time: 0.041639 Apr 06 17:13:39.082530 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1670/3336] 10.222.0.64 () {58 vars in 1412 bytes} [Wed Apr 6 17:13:39 2022] GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32/os-volume_attachments/45d61fb7-409f-4bad-85ab-d023ee1296ac => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:13:39.259963 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6feac493-0612-4bd8-9503-9acf89a19d78 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:39.260928 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6feac493-0612-4bd8-9503-9acf89a19d78 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:39.267302 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6feac493-0612-4bd8-9503-9acf89a19d78 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:39.267766 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6feac493-0612-4bd8-9503-9acf89a19d78 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:39.268587 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6feac493-0612-4bd8-9503-9acf89a19d78 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:39.269020 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6feac493-0612-4bd8-9503-9acf89a19d78 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:39.298267 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6feac493-0612-4bd8-9503-9acf89a19d78 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042306 Apr 06 17:13:39.298842 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1667/3337] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 17:13:39 2022] GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 06 17:13:39.361405 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-81cd31a0-9196-4e8e-a60d-a02f27ecef11 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:39.361945 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-81cd31a0-9196-4e8e-a60d-a02f27ecef11 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:39.368167 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81cd31a0-9196-4e8e-a60d-a02f27ecef11 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:39.368564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81cd31a0-9196-4e8e-a60d-a02f27ecef11 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:39.369971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81cd31a0-9196-4e8e-a60d-a02f27ecef11 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:39.370405 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-81cd31a0-9196-4e8e-a60d-a02f27ecef11 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:39.396884 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-81cd31a0-9196-4e8e-a60d-a02f27ecef11 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 06 17:13:39.503217 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-81cd31a0-9196-4e8e-a60d-a02f27ecef11 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "DELETE /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8" status: 204 len: 0 microversion: 2.1 time: 0.145404 Apr 06 17:13:39.503722 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1671/3338] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 17:13:39 2022] DELETE /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 06 17:13:39.512336 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-55ee4d05-7731-45dc-8978-467638f71bed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:39.513038 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-55ee4d05-7731-45dc-8978-467638f71bed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:39.520115 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55ee4d05-7731-45dc-8978-467638f71bed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:39.520548 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55ee4d05-7731-45dc-8978-467638f71bed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:39.521397 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55ee4d05-7731-45dc-8978-467638f71bed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:39.521857 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55ee4d05-7731-45dc-8978-467638f71bed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:39.932808 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-55ee4d05-7731-45dc-8978-467638f71bed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:13:39.941108 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-55ee4d05-7731-45dc-8978-467638f71bed tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8" status: 200 len: 1682 microversion: 2.1 time: 0.432690 Apr 06 17:13:39.941775 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1668/3339] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:13:39 2022] GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8 => generated 1682 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:13:40.439537 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fecfd0d6-d571-491f-86c5-9356499ec380 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37f3191b-841c-48c9-be80-99772e76161c"}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:13:40.440812 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fecfd0d6-d571-491f-86c5-9356499ec380 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:40.447063 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fecfd0d6-d571-491f-86c5-9356499ec380 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:40.447526 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fecfd0d6-d571-491f-86c5-9356499ec380 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:40.448302 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fecfd0d6-d571-491f-86c5-9356499ec380 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:40.448755 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fecfd0d6-d571-491f-86c5-9356499ec380 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:40.718116 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fecfd0d6-d571-491f-86c5-9356499ec380 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "POST /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283411 Apr 06 17:13:40.718816 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1672/3340] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Apr 6 17:13:40 2022] POST /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:13:40.960448 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bdb51ea4-2c3f-46db-9be2-effb8e5cf733 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:40.960966 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bdb51ea4-2c3f-46db-9be2-effb8e5cf733 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:40.967698 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bdb51ea4-2c3f-46db-9be2-effb8e5cf733 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:40.968310 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bdb51ea4-2c3f-46db-9be2-effb8e5cf733 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:40.969342 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bdb51ea4-2c3f-46db-9be2-effb8e5cf733 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:40.969840 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bdb51ea4-2c3f-46db-9be2-effb8e5cf733 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:41.062858 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-bdb51ea4-2c3f-46db-9be2-effb8e5cf733 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0f09ff8c240a485a775d3c95d626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b211944dc94094801aa5dd3d20a401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:13:41.070825 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bdb51ea4-2c3f-46db-9be2-effb8e5cf733 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8" status: 200 len: 1615 microversion: 2.1 time: 0.115019 Apr 06 17:13:41.071415 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1669/3341] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:13:40 2022] GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8 => generated 1615 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:13:41.282578 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-ecec9076-45ae-45be-9e3d-a884c7b9eda3 req-c7f74bd5-764e-44a0-99bc-91f1f986a4f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e13a396-e857-43f3-8d75-410c8b1324e8", "name": "network-vif-deleted", "tag": "1c2f84ef-5460-42db-82bc-1d89c3d65604"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:13:41.292571 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ecec9076-45ae-45be-9e3d-a884c7b9eda3 req-c7f74bd5-764e-44a0-99bc-91f1f986a4f7 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:41.293070 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-ecec9076-45ae-45be-9e3d-a884c7b9eda3 req-c7f74bd5-764e-44a0-99bc-91f1f986a4f7 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:41.318105 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-ecec9076-45ae-45be-9e3d-a884c7b9eda3 req-c7f74bd5-764e-44a0-99bc-91f1f986a4f7 service nova] Creating event network-vif-deleted:1c2f84ef-5460-42db-82bc-1d89c3d65604 for instance 9e13a396-e857-43f3-8d75-410c8b1324e8 on hv-cinder-83684 Apr 06 17:13:41.323846 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-ecec9076-45ae-45be-9e3d-a884c7b9eda3 req-c7f74bd5-764e-44a0-99bc-91f1f986a4f7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045945 Apr 06 17:13:41.325625 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1673/3342] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:13:42.088374 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-80542f36-8858-4e91-8093-3743438a0a1f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:42.089153 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-80542f36-8858-4e91-8093-3743438a0a1f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:42.096129 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80542f36-8858-4e91-8093-3743438a0a1f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:42.096774 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80542f36-8858-4e91-8093-3743438a0a1f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:42.098176 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80542f36-8858-4e91-8093-3743438a0a1f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:42.098619 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80542f36-8858-4e91-8093-3743438a0a1f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:42.113660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-80542f36-8858-4e91-8093-3743438a0a1f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] HTTP exception thrown: Instance 9e13a396-e857-43f3-8d75-410c8b1324e8 could not be found. Apr 06 17:13:42.114268 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-80542f36-8858-4e91-8093-3743438a0a1f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Returning 404 to user: Instance 9e13a396-e857-43f3-8d75-410c8b1324e8 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:13:42.115117 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-80542f36-8858-4e91-8093-3743438a0a1f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8" status: 404 len: 111 microversion: 2.1 time: 0.030851 Apr 06 17:13:42.115682 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1670/3343] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:13:42 2022] GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:13:42.125489 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-efcf0aeb-0c2d-46df-821a-e24a5cd39d77 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '.version_select at 0x7fa9cf0a5ca0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:42.149758 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-efcf0aeb-0c2d-46df-821a-e24a5cd39d77 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2068531710" status: 202 len: 0 microversion: 2.1 time: 0.028777 Apr 06 17:13:42.150109 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1674/3344] 10.222.0.64 () {58 vars in 1220 bytes} [Wed Apr 6 17:13:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2068531710 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 06 17:13:43.950918 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b7ce1704-b592-4147-9251-53093d91540f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:43.951598 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b7ce1704-b592-4147-9251-53093d91540f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:43.958425 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7ce1704-b592-4147-9251-53093d91540f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:43.958874 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7ce1704-b592-4147-9251-53093d91540f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:43.959668 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7ce1704-b592-4147-9251-53093d91540f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:43.960070 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7ce1704-b592-4147-9251-53093d91540f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:43.974645 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-b7ce1704-b592-4147-9251-53093d91540f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] HTTP exception thrown: Instance 9e13a396-e857-43f3-8d75-410c8b1324e8 could not be found. Apr 06 17:13:43.975234 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b7ce1704-b592-4147-9251-53093d91540f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Returning 404 to user: Instance 9e13a396-e857-43f3-8d75-410c8b1324e8 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:13:43.976066 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b7ce1704-b592-4147-9251-53093d91540f tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "DELETE /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8" status: 404 len: 111 microversion: 2.1 time: 0.029140 Apr 06 17:13:43.976598 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1671/3345] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 17:13:43 2022] DELETE /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:13:43.984482 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-58a39f2d-b7d4-4e12-a2c6-695f0d698f6b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:43.985373 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-58a39f2d-b7d4-4e12-a2c6-695f0d698f6b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 9e13a396-e857-43f3-8d75-410c8b1324e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:43.994606 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58a39f2d-b7d4-4e12-a2c6-695f0d698f6b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:43.995057 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58a39f2d-b7d4-4e12-a2c6-695f0d698f6b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:43.995815 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58a39f2d-b7d4-4e12-a2c6-695f0d698f6b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:43.996708 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-58a39f2d-b7d4-4e12-a2c6-695f0d698f6b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:44.010902 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-58a39f2d-b7d4-4e12-a2c6-695f0d698f6b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] HTTP exception thrown: Instance 9e13a396-e857-43f3-8d75-410c8b1324e8 could not be found. Apr 06 17:13:44.011492 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-58a39f2d-b7d4-4e12-a2c6-695f0d698f6b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Returning 404 to user: Instance 9e13a396-e857-43f3-8d75-410c8b1324e8 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:13:44.012356 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-58a39f2d-b7d4-4e12-a2c6-695f0d698f6b tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8" status: 404 len: 111 microversion: 2.1 time: 0.031738 Apr 06 17:13:44.013002 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1675/3346] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:13:43 2022] GET /compute/v2.1/servers/9e13a396-e857-43f3-8d75-410c8b1324e8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:13:45.147296 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3fb9d41c-dd3e-4bb8-8bef-2f8b3822dffe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:45.147867 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3fb9d41c-dd3e-4bb8-8bef-2f8b3822dffe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 4be6d0c6-2b22-40ab-b5b9-0f738db81efe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:45.154659 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fb9d41c-dd3e-4bb8-8bef-2f8b3822dffe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:45.155114 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fb9d41c-dd3e-4bb8-8bef-2f8b3822dffe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:45.155888 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fb9d41c-dd3e-4bb8-8bef-2f8b3822dffe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:45.156330 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fb9d41c-dd3e-4bb8-8bef-2f8b3822dffe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:45.171401 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-3fb9d41c-dd3e-4bb8-8bef-2f8b3822dffe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] HTTP exception thrown: Instance 4be6d0c6-2b22-40ab-b5b9-0f738db81efe could not be found. Apr 06 17:13:45.171980 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3fb9d41c-dd3e-4bb8-8bef-2f8b3822dffe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Returning 404 to user: Instance 4be6d0c6-2b22-40ab-b5b9-0f738db81efe could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:13:45.172867 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3fb9d41c-dd3e-4bb8-8bef-2f8b3822dffe tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe" status: 404 len: 111 microversion: 2.1 time: 0.029591 Apr 06 17:13:45.173461 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1672/3347] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 17:13:45 2022] DELETE /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:13:45.181838 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3418236c-6feb-41dd-beff-461b5966c169 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:45.182416 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3418236c-6feb-41dd-beff-461b5966c169 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 4be6d0c6-2b22-40ab-b5b9-0f738db81efe] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:45.189395 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3418236c-6feb-41dd-beff-461b5966c169 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:45.189845 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3418236c-6feb-41dd-beff-461b5966c169 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:45.190622 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3418236c-6feb-41dd-beff-461b5966c169 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:45.191051 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3418236c-6feb-41dd-beff-461b5966c169 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:45.206574 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-3418236c-6feb-41dd-beff-461b5966c169 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] HTTP exception thrown: Instance 4be6d0c6-2b22-40ab-b5b9-0f738db81efe could not be found. Apr 06 17:13:45.207151 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3418236c-6feb-41dd-beff-461b5966c169 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Returning 404 to user: Instance 4be6d0c6-2b22-40ab-b5b9-0f738db81efe could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:13:45.208034 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3418236c-6feb-41dd-beff-461b5966c169 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe" status: 404 len: 111 microversion: 2.1 time: 0.030256 Apr 06 17:13:45.208566 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1676/3348] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:13:45 2022] GET /compute/v2.1/servers/4be6d0c6-2b22-40ab-b5b9-0f738db81efe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:13:45.217069 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d1293c87-bd47-4b31-84eb-c9200878e2bc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:45.217566 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d1293c87-bd47-4b31-84eb-c9200878e2bc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:45.224517 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1293c87-bd47-4b31-84eb-c9200878e2bc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:45.225003 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1293c87-bd47-4b31-84eb-c9200878e2bc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:45.225773 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1293c87-bd47-4b31-84eb-c9200878e2bc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:45.226208 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1293c87-bd47-4b31-84eb-c9200878e2bc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:45.244759 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-d1293c87-bd47-4b31-84eb-c9200878e2bc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] HTTP exception thrown: Instance 1fd9a412-d36a-4da6-80ce-a49cb771a0af could not be found. Apr 06 17:13:45.245274 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d1293c87-bd47-4b31-84eb-c9200878e2bc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Returning 404 to user: Instance 1fd9a412-d36a-4da6-80ce-a49cb771a0af could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:13:45.246116 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d1293c87-bd47-4b31-84eb-c9200878e2bc tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 404 len: 111 microversion: 2.1 time: 0.033102 Apr 06 17:13:45.246669 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1673/3349] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 17:13:45 2022] DELETE /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:13:45.255346 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0bde6e34-a338-41eb-92b1-3fd1d652d9a5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:45.255971 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0bde6e34-a338-41eb-92b1-3fd1d652d9a5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 1fd9a412-d36a-4da6-80ce-a49cb771a0af] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:45.261999 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bde6e34-a338-41eb-92b1-3fd1d652d9a5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:45.262439 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bde6e34-a338-41eb-92b1-3fd1d652d9a5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:45.263187 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bde6e34-a338-41eb-92b1-3fd1d652d9a5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:45.263609 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0bde6e34-a338-41eb-92b1-3fd1d652d9a5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:45.277559 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-0bde6e34-a338-41eb-92b1-3fd1d652d9a5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] HTTP exception thrown: Instance 1fd9a412-d36a-4da6-80ce-a49cb771a0af could not be found. Apr 06 17:13:45.278145 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0bde6e34-a338-41eb-92b1-3fd1d652d9a5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Returning 404 to user: Instance 1fd9a412-d36a-4da6-80ce-a49cb771a0af could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:13:45.278960 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0bde6e34-a338-41eb-92b1-3fd1d652d9a5 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af" status: 404 len: 111 microversion: 2.1 time: 0.027969 Apr 06 17:13:45.279504 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1677/3350] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:13:45 2022] GET /compute/v2.1/servers/1fd9a412-d36a-4da6-80ce-a49cb771a0af => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:13:48.276093 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-906a177c-d348-46c1-997d-1e770e68c792 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:48.277104 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-906a177c-d348-46c1-997d-1e770e68c792 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:48.283745 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-906a177c-d348-46c1-997d-1e770e68c792 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:48.284188 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-906a177c-d348-46c1-997d-1e770e68c792 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:48.284997 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-906a177c-d348-46c1-997d-1e770e68c792 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:48.285428 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-906a177c-d348-46c1-997d-1e770e68c792 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:48.316256 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-906a177c-d348-46c1-997d-1e770e68c792 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044255 Apr 06 17:13:48.316870 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1674/3351] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 17:13:48 2022] GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:13:48.467886 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-cad7b08f-1587-4bd6-a43d-abdc1674f7b8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:48.468479 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-cad7b08f-1587-4bd6-a43d-abdc1674f7b8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:48.476361 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cad7b08f-1587-4bd6-a43d-abdc1674f7b8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:48.476856 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cad7b08f-1587-4bd6-a43d-abdc1674f7b8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:48.477639 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cad7b08f-1587-4bd6-a43d-abdc1674f7b8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:48.478072 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-cad7b08f-1587-4bd6-a43d-abdc1674f7b8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:48.508274 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-cad7b08f-1587-4bd6-a43d-abdc1674f7b8 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32/os-volume_attachments/45d61fb7-409f-4bad-85ab-d023ee1296ac" status: 200 len: 194 microversion: 2.1 time: 0.044487 Apr 06 17:13:48.508943 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1678/3352] 10.222.0.64 () {58 vars in 1412 bytes} [Wed Apr 6 17:13:48 2022] GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32/os-volume_attachments/45d61fb7-409f-4bad-85ab-d023ee1296ac => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:13:48.518648 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-94950d2a-ddb2-4dc4-97c7-725f238c40e7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:48.519143 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-94950d2a-ddb2-4dc4-97c7-725f238c40e7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:48.525236 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94950d2a-ddb2-4dc4-97c7-725f238c40e7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:48.525691 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94950d2a-ddb2-4dc4-97c7-725f238c40e7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:48.526467 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94950d2a-ddb2-4dc4-97c7-725f238c40e7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:48.526880 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94950d2a-ddb2-4dc4-97c7-725f238c40e7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:48.611276 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-94950d2a-ddb2-4dc4-97c7-725f238c40e7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lazy-loading 'services' on Instance uuid 6f22100d-961b-4402-83d5-a18988d88c32 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 06 17:13:48.686847 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-94950d2a-ddb2-4dc4-97c7-725f238c40e7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32/os-volume_attachments/45d61fb7-409f-4bad-85ab-d023ee1296ac" status: 202 len: 0 microversion: 2.1 time: 0.171941 Apr 06 17:13:48.687436 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1675/3353] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Apr 6 17:13:48 2022] DELETE /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32/os-volume_attachments/45d61fb7-409f-4bad-85ab-d023ee1296ac => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 06 17:13:50.864425 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d3a782a7-9d61-4a34-aa5d-7cf58570ec6d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:50.865113 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d3a782a7-9d61-4a34-aa5d-7cf58570ec6d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:50.872097 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3a782a7-9d61-4a34-aa5d-7cf58570ec6d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:50.872544 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3a782a7-9d61-4a34-aa5d-7cf58570ec6d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:50.873366 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3a782a7-9d61-4a34-aa5d-7cf58570ec6d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:50.873797 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d3a782a7-9d61-4a34-aa5d-7cf58570ec6d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:50.908053 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d3a782a7-9d61-4a34-aa5d-7cf58570ec6d tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32/os-volume_attachments/37f3191b-841c-48c9-be80-99772e76161c" status: 200 len: 194 microversion: 2.1 time: 0.047573 Apr 06 17:13:50.908946 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1679/3354] 10.222.0.64 () {58 vars in 1412 bytes} [Wed Apr 6 17:13:50 2022] GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32/os-volume_attachments/37f3191b-841c-48c9-be80-99772e76161c => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:13:50.919728 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-efcdbe70-a43b-4198-86ee-fd3e3b1cfdc4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:50.920335 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-efcdbe70-a43b-4198-86ee-fd3e3b1cfdc4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:50.927657 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efcdbe70-a43b-4198-86ee-fd3e3b1cfdc4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:50.928107 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efcdbe70-a43b-4198-86ee-fd3e3b1cfdc4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:50.928936 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efcdbe70-a43b-4198-86ee-fd3e3b1cfdc4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:50.929375 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efcdbe70-a43b-4198-86ee-fd3e3b1cfdc4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:51.022959 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-efcdbe70-a43b-4198-86ee-fd3e3b1cfdc4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lazy-loading 'services' on Instance uuid 6f22100d-961b-4402-83d5-a18988d88c32 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 06 17:13:51.095070 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-efcdbe70-a43b-4198-86ee-fd3e3b1cfdc4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32/os-volume_attachments/37f3191b-841c-48c9-be80-99772e76161c" status: 202 len: 0 microversion: 2.1 time: 0.179930 Apr 06 17:13:51.095683 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1676/3355] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Apr 6 17:13:50 2022] DELETE /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32/os-volume_attachments/37f3191b-841c-48c9-be80-99772e76161c => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 06 17:13:52.276895 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ec0a8273-e125-4326-881c-f81d96ae8348 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:52.277822 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ec0a8273-e125-4326-881c-f81d96ae8348 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:52.284488 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec0a8273-e125-4326-881c-f81d96ae8348 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:52.284954 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec0a8273-e125-4326-881c-f81d96ae8348 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:52.285714 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec0a8273-e125-4326-881c-f81d96ae8348 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:52.286120 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ec0a8273-e125-4326-881c-f81d96ae8348 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:52.316862 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ec0a8273-e125-4326-881c-f81d96ae8348 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043778 Apr 06 17:13:52.318260 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1680/3356] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 17:13:52 2022] GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 06 17:13:52.456180 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5fb1a25c-2e7e-44e7-a6e0-535a0e524fe7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:52.457603 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5fb1a25c-2e7e-44e7-a6e0-535a0e524fe7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:52.467218 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fb1a25c-2e7e-44e7-a6e0-535a0e524fe7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:52.467861 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fb1a25c-2e7e-44e7-a6e0-535a0e524fe7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:52.469164 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fb1a25c-2e7e-44e7-a6e0-535a0e524fe7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:52.469884 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fb1a25c-2e7e-44e7-a6e0-535a0e524fe7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:52.503524 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5fb1a25c-2e7e-44e7-a6e0-535a0e524fe7 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055458 Apr 06 17:13:52.504078 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1677/3357] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Apr 6 17:13:52 2022] GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 06 17:13:52.562856 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-443cdacd-16f5-4434-b663-baaa54711e90 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:52.563355 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-443cdacd-16f5-4434-b663-baaa54711e90 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:52.570111 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-443cdacd-16f5-4434-b663-baaa54711e90 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:52.570564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-443cdacd-16f5-4434-b663-baaa54711e90 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:52.571339 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-443cdacd-16f5-4434-b663-baaa54711e90 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:52.571767 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-443cdacd-16f5-4434-b663-baaa54711e90 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:52.598107 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-443cdacd-16f5-4434-b663-baaa54711e90 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 06 17:13:52.682781 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-443cdacd-16f5-4434-b663-baaa54711e90 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32" status: 204 len: 0 microversion: 2.1 time: 0.123293 Apr 06 17:13:52.683432 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1681/3358] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 17:13:52 2022] DELETE /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 06 17:13:52.694635 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bce1c7e7-f688-4804-b378-52e2c7ff471f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:52.695336 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bce1c7e7-f688-4804-b378-52e2c7ff471f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:52.700893 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bce1c7e7-f688-4804-b378-52e2c7ff471f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:52.701343 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bce1c7e7-f688-4804-b378-52e2c7ff471f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:52.702112 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bce1c7e7-f688-4804-b378-52e2c7ff471f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:52.702544 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bce1c7e7-f688-4804-b378-52e2c7ff471f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:52.840086 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-bce1c7e7-f688-4804-b378-52e2c7ff471f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:13:52.847973 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bce1c7e7-f688-4804-b378-52e2c7ff471f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32" status: 200 len: 1674 microversion: 2.1 time: 0.159951 Apr 06 17:13:52.848575 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1678/3359] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:13:52 2022] GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:13:53.865939 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5805e2e4-6f12-45cc-8798-23bf21c8b3a4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:53.867303 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5805e2e4-6f12-45cc-8798-23bf21c8b3a4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:53.874045 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5805e2e4-6f12-45cc-8798-23bf21c8b3a4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:53.874496 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5805e2e4-6f12-45cc-8798-23bf21c8b3a4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:53.875279 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5805e2e4-6f12-45cc-8798-23bf21c8b3a4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:53.875708 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5805e2e4-6f12-45cc-8798-23bf21c8b3a4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:54.031646 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5805e2e4-6f12-45cc-8798-23bf21c8b3a4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:13:54.040886 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5805e2e4-6f12-45cc-8798-23bf21c8b3a4 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32" status: 200 len: 1674 microversion: 2.1 time: 0.179374 Apr 06 17:13:54.041525 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1682/3360] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:13:53 2022] GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32 => generated 1674 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:13:54.886174 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-95ea7683-933d-4381-a9e7-1b79a2584577 req-6d394f1c-0464-437f-a017-eb188aaea260 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f22100d-961b-4402-83d5-a18988d88c32", "name": "network-vif-deleted", "tag": "2a9f60f2-6640-4b8f-bab1-379a2e3d163a"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:13:54.896559 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-95ea7683-933d-4381-a9e7-1b79a2584577 req-6d394f1c-0464-437f-a017-eb188aaea260 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:54.897388 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-95ea7683-933d-4381-a9e7-1b79a2584577 req-6d394f1c-0464-437f-a017-eb188aaea260 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:54.919562 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-95ea7683-933d-4381-a9e7-1b79a2584577 req-6d394f1c-0464-437f-a017-eb188aaea260 service nova] Creating event network-vif-deleted:2a9f60f2-6640-4b8f-bab1-379a2e3d163a for instance 6f22100d-961b-4402-83d5-a18988d88c32 on hv-cinder-83684 Apr 06 17:13:54.926011 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-95ea7683-933d-4381-a9e7-1b79a2584577 req-6d394f1c-0464-437f-a017-eb188aaea260 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043516 Apr 06 17:13:54.926922 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1679/3361] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:13:55.065742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8077c8da-f999-48b9-8ead-143ff55a65ab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:55.066520 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8077c8da-f999-48b9-8ead-143ff55a65ab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:55.073388 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8077c8da-f999-48b9-8ead-143ff55a65ab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:55.073839 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8077c8da-f999-48b9-8ead-143ff55a65ab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:55.074632 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8077c8da-f999-48b9-8ead-143ff55a65ab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:55.075071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8077c8da-f999-48b9-8ead-143ff55a65ab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:55.107722 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8077c8da-f999-48b9-8ead-143ff55a65ab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:55.108173 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8077c8da-f999-48b9-8ead-143ff55a65ab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:55.108624 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-8077c8da-f999-48b9-8ead-143ff55a65ab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lazy-loading 'fault' on Instance uuid 6f22100d-961b-4402-83d5-a18988d88c32 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 06 17:13:55.156511 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8077c8da-f999-48b9-8ead-143ff55a65ab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b497ce12aa400091fc7cbbc6a2d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025f673d99964de4820b8ba487f95cad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:13:55.164534 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8077c8da-f999-48b9-8ead-143ff55a65ab tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32" status: 200 len: 1327 microversion: 2.1 time: 0.103149 Apr 06 17:13:55.165144 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1683/3362] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:13:55 2022] GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32 => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:13:56.183809 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6bbc9889-d524-43c7-a7ec-5a05439add06 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:56.184417 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6bbc9889-d524-43c7-a7ec-5a05439add06 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:56.191148 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bbc9889-d524-43c7-a7ec-5a05439add06 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:56.191554 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bbc9889-d524-43c7-a7ec-5a05439add06 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:56.192480 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bbc9889-d524-43c7-a7ec-5a05439add06 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:56.193272 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bbc9889-d524-43c7-a7ec-5a05439add06 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:56.210575 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-6bbc9889-d524-43c7-a7ec-5a05439add06 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] HTTP exception thrown: Instance 6f22100d-961b-4402-83d5-a18988d88c32 could not be found. Apr 06 17:13:56.211478 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6bbc9889-d524-43c7-a7ec-5a05439add06 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Returning 404 to user: Instance 6f22100d-961b-4402-83d5-a18988d88c32 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:13:56.212833 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6bbc9889-d524-43c7-a7ec-5a05439add06 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32" status: 404 len: 111 microversion: 2.1 time: 0.033724 Apr 06 17:13:56.213698 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1680/3363] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:13:56 2022] GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:13:56.222922 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8e3d6b04-9517-4d89-a41d-511590546910 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '.version_select at 0x7fa9cf0a5ee0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:56.243165 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8e3d6b04-9517-4d89-a41d-511590546910 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1278443319" status: 202 len: 0 microversion: 2.1 time: 0.024439 Apr 06 17:13:56.243966 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1684/3364] 10.222.0.64 () {58 vars in 1220 bytes} [Wed Apr 6 17:13:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1278443319 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 06 17:13:59.188026 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-88a94c4b-417d-4824-a64e-07a09268c88e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:59.188558 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-88a94c4b-417d-4824-a64e-07a09268c88e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:59.195437 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88a94c4b-417d-4824-a64e-07a09268c88e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:59.195889 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88a94c4b-417d-4824-a64e-07a09268c88e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:59.196658 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88a94c4b-417d-4824-a64e-07a09268c88e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:59.197117 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88a94c4b-417d-4824-a64e-07a09268c88e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:59.210203 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-88a94c4b-417d-4824-a64e-07a09268c88e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] HTTP exception thrown: Instance 6f22100d-961b-4402-83d5-a18988d88c32 could not be found. Apr 06 17:13:59.210783 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-88a94c4b-417d-4824-a64e-07a09268c88e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Returning 404 to user: Instance 6f22100d-961b-4402-83d5-a18988d88c32 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:13:59.211613 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-88a94c4b-417d-4824-a64e-07a09268c88e tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32" status: 404 len: 111 microversion: 2.1 time: 0.027889 Apr 06 17:13:59.212166 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1681/3365] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 17:13:59 2022] DELETE /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:13:59.222736 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-975fa102-59bd-4b6b-b4b0-c4bf51179f03 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:13:59.223345 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-975fa102-59bd-4b6b-b4b0-c4bf51179f03 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: 6f22100d-961b-4402-83d5-a18988d88c32] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:13:59.230559 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-975fa102-59bd-4b6b-b4b0-c4bf51179f03 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:59.231009 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-975fa102-59bd-4b6b-b4b0-c4bf51179f03 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:59.231763 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-975fa102-59bd-4b6b-b4b0-c4bf51179f03 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:13:59.232201 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-975fa102-59bd-4b6b-b4b0-c4bf51179f03 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:13:59.247652 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-975fa102-59bd-4b6b-b4b0-c4bf51179f03 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] HTTP exception thrown: Instance 6f22100d-961b-4402-83d5-a18988d88c32 could not be found. Apr 06 17:13:59.248238 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-975fa102-59bd-4b6b-b4b0-c4bf51179f03 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Returning 404 to user: Instance 6f22100d-961b-4402-83d5-a18988d88c32 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:13:59.249116 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-975fa102-59bd-4b6b-b4b0-c4bf51179f03 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32" status: 404 len: 111 microversion: 2.1 time: 0.031268 Apr 06 17:13:59.249678 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1685/3366] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:13:59 2022] GET /compute/v2.1/servers/6f22100d-961b-4402-83d5-a18988d88c32 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:14:00.405381 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3cef1a55-7a0a-4ebb-8412-6ea37063b60f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:00.405936 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3cef1a55-7a0a-4ebb-8412-6ea37063b60f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:00.412875 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cef1a55-7a0a-4ebb-8412-6ea37063b60f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:00.413281 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cef1a55-7a0a-4ebb-8412-6ea37063b60f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:00.414058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cef1a55-7a0a-4ebb-8412-6ea37063b60f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:00.414494 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cef1a55-7a0a-4ebb-8412-6ea37063b60f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:00.430678 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-3cef1a55-7a0a-4ebb-8412-6ea37063b60f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] HTTP exception thrown: Instance bab853ba-a3d5-4828-baf6-1088f936bc96 could not be found. Apr 06 17:14:00.431261 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3cef1a55-7a0a-4ebb-8412-6ea37063b60f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Returning 404 to user: Instance bab853ba-a3d5-4828-baf6-1088f936bc96 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:14:00.432123 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3cef1a55-7a0a-4ebb-8412-6ea37063b60f tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "DELETE /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 404 len: 111 microversion: 2.1 time: 0.030625 Apr 06 17:14:00.432645 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1682/3367] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 17:14:00 2022] DELETE /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:14:00.443439 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a41d10c6-9c13-4cde-9e7d-6caf34d64021 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:00.444062 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a41d10c6-9c13-4cde-9e7d-6caf34d64021 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] [instance: bab853ba-a3d5-4828-baf6-1088f936bc96] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:00.453304 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a41d10c6-9c13-4cde-9e7d-6caf34d64021 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:00.453760 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a41d10c6-9c13-4cde-9e7d-6caf34d64021 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:00.454531 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a41d10c6-9c13-4cde-9e7d-6caf34d64021 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:00.455242 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a41d10c6-9c13-4cde-9e7d-6caf34d64021 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:00.469145 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-a41d10c6-9c13-4cde-9e7d-6caf34d64021 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] HTTP exception thrown: Instance bab853ba-a3d5-4828-baf6-1088f936bc96 could not be found. Apr 06 17:14:00.469728 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a41d10c6-9c13-4cde-9e7d-6caf34d64021 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] Returning 404 to user: Instance bab853ba-a3d5-4828-baf6-1088f936bc96 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:14:00.470558 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a41d10c6-9c13-4cde-9e7d-6caf34d64021 tempest-AttachVolumeTestJSON-1579852316 tempest-AttachVolumeTestJSON-1579852316-project] 10.222.0.64 "GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96" status: 404 len: 111 microversion: 2.1 time: 0.033353 Apr 06 17:14:00.471094 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1686/3368] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:00 2022] GET /compute/v2.1/servers/bab853ba-a3d5-4828-baf6-1088f936bc96 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:14:05.130988 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cdf31e0e-e618-4aec-b4fd-847fc8d4e977 tempest-VolumesNegativeTest-1203681929 tempest-VolumesNegativeTest-1203681929-project] Action: 'create', calling method: .version_select at 0x7fa9c9fd2ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-453275415", "metadata": {"Type": "work"}}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:14:05.132441 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cdf31e0e-e618-4aec-b4fd-847fc8d4e977 tempest-VolumesNegativeTest-1203681929 tempest-VolumesNegativeTest-1203681929-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:14:05.133278 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cdf31e0e-e618-4aec-b4fd-847fc8d4e977 tempest-VolumesNegativeTest-1203681929 tempest-VolumesNegativeTest-1203681929-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.117986 Apr 06 17:14:05.133803 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1683/3369] 10.222.0.64 () {60 vars in 1155 bytes} [Wed Apr 6 17:14:05 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 06 17:14:05.143121 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fd618463-57be-4d60-9b93-2c680af1bdee tempest-VolumesNegativeTest-1203681929 tempest-VolumesNegativeTest-1203681929-project] Action: 'create', calling method: .version_select at 0x7fa9cf157550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1359266118", "metadata": {"Type": "work"}}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:14:05.144547 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fd618463-57be-4d60-9b93-2c680af1bdee tempest-VolumesNegativeTest-1203681929 tempest-VolumesNegativeTest-1203681929-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:14:05.145365 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fd618463-57be-4d60-9b93-2c680af1bdee tempest-VolumesNegativeTest-1203681929 tempest-VolumesNegativeTest-1203681929-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006267 Apr 06 17:14:05.145874 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1687/3370] 10.222.0.64 () {60 vars in 1155 bytes} [Wed Apr 6 17:14:05 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 06 17:14:05.156083 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f218c8e8-fc6b-4c80-b1d7-61c6d42d51ef tempest-VolumesNegativeTest-1203681929 tempest-VolumesNegativeTest-1203681929-project] Action: 'create', calling method: .version_select at 0x7fa9c9ff8b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1696967461", "metadata": {"Type": "work"}}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:14:05.157518 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f218c8e8-fc6b-4c80-b1d7-61c6d42d51ef tempest-VolumesNegativeTest-1203681929 tempest-VolumesNegativeTest-1203681929-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:14:05.158917 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f218c8e8-fc6b-4c80-b1d7-61c6d42d51ef tempest-VolumesNegativeTest-1203681929 tempest-VolumesNegativeTest-1203681929-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007946 Apr 06 17:14:05.159707 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1684/3371] 10.222.0.64 () {60 vars in 1155 bytes} [Wed Apr 6 17:14:05 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 06 17:14:05.172499 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6ae85873-9f37-4514-8ffa-97e3569893e5 tempest-VolumesNegativeTest-1203681929 tempest-VolumesNegativeTest-1203681929-project] Calling method '.version_select at 0x7fa9ca3d1dc0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:05.205887 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-6ae85873-9f37-4514-8ffa-97e3569893e5 tempest-VolumesNegativeTest-1203681929 tempest-VolumesNegativeTest-1203681929-project] HTTP exception thrown: Volume tempest-invalid-1106897937 could not be found. Apr 06 17:14:05.206735 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6ae85873-9f37-4514-8ffa-97e3569893e5 tempest-VolumesNegativeTest-1203681929 tempest-VolumesNegativeTest-1203681929-project] Returning 404 to user: Volume tempest-invalid-1106897937 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:14:05.207877 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6ae85873-9f37-4514-8ffa-97e3569893e5 tempest-VolumesNegativeTest-1203681929 tempest-VolumesNegativeTest-1203681929-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1106897937" status: 404 len: 99 microversion: 2.1 time: 0.041678 Apr 06 17:14:05.208602 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1688/3372] 10.222.0.64 () {58 vars in 1217 bytes} [Wed Apr 6 17:14:05 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1106897937 => generated 99 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 06 17:14:05.219448 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-665e57bf-cd0c-466a-bd80-7f2343e5f34f tempest-VolumesNegativeTest-1203681929 tempest-VolumesNegativeTest-1203681929-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004853 Apr 06 17:14:05.219952 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1685/3373] 10.222.0.64 () {58 vars in 1139 bytes} [Wed Apr 6 17:14:05 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 06 17:14:05.229119 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ae5e87f8-9c76-4804-98eb-f3812f86708b tempest-VolumesNegativeTest-1203681929 tempest-VolumesNegativeTest-1203681929-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003707 Apr 06 17:14:05.229613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1689/3374] 10.222.0.64 () {58 vars in 1136 bytes} [Wed Apr 6 17:14:05 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 06 17:14:05.237823 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-08a79f42-0d09-4316-8a5d-082aa6ec593e tempest-VolumesNegativeTest-1203681929 tempest-VolumesNegativeTest-1203681929-project] Calling method '.version_select at 0x7fa9ca22b790>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:05.265819 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-08a79f42-0d09-4316-8a5d-082aa6ec593e tempest-VolumesNegativeTest-1203681929 tempest-VolumesNegativeTest-1203681929-project] HTTP exception thrown: Volume fbd56088-8eea-432e-846a-2cfa0eb31034 could not be found. Apr 06 17:14:05.266414 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-08a79f42-0d09-4316-8a5d-082aa6ec593e tempest-VolumesNegativeTest-1203681929 tempest-VolumesNegativeTest-1203681929-project] Returning 404 to user: Volume fbd56088-8eea-432e-846a-2cfa0eb31034 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:14:05.267281 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-08a79f42-0d09-4316-8a5d-082aa6ec593e tempest-VolumesNegativeTest-1203681929 tempest-VolumesNegativeTest-1203681929-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/fbd56088-8eea-432e-846a-2cfa0eb31034" status: 404 len: 109 microversion: 2.1 time: 0.033027 Apr 06 17:14:05.267822 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1686/3375] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Apr 6 17:14:05 2022] DELETE /compute/v2.1/os-volumes/fbd56088-8eea-432e-846a-2cfa0eb31034 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:14:05.277019 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ef1e7322-d3ab-4959-b702-edbc15d73ec7 tempest-VolumesNegativeTest-1203681929 tempest-VolumesNegativeTest-1203681929-project] Calling method '.version_select at 0x7fa9cf1570d0>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:05.305238 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-ef1e7322-d3ab-4959-b702-edbc15d73ec7 tempest-VolumesNegativeTest-1203681929 tempest-VolumesNegativeTest-1203681929-project] HTTP exception thrown: Volume eb0b81cc-e824-4c7c-a68f-795a74c1ca62 could not be found. Apr 06 17:14:05.305837 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ef1e7322-d3ab-4959-b702-edbc15d73ec7 tempest-VolumesNegativeTest-1203681929 tempest-VolumesNegativeTest-1203681929-project] Returning 404 to user: Volume eb0b81cc-e824-4c7c-a68f-795a74c1ca62 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:14:05.306666 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ef1e7322-d3ab-4959-b702-edbc15d73ec7 tempest-VolumesNegativeTest-1203681929 tempest-VolumesNegativeTest-1203681929-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/eb0b81cc-e824-4c7c-a68f-795a74c1ca62" status: 404 len: 109 microversion: 2.1 time: 0.033566 Apr 06 17:14:05.307214 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1690/3376] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Apr 6 17:14:05 2022] GET /compute/v2.1/os-volumes/eb0b81cc-e824-4c7c-a68f-795a74c1ca62 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:14:22.485123 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e79b6d2a-bb55-4d39-9a83-c5dd87fe984c tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-21634366", "imageRef": "c217dd2b-7679-4860-b2e6-01a967f654df", "flavorRef": "452", "networks": [{"uuid": "36d01b7a-ec0a-4d76-974e-295015e33416"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:14:22.541990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-e79b6d2a-bb55-4d39-9a83-c5dd87fe984c tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] validate_networks() for [('36d01b7a-ec0a-4d76-974e-295015e33416', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 06 17:14:22.964926 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e79b6d2a-bb55-4d39-9a83-c5dd87fe984c tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 06 17:14:22.965345 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e79b6d2a-bb55-4d39-9a83-c5dd87fe984c tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 06 17:14:22.965817 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e79b6d2a-bb55-4d39-9a83-c5dd87fe984c tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 06 17:14:22.966220 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e79b6d2a-bb55-4d39-9a83-c5dd87fe984c tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 06 17:14:22.966625 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e79b6d2a-bb55-4d39-9a83-c5dd87fe984c tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 06 17:14:22.976598 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e79b6d2a-bb55-4d39-9a83-c5dd87fe984c tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:22.977078 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e79b6d2a-bb55-4d39-9a83-c5dd87fe984c tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:22.978356 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e79b6d2a-bb55-4d39-9a83-c5dd87fe984c tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:22.978828 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e79b6d2a-bb55-4d39-9a83-c5dd87fe984c tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:22.996185 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-e79b6d2a-bb55-4d39-9a83-c5dd87fe984c tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Getting quotas for project 21157336f11141f39a1cf7fca6915365. Resources: {'instances', 'cores', 'ram'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 17:14:23.000589 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-e79b6d2a-bb55-4d39-9a83-c5dd87fe984c tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Getting quotas for user e1e2fe5e526a40da8859b0cf1716ad6b and project 21157336f11141f39a1cf7fca6915365. Resources: {'instances', 'cores', 'ram'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 17:14:23.014944 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e79b6d2a-bb55-4d39-9a83-c5dd87fe984c tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 06 17:14:23.017277 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e79b6d2a-bb55-4d39-9a83-c5dd87fe984c tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: 737ee8d5-1287-4f84-97f9-c180267c36e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c217dd2b-7679-4860-b2e6-01a967f654df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 06 17:14:23.069312 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e79b6d2a-bb55-4d39-9a83-c5dd87fe984c tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588590 Apr 06 17:14:23.069949 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1687/3377] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Apr 6 17:14:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 06 17:14:23.081283 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-60acd1fe-472f-4c69-b5e4-9528892c2708 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:23.081933 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-60acd1fe-472f-4c69-b5e4-9528892c2708 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: 737ee8d5-1287-4f84-97f9-c180267c36e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:23.135851 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-60acd1fe-472f-4c69-b5e4-9528892c2708 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e2fe5e526a40da8859b0cf1716ad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21157336f11141f39a1cf7fca6915365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:14:23.142733 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-60acd1fe-472f-4c69-b5e4-9528892c2708 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "GET /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8" status: 200 len: 1212 microversion: 2.1 time: 0.066479 Apr 06 17:14:23.143520 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1691/3378] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:23 2022] GET /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8 => generated 1212 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:14:24.160161 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-52a0b604-a839-4358-aa78-9a9542936f40 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:24.160802 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-52a0b604-a839-4358-aa78-9a9542936f40 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: 737ee8d5-1287-4f84-97f9-c180267c36e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:24.169343 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52a0b604-a839-4358-aa78-9a9542936f40 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:24.169791 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52a0b604-a839-4358-aa78-9a9542936f40 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:24.170561 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52a0b604-a839-4358-aa78-9a9542936f40 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:24.170989 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52a0b604-a839-4358-aa78-9a9542936f40 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:24.275625 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-52a0b604-a839-4358-aa78-9a9542936f40 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e2fe5e526a40da8859b0cf1716ad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21157336f11141f39a1cf7fca6915365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:14:24.283729 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-52a0b604-a839-4358-aa78-9a9542936f40 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "GET /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8" status: 200 len: 1272 microversion: 2.1 time: 0.127980 Apr 06 17:14:24.284302 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1688/3379] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:24 2022] GET /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8 => generated 1272 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:14:25.301896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-75ea0dbc-442d-4eca-9d67-391c090c6411 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:25.302507 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-75ea0dbc-442d-4eca-9d67-391c090c6411 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: 737ee8d5-1287-4f84-97f9-c180267c36e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:25.309292 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75ea0dbc-442d-4eca-9d67-391c090c6411 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:25.309730 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75ea0dbc-442d-4eca-9d67-391c090c6411 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:25.310499 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75ea0dbc-442d-4eca-9d67-391c090c6411 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:25.311266 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-75ea0dbc-442d-4eca-9d67-391c090c6411 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:25.454989 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-75ea0dbc-442d-4eca-9d67-391c090c6411 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e2fe5e526a40da8859b0cf1716ad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21157336f11141f39a1cf7fca6915365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:14:25.463001 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-75ea0dbc-442d-4eca-9d67-391c090c6411 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "GET /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8" status: 200 len: 1312 microversion: 2.1 time: 0.164988 Apr 06 17:14:25.463612 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1692/3380] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:25 2022] GET /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8 => generated 1312 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:14:25.639213 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-2f2cace2-2cda-4132-886b-c369c0b279e5 req-077193a5-deb4-44e5-8b6a-707db149f4de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "737ee8d5-1287-4f84-97f9-c180267c36e8", "tag": "a24a05c5-d569-4aa3-83f2-49299d36d8bb"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:14:25.649127 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2f2cace2-2cda-4132-886b-c369c0b279e5 req-077193a5-deb4-44e5-8b6a-707db149f4de service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:25.649663 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2f2cace2-2cda-4132-886b-c369c0b279e5 req-077193a5-deb4-44e5-8b6a-707db149f4de service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:25.661673 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-2f2cace2-2cda-4132-886b-c369c0b279e5 req-077193a5-deb4-44e5-8b6a-707db149f4de service nova] Creating event network-changed:a24a05c5-d569-4aa3-83f2-49299d36d8bb for instance 737ee8d5-1287-4f84-97f9-c180267c36e8 on hv-cinder-83684 Apr 06 17:14:25.666761 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-2f2cace2-2cda-4132-886b-c369c0b279e5 req-077193a5-deb4-44e5-8b6a-707db149f4de service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032490 Apr 06 17:14:25.667704 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1689/3381] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:14:26.482807 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-42367285-4baf-4aa2-abfd-b1a9101f16f1 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:26.483458 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-42367285-4baf-4aa2-abfd-b1a9101f16f1 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: 737ee8d5-1287-4f84-97f9-c180267c36e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:26.490924 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42367285-4baf-4aa2-abfd-b1a9101f16f1 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:26.491404 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42367285-4baf-4aa2-abfd-b1a9101f16f1 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:26.492210 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42367285-4baf-4aa2-abfd-b1a9101f16f1 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:26.492669 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-42367285-4baf-4aa2-abfd-b1a9101f16f1 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:26.634445 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-42367285-4baf-4aa2-abfd-b1a9101f16f1 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e2fe5e526a40da8859b0cf1716ad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21157336f11141f39a1cf7fca6915365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:14:26.642759 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-42367285-4baf-4aa2-abfd-b1a9101f16f1 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "GET /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8" status: 200 len: 1312 microversion: 2.1 time: 0.164062 Apr 06 17:14:26.643336 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1693/3382] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:26 2022] GET /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8 => generated 1312 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:14:27.665262 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a43feb42-2a4a-40e4-a251-fc5d348c54c8 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:27.666353 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a43feb42-2a4a-40e4-a251-fc5d348c54c8 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: 737ee8d5-1287-4f84-97f9-c180267c36e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:27.677259 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a43feb42-2a4a-40e4-a251-fc5d348c54c8 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:27.678017 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a43feb42-2a4a-40e4-a251-fc5d348c54c8 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:27.679294 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a43feb42-2a4a-40e4-a251-fc5d348c54c8 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:27.680021 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a43feb42-2a4a-40e4-a251-fc5d348c54c8 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:27.821904 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a43feb42-2a4a-40e4-a251-fc5d348c54c8 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e2fe5e526a40da8859b0cf1716ad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21157336f11141f39a1cf7fca6915365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:14:27.831350 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a43feb42-2a4a-40e4-a251-fc5d348c54c8 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "GET /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8" status: 200 len: 1312 microversion: 2.1 time: 0.173535 Apr 06 17:14:27.832138 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1690/3383] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:27 2022] GET /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8 => generated 1312 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:14:28.850568 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-937b903c-56f8-4572-aee1-1ae5b8bdca8a tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:28.851243 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-937b903c-56f8-4572-aee1-1ae5b8bdca8a tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: 737ee8d5-1287-4f84-97f9-c180267c36e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:28.858368 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-937b903c-56f8-4572-aee1-1ae5b8bdca8a tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:28.858817 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-937b903c-56f8-4572-aee1-1ae5b8bdca8a tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:28.859591 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-937b903c-56f8-4572-aee1-1ae5b8bdca8a tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:28.860023 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-937b903c-56f8-4572-aee1-1ae5b8bdca8a tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:29.003106 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-937b903c-56f8-4572-aee1-1ae5b8bdca8a tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e2fe5e526a40da8859b0cf1716ad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21157336f11141f39a1cf7fca6915365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:14:29.011615 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-937b903c-56f8-4572-aee1-1ae5b8bdca8a tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "GET /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8" status: 200 len: 1312 microversion: 2.1 time: 0.165390 Apr 06 17:14:29.012185 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1694/3384] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:28 2022] GET /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8 => generated 1312 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:14:30.029355 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4948fc4d-8eb8-43b7-beb4-ab46539d312b tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:30.029918 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4948fc4d-8eb8-43b7-beb4-ab46539d312b tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: 737ee8d5-1287-4f84-97f9-c180267c36e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:30.036713 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4948fc4d-8eb8-43b7-beb4-ab46539d312b tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:30.037170 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4948fc4d-8eb8-43b7-beb4-ab46539d312b tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:30.037928 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4948fc4d-8eb8-43b7-beb4-ab46539d312b tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:30.038355 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4948fc4d-8eb8-43b7-beb4-ab46539d312b tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:30.177986 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4948fc4d-8eb8-43b7-beb4-ab46539d312b tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e2fe5e526a40da8859b0cf1716ad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21157336f11141f39a1cf7fca6915365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:14:30.185825 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4948fc4d-8eb8-43b7-beb4-ab46539d312b tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "GET /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8" status: 200 len: 1312 microversion: 2.1 time: 0.160624 Apr 06 17:14:30.195736 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1691/3385] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:30 2022] GET /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8 => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:14:30.425775 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-19659b58-dc10-4400-a873-0b63ab55a939 req-9b10ab06-db2f-454e-bfe7-5a8db6579c76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "737ee8d5-1287-4f84-97f9-c180267c36e8", "name": "network-vif-plugged", "status": "completed", "tag": "a24a05c5-d569-4aa3-83f2-49299d36d8bb"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:14:30.433863 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-19659b58-dc10-4400-a873-0b63ab55a939 req-9b10ab06-db2f-454e-bfe7-5a8db6579c76 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:30.434299 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-19659b58-dc10-4400-a873-0b63ab55a939 req-9b10ab06-db2f-454e-bfe7-5a8db6579c76 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:30.445373 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-19659b58-dc10-4400-a873-0b63ab55a939 req-9b10ab06-db2f-454e-bfe7-5a8db6579c76 service nova] Creating event network-vif-plugged:a24a05c5-d569-4aa3-83f2-49299d36d8bb for instance 737ee8d5-1287-4f84-97f9-c180267c36e8 on hv-cinder-83684 Apr 06 17:14:30.451398 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-19659b58-dc10-4400-a873-0b63ab55a939 req-9b10ab06-db2f-454e-bfe7-5a8db6579c76 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149619 Apr 06 17:14:30.452373 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1695/3386] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:14:31.207345 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-341b4651-e46c-4612-84b7-f95c4faf0b24 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:31.208034 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-341b4651-e46c-4612-84b7-f95c4faf0b24 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: 737ee8d5-1287-4f84-97f9-c180267c36e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:31.218640 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-341b4651-e46c-4612-84b7-f95c4faf0b24 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:31.219342 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-341b4651-e46c-4612-84b7-f95c4faf0b24 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:31.220575 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-341b4651-e46c-4612-84b7-f95c4faf0b24 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:31.221705 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-341b4651-e46c-4612-84b7-f95c4faf0b24 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:31.375644 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-341b4651-e46c-4612-84b7-f95c4faf0b24 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e2fe5e526a40da8859b0cf1716ad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21157336f11141f39a1cf7fca6915365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:14:31.387945 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-341b4651-e46c-4612-84b7-f95c4faf0b24 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "GET /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8" status: 200 len: 1312 microversion: 2.1 time: 0.186960 Apr 06 17:14:31.388882 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1692/3387] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:31 2022] GET /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8 => generated 1312 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:14:32.418228 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0406f526-6981-489c-9552-fbd46929ba43 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:32.418956 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0406f526-6981-489c-9552-fbd46929ba43 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: 737ee8d5-1287-4f84-97f9-c180267c36e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:32.428997 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0406f526-6981-489c-9552-fbd46929ba43 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:32.429621 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0406f526-6981-489c-9552-fbd46929ba43 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:32.430788 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0406f526-6981-489c-9552-fbd46929ba43 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:32.431357 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0406f526-6981-489c-9552-fbd46929ba43 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:32.580184 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0406f526-6981-489c-9552-fbd46929ba43 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e2fe5e526a40da8859b0cf1716ad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21157336f11141f39a1cf7fca6915365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:14:32.592358 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0406f526-6981-489c-9552-fbd46929ba43 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "GET /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8" status: 200 len: 1496 microversion: 2.1 time: 0.184734 Apr 06 17:14:32.592924 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1696/3388] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:32 2022] GET /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8 => generated 1496 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:14:33.082473 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4831e868-8f8e-4ecd-93d2-f7b48d7a67e8 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:33.083021 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4831e868-8f8e-4ecd-93d2-f7b48d7a67e8 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: 737ee8d5-1287-4f84-97f9-c180267c36e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:33.092089 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4831e868-8f8e-4ecd-93d2-f7b48d7a67e8 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:33.092740 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4831e868-8f8e-4ecd-93d2-f7b48d7a67e8 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:33.093854 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4831e868-8f8e-4ecd-93d2-f7b48d7a67e8 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:33.094372 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4831e868-8f8e-4ecd-93d2-f7b48d7a67e8 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:33.123844 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4831e868-8f8e-4ecd-93d2-f7b48d7a67e8 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: 737ee8d5-1287-4f84-97f9-c180267c36e8] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 06 17:14:33.206948 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4831e868-8f8e-4ecd-93d2-f7b48d7a67e8 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "DELETE /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8" status: 204 len: 0 microversion: 2.1 time: 0.130513 Apr 06 17:14:33.207588 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1693/3389] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 17:14:33 2022] DELETE /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 06 17:14:33.215881 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-063a4a02-dd0a-4272-a3d2-d34da1adc319 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:33.216579 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-063a4a02-dd0a-4272-a3d2-d34da1adc319 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: 737ee8d5-1287-4f84-97f9-c180267c36e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:33.223131 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-063a4a02-dd0a-4272-a3d2-d34da1adc319 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:33.223565 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-063a4a02-dd0a-4272-a3d2-d34da1adc319 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:33.224318 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-063a4a02-dd0a-4272-a3d2-d34da1adc319 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:33.224732 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-063a4a02-dd0a-4272-a3d2-d34da1adc319 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:33.378248 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-063a4a02-dd0a-4272-a3d2-d34da1adc319 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e2fe5e526a40da8859b0cf1716ad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21157336f11141f39a1cf7fca6915365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:14:33.393219 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-063a4a02-dd0a-4272-a3d2-d34da1adc319 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "GET /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8" status: 200 len: 1502 microversion: 2.1 time: 0.181248 Apr 06 17:14:33.393774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1697/3390] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:33 2022] GET /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8 => generated 1502 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:14:34.419608 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-56eee534-4d4b-48f7-8afe-b8907c4a79a0 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:34.420310 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-56eee534-4d4b-48f7-8afe-b8907c4a79a0 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: 737ee8d5-1287-4f84-97f9-c180267c36e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:34.427667 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56eee534-4d4b-48f7-8afe-b8907c4a79a0 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:34.428118 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56eee534-4d4b-48f7-8afe-b8907c4a79a0 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:34.428933 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56eee534-4d4b-48f7-8afe-b8907c4a79a0 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:34.429359 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56eee534-4d4b-48f7-8afe-b8907c4a79a0 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:34.572749 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-56eee534-4d4b-48f7-8afe-b8907c4a79a0 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e2fe5e526a40da8859b0cf1716ad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21157336f11141f39a1cf7fca6915365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:14:34.581978 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-56eee534-4d4b-48f7-8afe-b8907c4a79a0 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "GET /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8" status: 200 len: 1502 microversion: 2.1 time: 0.166949 Apr 06 17:14:34.582488 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1694/3391] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:34 2022] GET /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8 => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:14:35.158248 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-1571eebc-10ca-4b16-8011-30d4b1aa359e req-4745bb5a-50ce-427e-b3be-52dbf975888f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "737ee8d5-1287-4f84-97f9-c180267c36e8", "name": "network-vif-deleted", "tag": "a24a05c5-d569-4aa3-83f2-49299d36d8bb"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:14:35.167196 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1571eebc-10ca-4b16-8011-30d4b1aa359e req-4745bb5a-50ce-427e-b3be-52dbf975888f service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:35.167547 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1571eebc-10ca-4b16-8011-30d4b1aa359e req-4745bb5a-50ce-427e-b3be-52dbf975888f service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:35.179759 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-1571eebc-10ca-4b16-8011-30d4b1aa359e req-4745bb5a-50ce-427e-b3be-52dbf975888f service nova] Creating event network-vif-deleted:a24a05c5-d569-4aa3-83f2-49299d36d8bb for instance 737ee8d5-1287-4f84-97f9-c180267c36e8 on hv-cinder-83684 Apr 06 17:14:35.189212 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-1571eebc-10ca-4b16-8011-30d4b1aa359e req-4745bb5a-50ce-427e-b3be-52dbf975888f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035003 Apr 06 17:14:35.189786 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1698/3392] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:14:35.602846 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f9641dd9-27d1-4dd1-a390-ce7239968272 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:35.603745 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f9641dd9-27d1-4dd1-a390-ce7239968272 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: 737ee8d5-1287-4f84-97f9-c180267c36e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:35.611810 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9641dd9-27d1-4dd1-a390-ce7239968272 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:35.612278 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9641dd9-27d1-4dd1-a390-ce7239968272 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:35.613146 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9641dd9-27d1-4dd1-a390-ce7239968272 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:35.613605 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9641dd9-27d1-4dd1-a390-ce7239968272 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:35.645414 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9641dd9-27d1-4dd1-a390-ce7239968272 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:35.645863 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9641dd9-27d1-4dd1-a390-ce7239968272 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:35.646309 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-f9641dd9-27d1-4dd1-a390-ce7239968272 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lazy-loading 'fault' on Instance uuid 737ee8d5-1287-4f84-97f9-c180267c36e8 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 06 17:14:35.690322 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f9641dd9-27d1-4dd1-a390-ce7239968272 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e2fe5e526a40da8859b0cf1716ad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21157336f11141f39a1cf7fca6915365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:14:35.699020 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f9641dd9-27d1-4dd1-a390-ce7239968272 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "GET /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8" status: 200 len: 1302 microversion: 2.1 time: 0.101983 Apr 06 17:14:35.699717 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1695/3393] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:35 2022] GET /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8 => generated 1302 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:14:36.717956 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-220d77fb-850a-4836-a501-cefc7e3165fe tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:36.718612 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-220d77fb-850a-4836-a501-cefc7e3165fe tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: 737ee8d5-1287-4f84-97f9-c180267c36e8] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:36.725771 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-220d77fb-850a-4836-a501-cefc7e3165fe tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:36.726219 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-220d77fb-850a-4836-a501-cefc7e3165fe tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:36.726967 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-220d77fb-850a-4836-a501-cefc7e3165fe tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:36.727395 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-220d77fb-850a-4836-a501-cefc7e3165fe tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:36.745519 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-220d77fb-850a-4836-a501-cefc7e3165fe tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] HTTP exception thrown: Instance 737ee8d5-1287-4f84-97f9-c180267c36e8 could not be found. Apr 06 17:14:36.746350 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-220d77fb-850a-4836-a501-cefc7e3165fe tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Returning 404 to user: Instance 737ee8d5-1287-4f84-97f9-c180267c36e8 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:14:36.747216 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-220d77fb-850a-4836-a501-cefc7e3165fe tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "GET /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8" status: 404 len: 111 microversion: 2.1 time: 0.034345 Apr 06 17:14:36.747886 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1699/3394] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:36 2022] GET /compute/v2.1/servers/737ee8d5-1287-4f84-97f9-c180267c36e8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:14:36.800161 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-59591129-258a-4305-8a17-733f42660781 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-420081476", "imageRef": "c217dd2b-7679-4860-b2e6-01a967f654df", "flavorRef": "452", "networks": [{"uuid": "36d01b7a-ec0a-4d76-974e-295015e33416"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:14:36.862478 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-59591129-258a-4305-8a17-733f42660781 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] validate_networks() for [('36d01b7a-ec0a-4d76-974e-295015e33416', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 06 17:14:37.226955 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-59591129-258a-4305-8a17-733f42660781 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 06 17:14:37.227377 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-59591129-258a-4305-8a17-733f42660781 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 06 17:14:37.227842 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-59591129-258a-4305-8a17-733f42660781 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 06 17:14:37.228273 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-59591129-258a-4305-8a17-733f42660781 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 06 17:14:37.228701 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-59591129-258a-4305-8a17-733f42660781 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 06 17:14:37.239489 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59591129-258a-4305-8a17-733f42660781 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:37.239855 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59591129-258a-4305-8a17-733f42660781 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:37.240642 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59591129-258a-4305-8a17-733f42660781 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:37.241095 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59591129-258a-4305-8a17-733f42660781 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:37.258240 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-59591129-258a-4305-8a17-733f42660781 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Getting quotas for project 21157336f11141f39a1cf7fca6915365. Resources: {'instances', 'cores', 'ram'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 17:14:37.262257 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-59591129-258a-4305-8a17-733f42660781 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Getting quotas for user e1e2fe5e526a40da8859b0cf1716ad6b and project 21157336f11141f39a1cf7fca6915365. Resources: {'instances', 'cores', 'ram'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 17:14:37.274136 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-59591129-258a-4305-8a17-733f42660781 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 06 17:14:37.276429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-59591129-258a-4305-8a17-733f42660781 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: f593d39b-3d08-4326-96c7-148c1f7ab95e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c217dd2b-7679-4860-b2e6-01a967f654df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 06 17:14:37.326860 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-59591129-258a-4305-8a17-733f42660781 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532671 Apr 06 17:14:37.327513 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1696/3395] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Apr 6 17:14:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 06 17:14:37.337777 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-731c6228-a4d4-4eb4-b921-f60c2c433bc1 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:37.338374 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-731c6228-a4d4-4eb4-b921-f60c2c433bc1 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: f593d39b-3d08-4326-96c7-148c1f7ab95e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:37.394273 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-731c6228-a4d4-4eb4-b921-f60c2c433bc1 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e2fe5e526a40da8859b0cf1716ad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21157336f11141f39a1cf7fca6915365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:14:37.402686 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-731c6228-a4d4-4eb4-b921-f60c2c433bc1 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "GET /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e" status: 200 len: 1213 microversion: 2.1 time: 0.068498 Apr 06 17:14:37.404197 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1700/3396] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:37 2022] GET /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:14:38.422168 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0b626f43-1c69-46be-99ab-cfa08a0c6da7 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:38.423252 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0b626f43-1c69-46be-99ab-cfa08a0c6da7 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: f593d39b-3d08-4326-96c7-148c1f7ab95e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:38.430074 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b626f43-1c69-46be-99ab-cfa08a0c6da7 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:38.431115 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b626f43-1c69-46be-99ab-cfa08a0c6da7 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:38.431489 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b626f43-1c69-46be-99ab-cfa08a0c6da7 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:38.431996 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b626f43-1c69-46be-99ab-cfa08a0c6da7 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:38.497484 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0b626f43-1c69-46be-99ab-cfa08a0c6da7 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e2fe5e526a40da8859b0cf1716ad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21157336f11141f39a1cf7fca6915365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:14:38.508433 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0b626f43-1c69-46be-99ab-cfa08a0c6da7 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "GET /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e" status: 200 len: 1283 microversion: 2.1 time: 0.091735 Apr 06 17:14:38.509449 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1697/3397] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:38 2022] GET /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e => generated 1283 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:14:39.530461 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3882890d-da20-4838-ac54-c12cf9c433aa tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:39.531110 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3882890d-da20-4838-ac54-c12cf9c433aa tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: f593d39b-3d08-4326-96c7-148c1f7ab95e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:39.539907 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3882890d-da20-4838-ac54-c12cf9c433aa tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:39.540647 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3882890d-da20-4838-ac54-c12cf9c433aa tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:39.541472 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3882890d-da20-4838-ac54-c12cf9c433aa tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:39.541906 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3882890d-da20-4838-ac54-c12cf9c433aa tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:39.691661 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3882890d-da20-4838-ac54-c12cf9c433aa tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e2fe5e526a40da8859b0cf1716ad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21157336f11141f39a1cf7fca6915365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:14:39.700211 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3882890d-da20-4838-ac54-c12cf9c433aa tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "GET /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e" status: 200 len: 1313 microversion: 2.1 time: 0.174545 Apr 06 17:14:39.701327 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1701/3398] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:39 2022] GET /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:14:39.703235 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-c5747937-1b67-460e-b01a-cf571296784d req-b9958f81-d7f2-4733-8d1a-2264d6181bea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f593d39b-3d08-4326-96c7-148c1f7ab95e", "tag": "79d4308c-043c-41c8-ae96-36eab7d8b7cc"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:14:39.712530 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c5747937-1b67-460e-b01a-cf571296784d req-b9958f81-d7f2-4733-8d1a-2264d6181bea service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:39.713420 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c5747937-1b67-460e-b01a-cf571296784d req-b9958f81-d7f2-4733-8d1a-2264d6181bea service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:39.726279 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-c5747937-1b67-460e-b01a-cf571296784d req-b9958f81-d7f2-4733-8d1a-2264d6181bea service nova] Creating event network-changed:79d4308c-043c-41c8-ae96-36eab7d8b7cc for instance f593d39b-3d08-4326-96c7-148c1f7ab95e on hv-cinder-83684 Apr 06 17:14:39.732357 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-c5747937-1b67-460e-b01a-cf571296784d req-b9958f81-d7f2-4733-8d1a-2264d6181bea service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034007 Apr 06 17:14:39.733535 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1698/3399] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 17:14:40.722294 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9ce96b38-5b0a-469e-9471-27ec86a43a45 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:40.723054 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9ce96b38-5b0a-469e-9471-27ec86a43a45 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: f593d39b-3d08-4326-96c7-148c1f7ab95e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:40.730950 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ce96b38-5b0a-469e-9471-27ec86a43a45 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:40.731684 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ce96b38-5b0a-469e-9471-27ec86a43a45 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:40.732459 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ce96b38-5b0a-469e-9471-27ec86a43a45 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:40.732937 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9ce96b38-5b0a-469e-9471-27ec86a43a45 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:40.898992 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9ce96b38-5b0a-469e-9471-27ec86a43a45 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e2fe5e526a40da8859b0cf1716ad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21157336f11141f39a1cf7fca6915365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:14:40.907098 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9ce96b38-5b0a-469e-9471-27ec86a43a45 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "GET /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e" status: 200 len: 1313 microversion: 2.1 time: 0.191627 Apr 06 17:14:40.907853 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1702/3400] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:40 2022] GET /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:14:41.928364 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e0886bc5-5ad5-42d8-b7bb-78bba501f7ca tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:41.928995 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e0886bc5-5ad5-42d8-b7bb-78bba501f7ca tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: f593d39b-3d08-4326-96c7-148c1f7ab95e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:41.936884 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0886bc5-5ad5-42d8-b7bb-78bba501f7ca tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:41.937341 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0886bc5-5ad5-42d8-b7bb-78bba501f7ca tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:41.938129 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0886bc5-5ad5-42d8-b7bb-78bba501f7ca tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:41.938565 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0886bc5-5ad5-42d8-b7bb-78bba501f7ca tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:42.079483 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e0886bc5-5ad5-42d8-b7bb-78bba501f7ca tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e2fe5e526a40da8859b0cf1716ad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21157336f11141f39a1cf7fca6915365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:14:42.091532 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e0886bc5-5ad5-42d8-b7bb-78bba501f7ca tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "GET /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e" status: 200 len: 1313 microversion: 2.1 time: 0.169419 Apr 06 17:14:42.092239 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1699/3401] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:41 2022] GET /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:14:43.117953 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ee1f13c3-c967-4d81-ab50-1bbffe63ccbc tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:43.118925 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ee1f13c3-c967-4d81-ab50-1bbffe63ccbc tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: f593d39b-3d08-4326-96c7-148c1f7ab95e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:43.129370 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee1f13c3-c967-4d81-ab50-1bbffe63ccbc tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:43.130115 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee1f13c3-c967-4d81-ab50-1bbffe63ccbc tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:43.131304 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee1f13c3-c967-4d81-ab50-1bbffe63ccbc tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:43.131937 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ee1f13c3-c967-4d81-ab50-1bbffe63ccbc tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:43.284782 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ee1f13c3-c967-4d81-ab50-1bbffe63ccbc tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e2fe5e526a40da8859b0cf1716ad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21157336f11141f39a1cf7fca6915365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:14:43.296745 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ee1f13c3-c967-4d81-ab50-1bbffe63ccbc tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "GET /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e" status: 200 len: 1313 microversion: 2.1 time: 0.184730 Apr 06 17:14:43.297587 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1703/3402] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:43 2022] GET /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:14:44.314431 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-56d1c6cb-e6b1-4f3e-9530-bebc2d620f1b tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:44.316293 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-56d1c6cb-e6b1-4f3e-9530-bebc2d620f1b tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: f593d39b-3d08-4326-96c7-148c1f7ab95e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:44.324050 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56d1c6cb-e6b1-4f3e-9530-bebc2d620f1b tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:44.324529 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56d1c6cb-e6b1-4f3e-9530-bebc2d620f1b tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:44.325364 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56d1c6cb-e6b1-4f3e-9530-bebc2d620f1b tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:44.325852 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56d1c6cb-e6b1-4f3e-9530-bebc2d620f1b tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:44.467449 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-56d1c6cb-e6b1-4f3e-9530-bebc2d620f1b tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e2fe5e526a40da8859b0cf1716ad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21157336f11141f39a1cf7fca6915365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:14:44.475716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-56d1c6cb-e6b1-4f3e-9530-bebc2d620f1b tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "GET /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e" status: 200 len: 1313 microversion: 2.1 time: 0.165892 Apr 06 17:14:44.476212 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1700/3403] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:44 2022] GET /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:14:44.544583 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-d9625495-fc27-41b2-899b-1bc1d55981b1 req-35c6b39b-d6ab-4a62-b9a6-8fca7acff92c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f593d39b-3d08-4326-96c7-148c1f7ab95e", "name": "network-vif-plugged", "status": "completed", "tag": "79d4308c-043c-41c8-ae96-36eab7d8b7cc"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:14:44.553336 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d9625495-fc27-41b2-899b-1bc1d55981b1 req-35c6b39b-d6ab-4a62-b9a6-8fca7acff92c service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:44.553756 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d9625495-fc27-41b2-899b-1bc1d55981b1 req-35c6b39b-d6ab-4a62-b9a6-8fca7acff92c service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:44.565265 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-d9625495-fc27-41b2-899b-1bc1d55981b1 req-35c6b39b-d6ab-4a62-b9a6-8fca7acff92c service nova] Creating event network-vif-plugged:79d4308c-043c-41c8-ae96-36eab7d8b7cc for instance f593d39b-3d08-4326-96c7-148c1f7ab95e on hv-cinder-83684 Apr 06 17:14:44.570716 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-d9625495-fc27-41b2-899b-1bc1d55981b1 req-35c6b39b-d6ab-4a62-b9a6-8fca7acff92c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030030 Apr 06 17:14:44.571287 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1704/3404] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:14:45.493293 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-70e8f54d-7a19-477f-b327-5bad07e1c344 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:45.493892 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-70e8f54d-7a19-477f-b327-5bad07e1c344 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: f593d39b-3d08-4326-96c7-148c1f7ab95e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:45.501000 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70e8f54d-7a19-477f-b327-5bad07e1c344 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:45.501453 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70e8f54d-7a19-477f-b327-5bad07e1c344 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:45.502223 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70e8f54d-7a19-477f-b327-5bad07e1c344 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:45.502658 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70e8f54d-7a19-477f-b327-5bad07e1c344 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:45.647239 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-70e8f54d-7a19-477f-b327-5bad07e1c344 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e2fe5e526a40da8859b0cf1716ad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21157336f11141f39a1cf7fca6915365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:14:45.657336 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-70e8f54d-7a19-477f-b327-5bad07e1c344 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "GET /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e" status: 200 len: 1313 microversion: 2.1 time: 0.168218 Apr 06 17:14:45.657913 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1701/3405] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:45 2022] GET /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:14:46.675293 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-524cab35-64ed-423b-88d6-d3e01838ec45 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:46.675978 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-524cab35-64ed-423b-88d6-d3e01838ec45 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: f593d39b-3d08-4326-96c7-148c1f7ab95e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:46.682653 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-524cab35-64ed-423b-88d6-d3e01838ec45 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:46.683100 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-524cab35-64ed-423b-88d6-d3e01838ec45 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:46.683858 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-524cab35-64ed-423b-88d6-d3e01838ec45 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:46.684290 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-524cab35-64ed-423b-88d6-d3e01838ec45 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:46.822859 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-524cab35-64ed-423b-88d6-d3e01838ec45 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e2fe5e526a40da8859b0cf1716ad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21157336f11141f39a1cf7fca6915365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:14:46.830579 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-524cab35-64ed-423b-88d6-d3e01838ec45 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "GET /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e" status: 200 len: 1497 microversion: 2.1 time: 0.160477 Apr 06 17:14:46.831125 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1705/3406] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:46 2022] GET /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:14:47.368825 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b3207c1d-3763-4e6c-96fa-fdd7d5b04125 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:47.369420 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b3207c1d-3763-4e6c-96fa-fdd7d5b04125 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: f593d39b-3d08-4326-96c7-148c1f7ab95e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:47.376076 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3207c1d-3763-4e6c-96fa-fdd7d5b04125 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:47.376524 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3207c1d-3763-4e6c-96fa-fdd7d5b04125 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:47.377320 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3207c1d-3763-4e6c-96fa-fdd7d5b04125 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:47.377765 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3207c1d-3763-4e6c-96fa-fdd7d5b04125 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:47.402284 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b3207c1d-3763-4e6c-96fa-fdd7d5b04125 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: f593d39b-3d08-4326-96c7-148c1f7ab95e] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 06 17:14:47.488459 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b3207c1d-3763-4e6c-96fa-fdd7d5b04125 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e" status: 204 len: 0 microversion: 2.1 time: 0.123321 Apr 06 17:14:47.489058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1702/3407] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 17:14:47 2022] DELETE /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 06 17:14:47.497227 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-c4c13602-69e4-4de3-b0ae-8af3c7cd6f03 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:47.497821 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-c4c13602-69e4-4de3-b0ae-8af3c7cd6f03 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: f593d39b-3d08-4326-96c7-148c1f7ab95e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:47.503848 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4c13602-69e4-4de3-b0ae-8af3c7cd6f03 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:47.504293 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4c13602-69e4-4de3-b0ae-8af3c7cd6f03 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:47.505071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4c13602-69e4-4de3-b0ae-8af3c7cd6f03 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:47.505494 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-c4c13602-69e4-4de3-b0ae-8af3c7cd6f03 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:47.647072 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-c4c13602-69e4-4de3-b0ae-8af3c7cd6f03 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e2fe5e526a40da8859b0cf1716ad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21157336f11141f39a1cf7fca6915365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:14:47.654709 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-c4c13602-69e4-4de3-b0ae-8af3c7cd6f03 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "GET /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e" status: 200 len: 1503 microversion: 2.1 time: 0.161063 Apr 06 17:14:47.655305 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1706/3408] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:47 2022] GET /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:14:48.675053 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4c3acc84-a95f-45c0-9c3c-9a5d042a67d4 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:48.675704 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4c3acc84-a95f-45c0-9c3c-9a5d042a67d4 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: f593d39b-3d08-4326-96c7-148c1f7ab95e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:48.685439 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c3acc84-a95f-45c0-9c3c-9a5d042a67d4 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:48.686010 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c3acc84-a95f-45c0-9c3c-9a5d042a67d4 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:48.686811 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c3acc84-a95f-45c0-9c3c-9a5d042a67d4 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:48.687243 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c3acc84-a95f-45c0-9c3c-9a5d042a67d4 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:48.842899 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4c3acc84-a95f-45c0-9c3c-9a5d042a67d4 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e2fe5e526a40da8859b0cf1716ad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21157336f11141f39a1cf7fca6915365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:14:48.850881 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4c3acc84-a95f-45c0-9c3c-9a5d042a67d4 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "GET /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e" status: 200 len: 1503 microversion: 2.1 time: 0.181532 Apr 06 17:14:48.851467 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1703/3409] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:48 2022] GET /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e => generated 1503 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:14:49.659317 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-6282a8d1-990c-4ce7-b9eb-d7c1a8f8dca5 req-992223e4-4988-4a85-81fa-37a65ff82c6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f593d39b-3d08-4326-96c7-148c1f7ab95e", "name": "network-vif-deleted", "tag": "79d4308c-043c-41c8-ae96-36eab7d8b7cc"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:14:49.667533 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6282a8d1-990c-4ce7-b9eb-d7c1a8f8dca5 req-992223e4-4988-4a85-81fa-37a65ff82c6d service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:49.667966 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-6282a8d1-990c-4ce7-b9eb-d7c1a8f8dca5 req-992223e4-4988-4a85-81fa-37a65ff82c6d service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:49.680325 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-6282a8d1-990c-4ce7-b9eb-d7c1a8f8dca5 req-992223e4-4988-4a85-81fa-37a65ff82c6d service nova] Creating event network-vif-deleted:79d4308c-043c-41c8-ae96-36eab7d8b7cc for instance f593d39b-3d08-4326-96c7-148c1f7ab95e on hv-cinder-83684 Apr 06 17:14:49.685620 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-6282a8d1-990c-4ce7-b9eb-d7c1a8f8dca5 req-992223e4-4988-4a85-81fa-37a65ff82c6d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029957 Apr 06 17:14:49.686527 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1707/3410] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:14:49.869825 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-547dd62f-be91-42bc-aba1-6f7e03907497 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:49.870444 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-547dd62f-be91-42bc-aba1-6f7e03907497 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: f593d39b-3d08-4326-96c7-148c1f7ab95e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:49.877443 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-547dd62f-be91-42bc-aba1-6f7e03907497 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:49.877897 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-547dd62f-be91-42bc-aba1-6f7e03907497 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:49.878662 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-547dd62f-be91-42bc-aba1-6f7e03907497 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:49.879352 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-547dd62f-be91-42bc-aba1-6f7e03907497 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:49.910066 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-547dd62f-be91-42bc-aba1-6f7e03907497 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:49.910517 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-547dd62f-be91-42bc-aba1-6f7e03907497 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:49.910993 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-547dd62f-be91-42bc-aba1-6f7e03907497 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lazy-loading 'fault' on Instance uuid f593d39b-3d08-4326-96c7-148c1f7ab95e {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 06 17:14:49.955083 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-547dd62f-be91-42bc-aba1-6f7e03907497 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e2fe5e526a40da8859b0cf1716ad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21157336f11141f39a1cf7fca6915365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:14:49.962740 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-547dd62f-be91-42bc-aba1-6f7e03907497 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "GET /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e" status: 200 len: 1303 microversion: 2.1 time: 0.097167 Apr 06 17:14:49.963329 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1704/3411] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:49 2022] GET /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:14:50.980827 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c630959-8980-4f20-a310-c24bec9c28e9 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:14:50.981658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2c630959-8980-4f20-a310-c24bec9c28e9 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] [instance: f593d39b-3d08-4326-96c7-148c1f7ab95e] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:14:50.988327 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c630959-8980-4f20-a310-c24bec9c28e9 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:50.989609 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c630959-8980-4f20-a310-c24bec9c28e9 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:50.990721 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c630959-8980-4f20-a310-c24bec9c28e9 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:14:50.991151 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2c630959-8980-4f20-a310-c24bec9c28e9 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:14:51.005492 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-2c630959-8980-4f20-a310-c24bec9c28e9 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] HTTP exception thrown: Instance f593d39b-3d08-4326-96c7-148c1f7ab95e could not be found. Apr 06 17:14:51.006080 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2c630959-8980-4f20-a310-c24bec9c28e9 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] Returning 404 to user: Instance f593d39b-3d08-4326-96c7-148c1f7ab95e could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:14:51.006941 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2c630959-8980-4f20-a310-c24bec9c28e9 tempest-VolumesActionsTest-23486416 tempest-VolumesActionsTest-23486416-project] 10.222.0.64 "GET /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e" status: 404 len: 111 microversion: 2.1 time: 0.030829 Apr 06 17:14:51.008375 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1708/3412] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:14:50 2022] GET /compute/v2.1/servers/f593d39b-3d08-4326-96c7-148c1f7ab95e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:15:32.995600 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:15:32.996243 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 17:15:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:16:08.110639 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0ca18303-5043-496a-b4c9-8064e256933e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:16:08.111449 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0ca18303-5043-496a-b4c9-8064e256933e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 51c2747f-a615-42e2-9fb6-13e355306395] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:16:08.121597 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ca18303-5043-496a-b4c9-8064e256933e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:16:08.122366 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ca18303-5043-496a-b4c9-8064e256933e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:16:08.124037 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ca18303-5043-496a-b4c9-8064e256933e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:16:08.124643 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ca18303-5043-496a-b4c9-8064e256933e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:16:08.141814 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-0ca18303-5043-496a-b4c9-8064e256933e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] HTTP exception thrown: Instance 51c2747f-a615-42e2-9fb6-13e355306395 could not be found. Apr 06 17:16:08.142647 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0ca18303-5043-496a-b4c9-8064e256933e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Returning 404 to user: Instance 51c2747f-a615-42e2-9fb6-13e355306395 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:16:08.143864 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0ca18303-5043-496a-b4c9-8064e256933e tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "DELETE /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395" status: 404 len: 111 microversion: 2.20 time: 0.042416 Apr 06 17:16:08.144520 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1705/3413] 10.222.0.64 () {60 vars in 1279 bytes} [Wed Apr 6 17:16:08 2022] DELETE /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 06 17:16:08.153909 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7eaf818c-706c-4797-9af8-5f7ca555848d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:16:08.154683 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7eaf818c-706c-4797-9af8-5f7ca555848d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 51c2747f-a615-42e2-9fb6-13e355306395] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:16:08.161648 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7eaf818c-706c-4797-9af8-5f7ca555848d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:16:08.162141 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7eaf818c-706c-4797-9af8-5f7ca555848d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:16:08.162936 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7eaf818c-706c-4797-9af8-5f7ca555848d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:16:08.163504 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7eaf818c-706c-4797-9af8-5f7ca555848d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:16:08.185891 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-7eaf818c-706c-4797-9af8-5f7ca555848d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] HTTP exception thrown: Instance 51c2747f-a615-42e2-9fb6-13e355306395 could not be found. Apr 06 17:16:08.186720 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7eaf818c-706c-4797-9af8-5f7ca555848d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Returning 404 to user: Instance 51c2747f-a615-42e2-9fb6-13e355306395 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:16:08.188143 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7eaf818c-706c-4797-9af8-5f7ca555848d tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395" status: 404 len: 111 microversion: 2.20 time: 0.039119 Apr 06 17:16:08.188979 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1709/3414] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:16:08 2022] GET /compute/v2.1/servers/51c2747f-a615-42e2-9fb6-13e355306395 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 06 17:16:09.378390 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d0bdd54b-6bd7-48d1-9f8e-adc922ea7667 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:16:09.379253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d0bdd54b-6bd7-48d1-9f8e-adc922ea7667 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:16:09.390716 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0bdd54b-6bd7-48d1-9f8e-adc922ea7667 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:16:09.391496 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0bdd54b-6bd7-48d1-9f8e-adc922ea7667 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:16:09.392971 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0bdd54b-6bd7-48d1-9f8e-adc922ea7667 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:16:09.393764 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0bdd54b-6bd7-48d1-9f8e-adc922ea7667 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:16:09.417239 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-d0bdd54b-6bd7-48d1-9f8e-adc922ea7667 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] HTTP exception thrown: Instance 330d17b1-0d7d-4519-8dc3-3210eb25aa3c could not be found. Apr 06 17:16:09.418276 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d0bdd54b-6bd7-48d1-9f8e-adc922ea7667 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Returning 404 to user: Instance 330d17b1-0d7d-4519-8dc3-3210eb25aa3c could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:16:09.419723 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d0bdd54b-6bd7-48d1-9f8e-adc922ea7667 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "DELETE /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 404 len: 111 microversion: 2.20 time: 0.048209 Apr 06 17:16:09.420712 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1706/3415] 10.222.0.64 () {60 vars in 1279 bytes} [Wed Apr 6 17:16:09 2022] DELETE /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 06 17:16:09.434021 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7b7be795-0d1a-4035-a73d-94b253e37b70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:16:09.435129 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7b7be795-0d1a-4035-a73d-94b253e37b70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] [instance: 330d17b1-0d7d-4519-8dc3-3210eb25aa3c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:16:09.446640 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b7be795-0d1a-4035-a73d-94b253e37b70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:16:09.447372 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b7be795-0d1a-4035-a73d-94b253e37b70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:16:09.448592 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b7be795-0d1a-4035-a73d-94b253e37b70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:16:09.449726 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7b7be795-0d1a-4035-a73d-94b253e37b70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:16:09.473836 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-7b7be795-0d1a-4035-a73d-94b253e37b70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] HTTP exception thrown: Instance 330d17b1-0d7d-4519-8dc3-3210eb25aa3c could not be found. Apr 06 17:16:09.474769 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7b7be795-0d1a-4035-a73d-94b253e37b70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] Returning 404 to user: Instance 330d17b1-0d7d-4519-8dc3-3210eb25aa3c could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:16:09.476098 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7b7be795-0d1a-4035-a73d-94b253e37b70 tempest-AttachVolumeShelveTestJSON-1762953083 tempest-AttachVolumeShelveTestJSON-1762953083-project] 10.222.0.64 "GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c" status: 404 len: 111 microversion: 2.20 time: 0.049273 Apr 06 17:16:09.477222 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1710/3416] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Apr 6 17:16:09 2022] GET /compute/v2.1/servers/330d17b1-0d7d-4519-8dc3-3210eb25aa3c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 06 17:16:58.188028 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:16:58.188826 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 17:16:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:17:04.083543 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:17:04.084238 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 17:17:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:17:11.579124 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:17:11.579948 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 17:17:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:17:23.202158 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:17:23.202739 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 17:17:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:17:36.856850 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ab22d81d-a306-4cb4-8aa5-e00f778241f1 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Action: 'create', calling method: .version_select at 0x7fa9cf175430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2132919883"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:17:36.881630 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-ab22d81d-a306-4cb4-8aa5-e00f778241f1 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Getting quotas for project d80fa131c3864ec191ac904b9e290dbc. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 17:17:36.888390 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-ab22d81d-a306-4cb4-8aa5-e00f778241f1 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Getting quotas for user 7c1e03597fc34d69b97096c60a4b5be1 and project d80fa131c3864ec191ac904b9e290dbc. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 17:17:37.201317 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-ab22d81d-a306-4cb4-8aa5-e00f778241f1 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Getting quotas for project d80fa131c3864ec191ac904b9e290dbc. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 17:17:37.206758 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-ab22d81d-a306-4cb4-8aa5-e00f778241f1 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Getting quotas for user 7c1e03597fc34d69b97096c60a4b5be1 and project d80fa131c3864ec191ac904b9e290dbc. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 17:17:37.227482 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ab22d81d-a306-4cb4-8aa5-e00f778241f1 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.656028 Apr 06 17:17:37.229342 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1707/3417] 10.222.0.64 () {60 vars in 1157 bytes} [Wed Apr 6 17:17:36 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:17:53.336017 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bad9a484-248b-4e52-bcdb-f18c7769f52d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1791826037", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2132919883", "security_groups": [{"name": "tempest-secgroup-smoke-706301784"}], "block_device_mapping_v2": [{"uuid": "88f0c570-23a0-4ae6-b99c-c0444b439b88", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "85bbf121-bd26-449c-a399-89da35ff4bb5"}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:17:53.619780 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-bad9a484-248b-4e52-bcdb-f18c7769f52d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] validate_networks() for [('85bbf121-bd26-449c-a399-89da35ff4bb5', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 06 17:17:54.256052 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-bad9a484-248b-4e52-bcdb-f18c7769f52d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 06 17:17:54.256795 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-bad9a484-248b-4e52-bcdb-f18c7769f52d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 06 17:17:54.257622 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-bad9a484-248b-4e52-bcdb-f18c7769f52d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 06 17:17:54.258317 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-bad9a484-248b-4e52-bcdb-f18c7769f52d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 06 17:17:54.258876 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-bad9a484-248b-4e52-bcdb-f18c7769f52d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 06 17:17:54.270882 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bad9a484-248b-4e52-bcdb-f18c7769f52d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:17:54.271439 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bad9a484-248b-4e52-bcdb-f18c7769f52d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:17:54.272288 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bad9a484-248b-4e52-bcdb-f18c7769f52d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:17:54.272869 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bad9a484-248b-4e52-bcdb-f18c7769f52d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:17:54.290984 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-bad9a484-248b-4e52-bcdb-f18c7769f52d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Getting quotas for project d80fa131c3864ec191ac904b9e290dbc. Resources: {'instances', 'cores', 'ram'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 17:17:54.295477 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-bad9a484-248b-4e52-bcdb-f18c7769f52d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Getting quotas for user 7c1e03597fc34d69b97096c60a4b5be1 and project d80fa131c3864ec191ac904b9e290dbc. Resources: {'instances', 'cores', 'ram'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 17:17:54.383894 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bad9a484-248b-4e52-bcdb-f18c7769f52d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 06 17:17:54.388959 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bad9a484-248b-4e52-bcdb-f18c7769f52d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 7fb9f502-78ea-4787-8899-743c71d590e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='88f0c570-23a0-4ae6-b99c-c0444b439b88',volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 06 17:17:54.546443 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bad9a484-248b-4e52-bcdb-f18c7769f52d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.218612 Apr 06 17:17:54.547091 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1711/3418] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Apr 6 17:17:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 1220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 06 17:17:54.564274 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9d3310a3-88b5-4adf-a0af-9b7b131d5fca tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:17:54.565646 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9d3310a3-88b5-4adf-a0af-9b7b131d5fca tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 7fb9f502-78ea-4787-8899-743c71d590e6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:17:54.641124 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9d3310a3-88b5-4adf-a0af-9b7b131d5fca tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:17:54.652433 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9d3310a3-88b5-4adf-a0af-9b7b131d5fca tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6" status: 200 len: 1095 microversion: 2.1 time: 0.094296 Apr 06 17:17:54.655348 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1708/3419] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:17:54 2022] GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6 => generated 1095 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:17:55.676727 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-47428e54-76f4-4840-afe6-fb1e40faef0c tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:17:55.677545 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-47428e54-76f4-4840-afe6-fb1e40faef0c tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 7fb9f502-78ea-4787-8899-743c71d590e6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:17:55.687069 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47428e54-76f4-4840-afe6-fb1e40faef0c tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:17:55.687520 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47428e54-76f4-4840-afe6-fb1e40faef0c tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:17:55.688325 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47428e54-76f4-4840-afe6-fb1e40faef0c tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:17:55.688850 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-47428e54-76f4-4840-afe6-fb1e40faef0c tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:17:55.772830 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-47428e54-76f4-4840-afe6-fb1e40faef0c tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:17:55.781495 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-47428e54-76f4-4840-afe6-fb1e40faef0c tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6" status: 200 len: 1193 microversion: 2.1 time: 0.111237 Apr 06 17:17:55.782066 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1712/3420] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:17:55 2022] GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6 => generated 1193 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:17:56.798984 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-50597da1-cf7d-4536-84f6-aa7d790d0ba8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:17:56.799590 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-50597da1-cf7d-4536-84f6-aa7d790d0ba8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 7fb9f502-78ea-4787-8899-743c71d590e6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:17:56.806317 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50597da1-cf7d-4536-84f6-aa7d790d0ba8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:17:56.806764 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50597da1-cf7d-4536-84f6-aa7d790d0ba8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:17:56.807534 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50597da1-cf7d-4536-84f6-aa7d790d0ba8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:17:56.807966 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50597da1-cf7d-4536-84f6-aa7d790d0ba8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:17:56.908600 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-50597da1-cf7d-4536-84f6-aa7d790d0ba8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:17:56.920135 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-50597da1-cf7d-4536-84f6-aa7d790d0ba8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6" status: 200 len: 1211 microversion: 2.1 time: 0.124922 Apr 06 17:17:56.921055 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1709/3421] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:17:56 2022] GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6 => generated 1211 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:17:57.941758 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ef6e46cb-1465-4529-a518-457615765b81 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:17:57.942616 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ef6e46cb-1465-4529-a518-457615765b81 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 7fb9f502-78ea-4787-8899-743c71d590e6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:17:57.950473 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef6e46cb-1465-4529-a518-457615765b81 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:17:57.950926 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef6e46cb-1465-4529-a518-457615765b81 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:17:57.951708 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef6e46cb-1465-4529-a518-457615765b81 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:17:57.952143 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ef6e46cb-1465-4529-a518-457615765b81 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:17:58.177116 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ef6e46cb-1465-4529-a518-457615765b81 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:17:58.191573 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ef6e46cb-1465-4529-a518-457615765b81 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6" status: 200 len: 1266 microversion: 2.1 time: 0.253545 Apr 06 17:17:58.193128 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1713/3422] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:17:57 2022] GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6 => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:17:58.328429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-19549a2d-8a83-4e77-9a2c-3ce6abd54d25 req-931e7c0b-689a-4a87-8994-09855275998a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fb9f502-78ea-4787-8899-743c71d590e6", "tag": "20e67ccd-b603-4712-9b79-542cc2e273e7"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:17:58.349749 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-19549a2d-8a83-4e77-9a2c-3ce6abd54d25 req-931e7c0b-689a-4a87-8994-09855275998a service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:17:58.350287 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-19549a2d-8a83-4e77-9a2c-3ce6abd54d25 req-931e7c0b-689a-4a87-8994-09855275998a service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:17:58.367547 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-19549a2d-8a83-4e77-9a2c-3ce6abd54d25 req-931e7c0b-689a-4a87-8994-09855275998a service nova] Creating event network-changed:20e67ccd-b603-4712-9b79-542cc2e273e7 for instance 7fb9f502-78ea-4787-8899-743c71d590e6 on hv-cinder-83684 Apr 06 17:17:58.377444 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-19549a2d-8a83-4e77-9a2c-3ce6abd54d25 req-931e7c0b-689a-4a87-8994-09855275998a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062496 Apr 06 17:17:58.378188 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1710/3423] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 17:17:59.210028 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-516915f2-6a64-4f41-92a2-5f9b6afb4fa9 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:17:59.211024 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-516915f2-6a64-4f41-92a2-5f9b6afb4fa9 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 7fb9f502-78ea-4787-8899-743c71d590e6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:17:59.217838 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-516915f2-6a64-4f41-92a2-5f9b6afb4fa9 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:17:59.218312 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-516915f2-6a64-4f41-92a2-5f9b6afb4fa9 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:17:59.219106 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-516915f2-6a64-4f41-92a2-5f9b6afb4fa9 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:17:59.219543 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-516915f2-6a64-4f41-92a2-5f9b6afb4fa9 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:17:59.413952 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-516915f2-6a64-4f41-92a2-5f9b6afb4fa9 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:17:59.421742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-516915f2-6a64-4f41-92a2-5f9b6afb4fa9 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6" status: 200 len: 1266 microversion: 2.1 time: 0.215585 Apr 06 17:17:59.422332 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1714/3424] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:17:59 2022] GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:18:00.439285 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2d7cd276-245d-4fe9-974d-1773b84994c8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:18:00.440175 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2d7cd276-245d-4fe9-974d-1773b84994c8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 7fb9f502-78ea-4787-8899-743c71d590e6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:18:00.447351 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d7cd276-245d-4fe9-974d-1773b84994c8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:18:00.447977 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d7cd276-245d-4fe9-974d-1773b84994c8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:18:00.448781 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d7cd276-245d-4fe9-974d-1773b84994c8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:18:00.449215 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d7cd276-245d-4fe9-974d-1773b84994c8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:18:00.601834 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-2d7cd276-245d-4fe9-974d-1773b84994c8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:18:00.612394 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2d7cd276-245d-4fe9-974d-1773b84994c8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6" status: 200 len: 1266 microversion: 2.1 time: 0.177198 Apr 06 17:18:00.613058 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1711/3425] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:18:00 2022] GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:18:01.633238 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-395cd983-d2d0-4409-aaea-c28a34894dc8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:18:01.634240 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-395cd983-d2d0-4409-aaea-c28a34894dc8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 7fb9f502-78ea-4787-8899-743c71d590e6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:18:01.642867 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-395cd983-d2d0-4409-aaea-c28a34894dc8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:18:01.643517 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-395cd983-d2d0-4409-aaea-c28a34894dc8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:18:01.644494 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-395cd983-d2d0-4409-aaea-c28a34894dc8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:18:01.645097 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-395cd983-d2d0-4409-aaea-c28a34894dc8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:18:01.815853 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-395cd983-d2d0-4409-aaea-c28a34894dc8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:18:01.826347 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-395cd983-d2d0-4409-aaea-c28a34894dc8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6" status: 200 len: 1266 microversion: 2.1 time: 0.199786 Apr 06 17:18:01.827006 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1715/3426] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:18:01 2022] GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:18:02.845956 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-283c119a-5843-476a-9c4e-50e4c3d97dae tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:18:02.846898 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-283c119a-5843-476a-9c4e-50e4c3d97dae tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 7fb9f502-78ea-4787-8899-743c71d590e6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:18:02.857979 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-283c119a-5843-476a-9c4e-50e4c3d97dae tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:18:02.858719 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-283c119a-5843-476a-9c4e-50e4c3d97dae tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:18:02.860537 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-283c119a-5843-476a-9c4e-50e4c3d97dae tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:18:02.861389 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-283c119a-5843-476a-9c4e-50e4c3d97dae tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:18:03.052491 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-283c119a-5843-476a-9c4e-50e4c3d97dae tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:18:03.066081 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-283c119a-5843-476a-9c4e-50e4c3d97dae tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6" status: 200 len: 1266 microversion: 2.1 time: 0.225187 Apr 06 17:18:03.067124 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1712/3427] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:18:02 2022] GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:18:04.092445 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7a43e8e9-1efe-4f0b-812d-36d5e74feffa tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:18:04.093422 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7a43e8e9-1efe-4f0b-812d-36d5e74feffa tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 7fb9f502-78ea-4787-8899-743c71d590e6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:18:04.099622 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a43e8e9-1efe-4f0b-812d-36d5e74feffa tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:18:04.100064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a43e8e9-1efe-4f0b-812d-36d5e74feffa tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:18:04.100862 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a43e8e9-1efe-4f0b-812d-36d5e74feffa tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:18:04.101290 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7a43e8e9-1efe-4f0b-812d-36d5e74feffa tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:18:04.263790 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7a43e8e9-1efe-4f0b-812d-36d5e74feffa tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:18:04.271617 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7a43e8e9-1efe-4f0b-812d-36d5e74feffa tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6" status: 200 len: 1266 microversion: 2.1 time: 0.183447 Apr 06 17:18:04.272171 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1716/3428] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:18:04 2022] GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:18:05.298398 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ac80acb4-4c95-4381-870c-3f8838342841 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:18:05.299454 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ac80acb4-4c95-4381-870c-3f8838342841 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 7fb9f502-78ea-4787-8899-743c71d590e6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:18:05.307794 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac80acb4-4c95-4381-870c-3f8838342841 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:18:05.308919 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac80acb4-4c95-4381-870c-3f8838342841 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:18:05.310327 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac80acb4-4c95-4381-870c-3f8838342841 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:18:05.311111 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac80acb4-4c95-4381-870c-3f8838342841 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:18:05.483190 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ac80acb4-4c95-4381-870c-3f8838342841 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:18:05.491578 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ac80acb4-4c95-4381-870c-3f8838342841 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6" status: 200 len: 1266 microversion: 2.1 time: 0.200348 Apr 06 17:18:05.492184 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1713/3429] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:18:05 2022] GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:18:06.513006 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8e9f34e0-a357-4dbe-a3b8-7afd8de1a0dc tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:18:06.514004 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8e9f34e0-a357-4dbe-a3b8-7afd8de1a0dc tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 7fb9f502-78ea-4787-8899-743c71d590e6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:18:06.523494 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e9f34e0-a357-4dbe-a3b8-7afd8de1a0dc tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:18:06.524167 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e9f34e0-a357-4dbe-a3b8-7afd8de1a0dc tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:18:06.525533 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e9f34e0-a357-4dbe-a3b8-7afd8de1a0dc tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:18:06.526241 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-8e9f34e0-a357-4dbe-a3b8-7afd8de1a0dc tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:18:06.701730 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8e9f34e0-a357-4dbe-a3b8-7afd8de1a0dc tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:18:06.709289 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8e9f34e0-a357-4dbe-a3b8-7afd8de1a0dc tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6" status: 200 len: 1266 microversion: 2.1 time: 0.203380 Apr 06 17:18:06.709863 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1717/3430] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:18:06 2022] GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:18:07.731286 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-29a45b40-0125-4932-abd3-69da93c216f2 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:18:07.732558 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-29a45b40-0125-4932-abd3-69da93c216f2 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 7fb9f502-78ea-4787-8899-743c71d590e6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:18:07.742441 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29a45b40-0125-4932-abd3-69da93c216f2 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:18:07.742905 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29a45b40-0125-4932-abd3-69da93c216f2 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:18:07.743770 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29a45b40-0125-4932-abd3-69da93c216f2 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:18:07.744210 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29a45b40-0125-4932-abd3-69da93c216f2 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:18:07.947648 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-29a45b40-0125-4932-abd3-69da93c216f2 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:18:07.965356 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-29a45b40-0125-4932-abd3-69da93c216f2 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6" status: 200 len: 1266 microversion: 2.1 time: 0.240923 Apr 06 17:18:07.966761 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1714/3431] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:18:07 2022] GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:18:08.984408 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-650b388a-6837-4dbd-8bdb-830bfcd1d58f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:18:08.985306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-650b388a-6837-4dbd-8bdb-830bfcd1d58f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 7fb9f502-78ea-4787-8899-743c71d590e6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:18:08.993466 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-650b388a-6837-4dbd-8bdb-830bfcd1d58f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:18:08.994012 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-650b388a-6837-4dbd-8bdb-830bfcd1d58f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:18:08.994986 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-650b388a-6837-4dbd-8bdb-830bfcd1d58f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:18:08.995487 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-650b388a-6837-4dbd-8bdb-830bfcd1d58f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:18:09.177839 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-650b388a-6837-4dbd-8bdb-830bfcd1d58f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:18:09.190678 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-650b388a-6837-4dbd-8bdb-830bfcd1d58f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6" status: 200 len: 1266 microversion: 2.1 time: 0.210212 Apr 06 17:18:09.191713 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1718/3432] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:18:08 2022] GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:18:09.845001 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-1de35e69-e83b-4e8d-9f86-585287d80922 req-03cea756-bf47-4cb2-9dfe-b16f2a542395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb9f502-78ea-4787-8899-743c71d590e6", "name": "network-vif-plugged", "status": "completed", "tag": "20e67ccd-b603-4712-9b79-542cc2e273e7"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:18:09.860431 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-1de35e69-e83b-4e8d-9f86-585287d80922 req-03cea756-bf47-4cb2-9dfe-b16f2a542395 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:18:09.862287 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-1de35e69-e83b-4e8d-9f86-585287d80922 req-03cea756-bf47-4cb2-9dfe-b16f2a542395 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:18:09.884999 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-1de35e69-e83b-4e8d-9f86-585287d80922 req-03cea756-bf47-4cb2-9dfe-b16f2a542395 service nova] Creating event network-vif-plugged:20e67ccd-b603-4712-9b79-542cc2e273e7 for instance 7fb9f502-78ea-4787-8899-743c71d590e6 on hv-cinder-83684 Apr 06 17:18:09.895259 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-1de35e69-e83b-4e8d-9f86-585287d80922 req-03cea756-bf47-4cb2-9dfe-b16f2a542395 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054633 Apr 06 17:18:09.896293 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1715/3433] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:18:10.217108 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5740cd1c-4871-4c3a-ae39-d28b66188d50 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:18:10.218226 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5740cd1c-4871-4c3a-ae39-d28b66188d50 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 7fb9f502-78ea-4787-8899-743c71d590e6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:18:10.230156 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5740cd1c-4871-4c3a-ae39-d28b66188d50 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:18:10.230956 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5740cd1c-4871-4c3a-ae39-d28b66188d50 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:18:10.232365 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5740cd1c-4871-4c3a-ae39-d28b66188d50 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:18:10.233166 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5740cd1c-4871-4c3a-ae39-d28b66188d50 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:18:10.424427 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5740cd1c-4871-4c3a-ae39-d28b66188d50 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:18:10.432997 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5740cd1c-4871-4c3a-ae39-d28b66188d50 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6" status: 200 len: 1266 microversion: 2.1 time: 0.223777 Apr 06 17:18:10.433597 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1719/3434] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:18:10 2022] GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:18:11.453515 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1a70d4b7-c2c8-4234-8805-6fab58bb9d40 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:18:11.454290 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1a70d4b7-c2c8-4234-8805-6fab58bb9d40 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 7fb9f502-78ea-4787-8899-743c71d590e6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:18:11.462760 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a70d4b7-c2c8-4234-8805-6fab58bb9d40 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:18:11.463269 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a70d4b7-c2c8-4234-8805-6fab58bb9d40 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:18:11.464068 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a70d4b7-c2c8-4234-8805-6fab58bb9d40 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:18:11.464501 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a70d4b7-c2c8-4234-8805-6fab58bb9d40 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:18:11.625245 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1a70d4b7-c2c8-4234-8805-6fab58bb9d40 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:18:11.635061 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1a70d4b7-c2c8-4234-8805-6fab58bb9d40 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6" status: 200 len: 1453 microversion: 2.1 time: 0.185852 Apr 06 17:18:11.635671 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1716/3435] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:18:11 2022] GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6 => generated 1453 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:18:11.652651 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9dae8252-325e-4579-979c-6406a791978a tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:18:11.653823 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-9dae8252-325e-4579-979c-6406a791978a tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 7fb9f502-78ea-4787-8899-743c71d590e6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:18:11.660789 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dae8252-325e-4579-979c-6406a791978a tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:18:11.661242 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dae8252-325e-4579-979c-6406a791978a tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:18:11.662504 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dae8252-325e-4579-979c-6406a791978a tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:18:11.662504 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-9dae8252-325e-4579-979c-6406a791978a tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:18:11.832496 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-9dae8252-325e-4579-979c-6406a791978a tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:18:11.841999 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9dae8252-325e-4579-979c-6406a791978a tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6" status: 200 len: 1453 microversion: 2.1 time: 0.193561 Apr 06 17:18:11.842742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1720/3436] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:18:11 2022] GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6 => generated 1453 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:18:14.210673 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-79ee8463-c724-420b-a998-1a797805f923 req-c186c714-cfb5-4489-97eb-5cfcb901cdc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fb9f502-78ea-4787-8899-743c71d590e6", "tag": "20e67ccd-b603-4712-9b79-542cc2e273e7"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:18:14.224597 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-79ee8463-c724-420b-a998-1a797805f923 req-c186c714-cfb5-4489-97eb-5cfcb901cdc2 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:18:14.225325 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-79ee8463-c724-420b-a998-1a797805f923 req-c186c714-cfb5-4489-97eb-5cfcb901cdc2 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:18:14.239432 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-79ee8463-c724-420b-a998-1a797805f923 req-c186c714-cfb5-4489-97eb-5cfcb901cdc2 service nova] Creating event network-changed:20e67ccd-b603-4712-9b79-542cc2e273e7 for instance 7fb9f502-78ea-4787-8899-743c71d590e6 on hv-cinder-83684 Apr 06 17:18:14.247062 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-79ee8463-c724-420b-a998-1a797805f923 req-c186c714-cfb5-4489-97eb-5cfcb901cdc2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122946 Apr 06 17:18:14.248038 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1717/3437] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:19:45.347528 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: ERROR oslo.messaging._drivers.impl_rabbit [-] [98b694a4-ebf4-4aca-8059-be2b87c00e80] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 06 17:19:45.351970 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-78c36aae-c8a3-4643-a786-e6ff8b52dd98 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:19:45.352617 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-78c36aae-c8a3-4643-a786-e6ff8b52dd98 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:19:45.359026 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78c36aae-c8a3-4643-a786-e6ff8b52dd98 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:19:45.359471 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78c36aae-c8a3-4643-a786-e6ff8b52dd98 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:19:45.360281 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78c36aae-c8a3-4643-a786-e6ff8b52dd98 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:19:45.360771 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-78c36aae-c8a3-4643-a786-e6ff8b52dd98 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:19:45.375331 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-78c36aae-c8a3-4643-a786-e6ff8b52dd98 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] HTTP exception thrown: Instance 6b9f9e64-72fd-4e62-bde6-4e44f737c02c could not be found. Apr 06 17:19:45.375928 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-78c36aae-c8a3-4643-a786-e6ff8b52dd98 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Returning 404 to user: Instance 6b9f9e64-72fd-4e62-bde6-4e44f737c02c could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:19:45.376801 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-78c36aae-c8a3-4643-a786-e6ff8b52dd98 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 404 len: 111 microversion: 2.1 time: 0.032906 Apr 06 17:19:45.377360 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1721/3438] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 17:19:45 2022] DELETE /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:19:45.387306 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6af15540-3121-4b02-baeb-8e0f9975e3af] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 06 17:19:45.393352 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f5934754-2c08-476e-8067-170f9fc623a6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:19:45.394576 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f5934754-2c08-476e-8067-170f9fc623a6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] [instance: 6b9f9e64-72fd-4e62-bde6-4e44f737c02c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:19:45.401700 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5934754-2c08-476e-8067-170f9fc623a6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:19:45.402150 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5934754-2c08-476e-8067-170f9fc623a6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:19:45.402976 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5934754-2c08-476e-8067-170f9fc623a6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:19:45.403414 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5934754-2c08-476e-8067-170f9fc623a6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:19:45.418304 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-f5934754-2c08-476e-8067-170f9fc623a6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] HTTP exception thrown: Instance 6b9f9e64-72fd-4e62-bde6-4e44f737c02c could not be found. Apr 06 17:19:45.418878 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f5934754-2c08-476e-8067-170f9fc623a6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] Returning 404 to user: Instance 6b9f9e64-72fd-4e62-bde6-4e44f737c02c could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:19:45.419855 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f5934754-2c08-476e-8067-170f9fc623a6 tempest-AttachVolumeNegativeTest-624820347 tempest-AttachVolumeNegativeTest-624820347-project] 10.222.0.64 "GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c" status: 404 len: 111 microversion: 2.1 time: 0.035957 Apr 06 17:19:45.420431 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1718/3439] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:19:45 2022] GET /compute/v2.1/servers/6b9f9e64-72fd-4e62-bde6-4e44f737c02c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:20:05.952533 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:20:05.953576 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 17:20:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:20:08.589246 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-14f9a6b6-b07f-4484-8f55-acb89326b026 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:20:08.590000 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-14f9a6b6-b07f-4484-8f55-acb89326b026 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 7fb9f502-78ea-4787-8899-743c71d590e6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:20:08.599396 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14f9a6b6-b07f-4484-8f55-acb89326b026 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:08.599961 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14f9a6b6-b07f-4484-8f55-acb89326b026 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:08.601188 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14f9a6b6-b07f-4484-8f55-acb89326b026 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:08.601360 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-14f9a6b6-b07f-4484-8f55-acb89326b026 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:08.625692 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] [98b694a4-ebf4-4aca-8059-be2b87c00e80] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 44320. Apr 06 17:20:08.641601 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-14f9a6b6-b07f-4484-8f55-acb89326b026 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 7fb9f502-78ea-4787-8899-743c71d590e6] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 06 17:20:08.755957 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-14f9a6b6-b07f-4484-8f55-acb89326b026 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "DELETE /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6" status: 204 len: 0 microversion: 2.1 time: 0.170549 Apr 06 17:20:08.756948 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1722/3440] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 17:20:08 2022] DELETE /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 06 17:20:08.768956 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5364e5eb-b44b-4089-becb-c9dfe35625da tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:20:08.770072 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5364e5eb-b44b-4089-becb-c9dfe35625da tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 7fb9f502-78ea-4787-8899-743c71d590e6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:20:08.779518 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5364e5eb-b44b-4089-becb-c9dfe35625da tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:08.780124 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5364e5eb-b44b-4089-becb-c9dfe35625da tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:08.781265 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5364e5eb-b44b-4089-becb-c9dfe35625da tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:08.781873 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5364e5eb-b44b-4089-becb-c9dfe35625da tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:08.807387 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] [6af15540-3121-4b02-baeb-8e0f9975e3af] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 44328. Apr 06 17:20:09.137064 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5364e5eb-b44b-4089-becb-c9dfe35625da tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:20:09.146836 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5364e5eb-b44b-4089-becb-c9dfe35625da tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6" status: 200 len: 1577 microversion: 2.1 time: 0.383168 Apr 06 17:20:09.147646 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1719/3441] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:20:08 2022] GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6 => generated 1577 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:20:10.172725 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-ba3bb044-321d-46fa-b748-65e7633729a5 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:20:10.174072 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-ba3bb044-321d-46fa-b748-65e7633729a5 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 7fb9f502-78ea-4787-8899-743c71d590e6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:20:10.182088 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba3bb044-321d-46fa-b748-65e7633729a5 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:10.182371 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba3bb044-321d-46fa-b748-65e7633729a5 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:10.183393 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba3bb044-321d-46fa-b748-65e7633729a5 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:10.183790 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-ba3bb044-321d-46fa-b748-65e7633729a5 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:10.338512 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-ba3bb044-321d-46fa-b748-65e7633729a5 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:20:10.346540 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-ba3bb044-321d-46fa-b748-65e7633729a5 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6" status: 200 len: 1577 microversion: 2.1 time: 0.178520 Apr 06 17:20:10.347314 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1723/3442] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:20:10 2022] GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6 => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:20:11.365023 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d6a3a242-7747-4a63-b0f3-5ee907fd01d4 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:20:11.365023 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d6a3a242-7747-4a63-b0f3-5ee907fd01d4 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 7fb9f502-78ea-4787-8899-743c71d590e6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:20:11.371769 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6a3a242-7747-4a63-b0f3-5ee907fd01d4 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:11.372227 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6a3a242-7747-4a63-b0f3-5ee907fd01d4 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:11.373060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6a3a242-7747-4a63-b0f3-5ee907fd01d4 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:11.373490 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6a3a242-7747-4a63-b0f3-5ee907fd01d4 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:11.466867 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d6a3a242-7747-4a63-b0f3-5ee907fd01d4 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:20:11.475109 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d6a3a242-7747-4a63-b0f3-5ee907fd01d4 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6" status: 200 len: 1510 microversion: 2.1 time: 0.115379 Apr 06 17:20:11.475721 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1720/3443] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:20:11 2022] GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6 => generated 1510 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:20:11.736348 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-3afe4238-f699-4d09-b88d-78c6d80759de req-a04b1701-6856-4914-b8bc-48f630bad153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb9f502-78ea-4787-8899-743c71d590e6", "name": "network-vif-deleted", "tag": "20e67ccd-b603-4712-9b79-542cc2e273e7"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:20:11.754903 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3afe4238-f699-4d09-b88d-78c6d80759de req-a04b1701-6856-4914-b8bc-48f630bad153 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:11.755564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-3afe4238-f699-4d09-b88d-78c6d80759de req-a04b1701-6856-4914-b8bc-48f630bad153 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:11.771983 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-3afe4238-f699-4d09-b88d-78c6d80759de req-a04b1701-6856-4914-b8bc-48f630bad153 service nova] Creating event network-vif-deleted:20e67ccd-b603-4712-9b79-542cc2e273e7 for instance 7fb9f502-78ea-4787-8899-743c71d590e6 on hv-cinder-83684 Apr 06 17:20:11.777808 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-3afe4238-f699-4d09-b88d-78c6d80759de req-a04b1701-6856-4914-b8bc-48f630bad153 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045351 Apr 06 17:20:11.778560 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1724/3444] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 17:20:12.492886 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0ae9a100-4127-4ab2-b762-8d57ecba6b6c tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:20:12.495230 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0ae9a100-4127-4ab2-b762-8d57ecba6b6c tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 7fb9f502-78ea-4787-8899-743c71d590e6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:20:12.503994 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ae9a100-4127-4ab2-b762-8d57ecba6b6c tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:12.505002 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ae9a100-4127-4ab2-b762-8d57ecba6b6c tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:12.506017 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ae9a100-4127-4ab2-b762-8d57ecba6b6c tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:12.507122 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ae9a100-4127-4ab2-b762-8d57ecba6b6c tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:12.552136 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ae9a100-4127-4ab2-b762-8d57ecba6b6c tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:12.552724 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ae9a100-4127-4ab2-b762-8d57ecba6b6c tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:12.553256 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-0ae9a100-4127-4ab2-b762-8d57ecba6b6c tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lazy-loading 'fault' on Instance uuid 7fb9f502-78ea-4787-8899-743c71d590e6 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 06 17:20:12.613289 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0ae9a100-4127-4ab2-b762-8d57ecba6b6c tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:20:12.621101 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0ae9a100-4127-4ab2-b762-8d57ecba6b6c tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6" status: 200 len: 1185 microversion: 2.1 time: 0.132809 Apr 06 17:20:12.624726 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1721/3445] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:20:12 2022] GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6 => generated 1185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:20:13.642994 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3890a82e-3e2d-4b0f-a97f-a0e66170c5f1 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:20:13.644323 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3890a82e-3e2d-4b0f-a97f-a0e66170c5f1 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 7fb9f502-78ea-4787-8899-743c71d590e6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:20:13.652078 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3890a82e-3e2d-4b0f-a97f-a0e66170c5f1 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:13.652723 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3890a82e-3e2d-4b0f-a97f-a0e66170c5f1 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:13.653796 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3890a82e-3e2d-4b0f-a97f-a0e66170c5f1 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:13.654306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3890a82e-3e2d-4b0f-a97f-a0e66170c5f1 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:13.670716 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-3890a82e-3e2d-4b0f-a97f-a0e66170c5f1 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] HTTP exception thrown: Instance 7fb9f502-78ea-4787-8899-743c71d590e6 could not be found. Apr 06 17:20:13.671320 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3890a82e-3e2d-4b0f-a97f-a0e66170c5f1 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Returning 404 to user: Instance 7fb9f502-78ea-4787-8899-743c71d590e6 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:20:13.672166 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3890a82e-3e2d-4b0f-a97f-a0e66170c5f1 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6" status: 404 len: 111 microversion: 2.1 time: 0.035554 Apr 06 17:20:13.672769 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1725/3446] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:20:13 2022] GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:20:13.778059 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bad3c205-3991-4c9d-aa56-8d2f86a4e6d8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1062784679", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2132919883", "security_groups": [{"name": "tempest-secgroup-smoke-706301784"}], "block_device_mapping_v2": [{"uuid": "88f0c570-23a0-4ae6-b99c-c0444b439b88", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "85bbf121-bd26-449c-a399-89da35ff4bb5"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:20:13.945133 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-bad3c205-3991-4c9d-aa56-8d2f86a4e6d8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] validate_networks() for [('85bbf121-bd26-449c-a399-89da35ff4bb5', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 06 17:20:14.569665 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-bad3c205-3991-4c9d-aa56-8d2f86a4e6d8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 06 17:20:14.570108 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-bad3c205-3991-4c9d-aa56-8d2f86a4e6d8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 06 17:20:14.570656 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-bad3c205-3991-4c9d-aa56-8d2f86a4e6d8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 06 17:20:14.570979 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-bad3c205-3991-4c9d-aa56-8d2f86a4e6d8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 06 17:20:14.571383 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-bad3c205-3991-4c9d-aa56-8d2f86a4e6d8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 06 17:20:14.582171 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bad3c205-3991-4c9d-aa56-8d2f86a4e6d8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:14.582625 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bad3c205-3991-4c9d-aa56-8d2f86a4e6d8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:14.583419 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bad3c205-3991-4c9d-aa56-8d2f86a4e6d8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:14.583849 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bad3c205-3991-4c9d-aa56-8d2f86a4e6d8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:14.602368 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-bad3c205-3991-4c9d-aa56-8d2f86a4e6d8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Getting quotas for project d80fa131c3864ec191ac904b9e290dbc. Resources: {'instances', 'cores', 'ram'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 17:20:14.607172 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-bad3c205-3991-4c9d-aa56-8d2f86a4e6d8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Getting quotas for user 7c1e03597fc34d69b97096c60a4b5be1 and project d80fa131c3864ec191ac904b9e290dbc. Resources: {'instances', 'cores', 'ram'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 17:20:14.672515 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bad3c205-3991-4c9d-aa56-8d2f86a4e6d8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 06 17:20:14.674762 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bad3c205-3991-4c9d-aa56-8d2f86a4e6d8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 07317980-54b7-47cb-b8df-4152ab005b87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='88f0c570-23a0-4ae6-b99c-c0444b439b88',volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 06 17:20:14.827073 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bad3c205-3991-4c9d-aa56-8d2f86a4e6d8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.052936 Apr 06 17:20:14.828078 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1722/3447] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Apr 6 17:20:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 06 17:20:14.841761 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7e0b5e6c-9fbb-4ed1-8aa6-9fa5753d72b9 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:20:14.842353 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7e0b5e6c-9fbb-4ed1-8aa6-9fa5753d72b9 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 07317980-54b7-47cb-b8df-4152ab005b87] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:20:14.904294 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7e0b5e6c-9fbb-4ed1-8aa6-9fa5753d72b9 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:20:14.914266 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7e0b5e6c-9fbb-4ed1-8aa6-9fa5753d72b9 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87" status: 200 len: 1095 microversion: 2.1 time: 0.079692 Apr 06 17:20:14.914932 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1726/3448] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:20:14 2022] GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87 => generated 1095 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:20:15.933042 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dc644afc-a96e-4f2f-8b73-24fc4222cfa1 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:20:15.934615 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dc644afc-a96e-4f2f-8b73-24fc4222cfa1 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 07317980-54b7-47cb-b8df-4152ab005b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:20:15.945073 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc644afc-a96e-4f2f-8b73-24fc4222cfa1 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:15.945808 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc644afc-a96e-4f2f-8b73-24fc4222cfa1 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:15.946653 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc644afc-a96e-4f2f-8b73-24fc4222cfa1 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:15.947268 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc644afc-a96e-4f2f-8b73-24fc4222cfa1 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:16.027136 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-dc644afc-a96e-4f2f-8b73-24fc4222cfa1 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:20:16.046397 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dc644afc-a96e-4f2f-8b73-24fc4222cfa1 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87" status: 200 len: 1193 microversion: 2.1 time: 0.118441 Apr 06 17:20:16.047249 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1723/3449] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:20:15 2022] GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87 => generated 1193 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:20:17.071683 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d92e12d9-c700-4c38-8eac-86ab98d0c5c2 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:20:17.071683 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d92e12d9-c700-4c38-8eac-86ab98d0c5c2 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 07317980-54b7-47cb-b8df-4152ab005b87] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:20:17.077699 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d92e12d9-c700-4c38-8eac-86ab98d0c5c2 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:17.078154 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d92e12d9-c700-4c38-8eac-86ab98d0c5c2 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:17.079099 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d92e12d9-c700-4c38-8eac-86ab98d0c5c2 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:17.079540 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d92e12d9-c700-4c38-8eac-86ab98d0c5c2 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:17.318903 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d92e12d9-c700-4c38-8eac-86ab98d0c5c2 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:20:17.338098 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d92e12d9-c700-4c38-8eac-86ab98d0c5c2 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87" status: 200 len: 1266 microversion: 2.1 time: 0.274694 Apr 06 17:20:17.349932 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1727/3450] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:20:17 2022] GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87 => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:20:17.828539 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-ce81a660-21fa-45b5-9107-d07385212bcc req-8bbe1eec-b94c-4ef0-a093-ba3a88515c37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07317980-54b7-47cb-b8df-4152ab005b87", "tag": "638cdf56-1af6-4e4a-900d-b7a3902711ad"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:20:17.857544 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ce81a660-21fa-45b5-9107-d07385212bcc req-8bbe1eec-b94c-4ef0-a093-ba3a88515c37 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:17.859655 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ce81a660-21fa-45b5-9107-d07385212bcc req-8bbe1eec-b94c-4ef0-a093-ba3a88515c37 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:17.876306 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-ce81a660-21fa-45b5-9107-d07385212bcc req-8bbe1eec-b94c-4ef0-a093-ba3a88515c37 service nova] Creating event network-changed:638cdf56-1af6-4e4a-900d-b7a3902711ad for instance 07317980-54b7-47cb-b8df-4152ab005b87 on hv-cinder-83684 Apr 06 17:20:17.884146 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-ce81a660-21fa-45b5-9107-d07385212bcc req-8bbe1eec-b94c-4ef0-a093-ba3a88515c37 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063423 Apr 06 17:20:17.885339 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1724/3451] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:20:18.198316 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:20:18.199088 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 17:20:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:20:18.357309 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a82b7056-684b-4d56-a8b6-c055dd74f326 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:20:18.357983 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a82b7056-684b-4d56-a8b6-c055dd74f326 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 07317980-54b7-47cb-b8df-4152ab005b87] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:20:18.366530 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a82b7056-684b-4d56-a8b6-c055dd74f326 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:18.367143 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a82b7056-684b-4d56-a8b6-c055dd74f326 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:18.368336 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a82b7056-684b-4d56-a8b6-c055dd74f326 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:18.369060 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a82b7056-684b-4d56-a8b6-c055dd74f326 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:18.538445 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a82b7056-684b-4d56-a8b6-c055dd74f326 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:20:18.547362 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a82b7056-684b-4d56-a8b6-c055dd74f326 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87" status: 200 len: 1266 microversion: 2.1 time: 0.194534 Apr 06 17:20:18.547947 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1728/3452] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:20:18 2022] GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:20:19.569191 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8c43bde0-9e52-4117-9d20-6e2b304d9b56 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:20:19.570600 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8c43bde0-9e52-4117-9d20-6e2b304d9b56 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 07317980-54b7-47cb-b8df-4152ab005b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:20:19.579524 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c43bde0-9e52-4117-9d20-6e2b304d9b56 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:19.580303 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c43bde0-9e52-4117-9d20-6e2b304d9b56 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:19.581407 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c43bde0-9e52-4117-9d20-6e2b304d9b56 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:19.582290 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c43bde0-9e52-4117-9d20-6e2b304d9b56 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:19.786871 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8c43bde0-9e52-4117-9d20-6e2b304d9b56 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:20:19.795235 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8c43bde0-9e52-4117-9d20-6e2b304d9b56 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87" status: 200 len: 1266 microversion: 2.1 time: 0.231226 Apr 06 17:20:19.796740 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1725/3453] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:20:19 2022] GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87 => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:20:20.820565 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-6c12ad99-11c9-4532-b2fb-f4264169c710 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:20:20.821561 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-6c12ad99-11c9-4532-b2fb-f4264169c710 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 07317980-54b7-47cb-b8df-4152ab005b87] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:20:20.830789 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c12ad99-11c9-4532-b2fb-f4264169c710 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:20.831525 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c12ad99-11c9-4532-b2fb-f4264169c710 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:20.832401 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c12ad99-11c9-4532-b2fb-f4264169c710 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:20.832943 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-6c12ad99-11c9-4532-b2fb-f4264169c710 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:21.006436 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-6c12ad99-11c9-4532-b2fb-f4264169c710 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:20:21.013979 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-6c12ad99-11c9-4532-b2fb-f4264169c710 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87" status: 200 len: 1266 microversion: 2.1 time: 0.198930 Apr 06 17:20:21.014734 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1729/3454] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:20:20 2022] GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:20:22.036449 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0a290317-ce5d-471e-a55b-0ee9011c858e tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:20:22.037107 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0a290317-ce5d-471e-a55b-0ee9011c858e tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 07317980-54b7-47cb-b8df-4152ab005b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:20:22.043761 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a290317-ce5d-471e-a55b-0ee9011c858e tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:22.044396 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a290317-ce5d-471e-a55b-0ee9011c858e tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:22.045213 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a290317-ce5d-471e-a55b-0ee9011c858e tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:22.045640 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a290317-ce5d-471e-a55b-0ee9011c858e tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:22.196239 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-0a290317-ce5d-471e-a55b-0ee9011c858e tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:20:22.204499 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0a290317-ce5d-471e-a55b-0ee9011c858e tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87" status: 200 len: 1266 microversion: 2.1 time: 0.172505 Apr 06 17:20:22.205111 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1726/3455] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:20:22 2022] GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:20:23.222526 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-12096ca6-61af-486c-9db0-50db3ad59350 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:20:23.223109 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-12096ca6-61af-486c-9db0-50db3ad59350 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 07317980-54b7-47cb-b8df-4152ab005b87] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:20:23.229672 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12096ca6-61af-486c-9db0-50db3ad59350 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:23.230117 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12096ca6-61af-486c-9db0-50db3ad59350 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:23.230873 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12096ca6-61af-486c-9db0-50db3ad59350 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:23.231301 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-12096ca6-61af-486c-9db0-50db3ad59350 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:23.379053 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-12096ca6-61af-486c-9db0-50db3ad59350 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:20:23.387190 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-12096ca6-61af-486c-9db0-50db3ad59350 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87" status: 200 len: 1266 microversion: 2.1 time: 0.168973 Apr 06 17:20:23.387781 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1730/3456] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:20:23 2022] GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:20:24.093099 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:20:24.093306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 17:20:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:20:24.406916 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-480b31f0-eb5d-4858-9906-e67a14c1910a tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:20:24.407825 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-480b31f0-eb5d-4858-9906-e67a14c1910a tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 07317980-54b7-47cb-b8df-4152ab005b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:20:24.414817 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-480b31f0-eb5d-4858-9906-e67a14c1910a tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:24.415265 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-480b31f0-eb5d-4858-9906-e67a14c1910a tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:24.416044 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-480b31f0-eb5d-4858-9906-e67a14c1910a tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:24.416478 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-480b31f0-eb5d-4858-9906-e67a14c1910a tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:24.571100 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-480b31f0-eb5d-4858-9906-e67a14c1910a tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:20:24.579643 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-480b31f0-eb5d-4858-9906-e67a14c1910a tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87" status: 200 len: 1266 microversion: 2.1 time: 0.176789 Apr 06 17:20:24.580146 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1727/3457] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:20:24 2022] GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:20:25.598286 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-548a4027-a185-41a9-b9fc-55298a7b60f4 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:20:25.598896 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-548a4027-a185-41a9-b9fc-55298a7b60f4 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 07317980-54b7-47cb-b8df-4152ab005b87] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:20:25.605856 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-548a4027-a185-41a9-b9fc-55298a7b60f4 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:25.606305 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-548a4027-a185-41a9-b9fc-55298a7b60f4 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:25.607084 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-548a4027-a185-41a9-b9fc-55298a7b60f4 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:25.607529 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-548a4027-a185-41a9-b9fc-55298a7b60f4 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:25.755926 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-548a4027-a185-41a9-b9fc-55298a7b60f4 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:20:25.763501 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-548a4027-a185-41a9-b9fc-55298a7b60f4 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87" status: 200 len: 1266 microversion: 2.1 time: 0.169321 Apr 06 17:20:25.764085 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1731/3458] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:20:25 2022] GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:20:26.785678 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1c0391c7-51b7-4d07-b0cd-91e47049ec3e tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:20:26.787085 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1c0391c7-51b7-4d07-b0cd-91e47049ec3e tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 07317980-54b7-47cb-b8df-4152ab005b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:20:26.796052 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c0391c7-51b7-4d07-b0cd-91e47049ec3e tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:26.796560 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c0391c7-51b7-4d07-b0cd-91e47049ec3e tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:26.797576 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c0391c7-51b7-4d07-b0cd-91e47049ec3e tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:26.797923 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c0391c7-51b7-4d07-b0cd-91e47049ec3e tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:26.951300 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-1c0391c7-51b7-4d07-b0cd-91e47049ec3e tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:20:26.960334 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1c0391c7-51b7-4d07-b0cd-91e47049ec3e tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87" status: 200 len: 1266 microversion: 2.1 time: 0.179400 Apr 06 17:20:26.960969 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1728/3459] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:20:26 2022] GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:20:27.977942 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4663e3c1-9a86-4943-891d-13475882bef2 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:20:27.978547 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4663e3c1-9a86-4943-891d-13475882bef2 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 07317980-54b7-47cb-b8df-4152ab005b87] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:20:27.987300 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4663e3c1-9a86-4943-891d-13475882bef2 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:27.987935 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4663e3c1-9a86-4943-891d-13475882bef2 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:27.989141 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4663e3c1-9a86-4943-891d-13475882bef2 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:27.989780 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4663e3c1-9a86-4943-891d-13475882bef2 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:28.141905 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4663e3c1-9a86-4943-891d-13475882bef2 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:20:28.150233 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4663e3c1-9a86-4943-891d-13475882bef2 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87" status: 200 len: 1266 microversion: 2.1 time: 0.176228 Apr 06 17:20:28.150818 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1732/3460] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:20:27 2022] GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:20:28.760606 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-60bea35a-8a8c-4852-aa52-36ec3f704937 req-e5dc7a6b-fc29-4e4d-8847-c566bad3dcab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07317980-54b7-47cb-b8df-4152ab005b87", "name": "network-vif-plugged", "status": "completed", "tag": "638cdf56-1af6-4e4a-900d-b7a3902711ad"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:20:28.770687 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-60bea35a-8a8c-4852-aa52-36ec3f704937 req-e5dc7a6b-fc29-4e4d-8847-c566bad3dcab service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:28.771141 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-60bea35a-8a8c-4852-aa52-36ec3f704937 req-e5dc7a6b-fc29-4e4d-8847-c566bad3dcab service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:28.782207 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-60bea35a-8a8c-4852-aa52-36ec3f704937 req-e5dc7a6b-fc29-4e4d-8847-c566bad3dcab service nova] Creating event network-vif-plugged:638cdf56-1af6-4e4a-900d-b7a3902711ad for instance 07317980-54b7-47cb-b8df-4152ab005b87 on hv-cinder-83684 Apr 06 17:20:28.787503 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-60bea35a-8a8c-4852-aa52-36ec3f704937 req-e5dc7a6b-fc29-4e4d-8847-c566bad3dcab service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177128 Apr 06 17:20:28.788071 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1729/3461] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:20:29.167794 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f171112b-b00b-4be1-b345-b49684156630 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:20:29.168438 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f171112b-b00b-4be1-b345-b49684156630 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 07317980-54b7-47cb-b8df-4152ab005b87] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:20:29.175668 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f171112b-b00b-4be1-b345-b49684156630 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:29.176154 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f171112b-b00b-4be1-b345-b49684156630 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:29.177039 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f171112b-b00b-4be1-b345-b49684156630 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:29.177473 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f171112b-b00b-4be1-b345-b49684156630 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:29.332981 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f171112b-b00b-4be1-b345-b49684156630 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:20:29.347477 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f171112b-b00b-4be1-b345-b49684156630 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87" status: 200 len: 1266 microversion: 2.1 time: 0.182897 Apr 06 17:20:29.348424 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1733/3462] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:20:29 2022] GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:20:30.367154 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8ee08013-ba2f-4d8b-b214-be78a21c8153 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:20:30.367938 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8ee08013-ba2f-4d8b-b214-be78a21c8153 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 07317980-54b7-47cb-b8df-4152ab005b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:20:30.374866 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ee08013-ba2f-4d8b-b214-be78a21c8153 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:30.375378 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ee08013-ba2f-4d8b-b214-be78a21c8153 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:30.376174 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ee08013-ba2f-4d8b-b214-be78a21c8153 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:30.376654 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ee08013-ba2f-4d8b-b214-be78a21c8153 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:30.529321 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8ee08013-ba2f-4d8b-b214-be78a21c8153 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:20:30.537521 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8ee08013-ba2f-4d8b-b214-be78a21c8153 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87" status: 200 len: 1266 microversion: 2.1 time: 0.175520 Apr 06 17:20:30.538113 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1730/3463] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:20:30 2022] GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:20:31.554742 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d26ff378-0719-4c08-adc0-6bf2e9e5e72a tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:20:31.555331 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d26ff378-0719-4c08-adc0-6bf2e9e5e72a tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 07317980-54b7-47cb-b8df-4152ab005b87] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:20:31.568604 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d26ff378-0719-4c08-adc0-6bf2e9e5e72a tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:31.569191 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d26ff378-0719-4c08-adc0-6bf2e9e5e72a tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:31.570137 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d26ff378-0719-4c08-adc0-6bf2e9e5e72a tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:31.570585 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d26ff378-0719-4c08-adc0-6bf2e9e5e72a tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:31.721079 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d26ff378-0719-4c08-adc0-6bf2e9e5e72a tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:20:31.729552 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d26ff378-0719-4c08-adc0-6bf2e9e5e72a tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87" status: 200 len: 1453 microversion: 2.1 time: 0.178884 Apr 06 17:20:31.730365 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1734/3464] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:20:31 2022] GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87 => generated 1453 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:20:31.747044 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4ec12012-6bdb-472d-8f20-0ccc331aaf74 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:20:31.747607 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4ec12012-6bdb-472d-8f20-0ccc331aaf74 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 07317980-54b7-47cb-b8df-4152ab005b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:20:31.754163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ec12012-6bdb-472d-8f20-0ccc331aaf74 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:31.754617 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ec12012-6bdb-472d-8f20-0ccc331aaf74 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:31.755384 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ec12012-6bdb-472d-8f20-0ccc331aaf74 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:31.755820 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ec12012-6bdb-472d-8f20-0ccc331aaf74 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:31.915065 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-4ec12012-6bdb-472d-8f20-0ccc331aaf74 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:20:31.922911 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4ec12012-6bdb-472d-8f20-0ccc331aaf74 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87" status: 200 len: 1453 microversion: 2.1 time: 0.179837 Apr 06 17:20:31.923451 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1731/3465] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:20:31 2022] GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87 => generated 1453 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:20:33.007071 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:20:33.007907 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 17:20:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:20:34.078185 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-d80f520a-38b0-4bbe-aa89-a1031b71d097 req-839ec869-fca1-4a8b-966a-f3e9d0523760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07317980-54b7-47cb-b8df-4152ab005b87", "tag": "638cdf56-1af6-4e4a-900d-b7a3902711ad"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:20:34.088530 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d80f520a-38b0-4bbe-aa89-a1031b71d097 req-839ec869-fca1-4a8b-966a-f3e9d0523760 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:20:34.088911 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-d80f520a-38b0-4bbe-aa89-a1031b71d097 req-839ec869-fca1-4a8b-966a-f3e9d0523760 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:20:34.100370 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-d80f520a-38b0-4bbe-aa89-a1031b71d097 req-839ec869-fca1-4a8b-966a-f3e9d0523760 service nova] Creating event network-changed:638cdf56-1af6-4e4a-900d-b7a3902711ad for instance 07317980-54b7-47cb-b8df-4152ab005b87 on hv-cinder-83684 Apr 06 17:20:34.105840 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-d80f520a-38b0-4bbe-aa89-a1031b71d097 req-839ec869-fca1-4a8b-966a-f3e9d0523760 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031386 Apr 06 17:20:34.106637 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1735/3466] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:21:06.223562 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f554e3c9-f194-4901-9662-5887d7d966e7 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Action: 'create', calling method: .version_select at 0x7fa9cf0f8dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1182119716"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:21:06.239937 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-f554e3c9-f194-4901-9662-5887d7d966e7 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Getting quotas for project 44ecd2071a704b60b72c2b81c2595cc0. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 17:21:06.245603 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-f554e3c9-f194-4901-9662-5887d7d966e7 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Getting quotas for user 4b405ad574b74a9ebeb7c13970d3313e and project 44ecd2071a704b60b72c2b81c2595cc0. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 17:21:06.784131 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-f554e3c9-f194-4901-9662-5887d7d966e7 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Getting quotas for project 44ecd2071a704b60b72c2b81c2595cc0. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 17:21:06.789790 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-f554e3c9-f194-4901-9662-5887d7d966e7 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Getting quotas for user 4b405ad574b74a9ebeb7c13970d3313e and project 44ecd2071a704b60b72c2b81c2595cc0. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 17:21:06.805495 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f554e3c9-f194-4901-9662-5887d7d966e7 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.773973 Apr 06 17:21:06.811220 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1732/3467] 10.222.0.64 () {60 vars in 1157 bytes} [Wed Apr 6 17:21:06 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:21:23.577753 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-eb0e81e3-ad7e-44da-b562-0a6d75654383 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1058518287", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1182119716", "security_groups": [{"name": "tempest-secgroup-smoke-591041639"}], "networks": [{"uuid": "f9e9c72b-83a5-43f0-a149-26bb030e2174"}], "block_device_mapping_v2": [{"uuid": "36ae6b94-ed4f-455c-8c39-d60824920bd3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:21:23.723200 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.network.neutron [None req-eb0e81e3-ad7e-44da-b562-0a6d75654383 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] validate_networks() for [('f9e9c72b-83a5-43f0-a149-26bb030e2174', None, None, None, None, None)] {{(pid=128861) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 06 17:21:24.144116 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-eb0e81e3-ad7e-44da-b562-0a6d75654383 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Flavor limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 06 17:21:24.144984 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-eb0e81e3-ad7e-44da-b562-0a6d75654383 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Image limits 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 06 17:21:24.145558 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-eb0e81e3-ad7e-44da-b562-0a6d75654383 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Flavor pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 06 17:21:24.146100 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-eb0e81e3-ad7e-44da-b562-0a6d75654383 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Image pref 0:0:0 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 06 17:21:24.146516 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.virt.hardware [None req-eb0e81e3-ad7e-44da-b562-0a6d75654383 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 06 17:21:24.155952 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb0e81e3-ad7e-44da-b562-0a6d75654383 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:24.156404 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb0e81e3-ad7e-44da-b562-0a6d75654383 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:24.157227 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb0e81e3-ad7e-44da-b562-0a6d75654383 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:24.157661 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-eb0e81e3-ad7e-44da-b562-0a6d75654383 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:24.175244 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-eb0e81e3-ad7e-44da-b562-0a6d75654383 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Getting quotas for project 44ecd2071a704b60b72c2b81c2595cc0. Resources: {'instances', 'cores', 'ram'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 17:21:24.180129 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.quota [None req-eb0e81e3-ad7e-44da-b562-0a6d75654383 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Getting quotas for user 4b405ad574b74a9ebeb7c13970d3313e and project 44ecd2071a704b60b72c2b81c2595cc0. Resources: {'instances', 'cores', 'ram'} {{(pid=128861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 17:21:24.244270 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eb0e81e3-ad7e-44da-b562-0a6d75654383 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Going to run 1 instances... {{(pid=128861) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 06 17:21:24.246594 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-eb0e81e3-ad7e-44da-b562-0a6d75654383 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='36ae6b94-ed4f-455c-8c39-d60824920bd3',volume_size=None,volume_type=None)] {{(pid=128861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 06 17:21:24.415489 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-eb0e81e3-ad7e-44da-b562-0a6d75654383 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.842378 Apr 06 17:21:24.416717 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1736/3468] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Apr 6 17:21:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 06 17:21:24.431881 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-685780e1-52ae-411a-b766-fb8e2bea586e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:21:24.432899 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-685780e1-52ae-411a-b766-fb8e2bea586e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:21:24.504589 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-685780e1-52ae-411a-b766-fb8e2bea586e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:21:24.516197 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-685780e1-52ae-411a-b766-fb8e2bea586e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1089 microversion: 2.1 time: 0.091186 Apr 06 17:21:24.517071 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1733/3469] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:21:24 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1089 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:21:25.538882 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f88d0ee4-6bfc-4d34-8767-196cf7055cae tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:21:25.544918 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f88d0ee4-6bfc-4d34-8767-196cf7055cae tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:21:25.547329 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f88d0ee4-6bfc-4d34-8767-196cf7055cae tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:25.547844 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f88d0ee4-6bfc-4d34-8767-196cf7055cae tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:25.548712 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f88d0ee4-6bfc-4d34-8767-196cf7055cae tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:25.549224 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f88d0ee4-6bfc-4d34-8767-196cf7055cae tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:25.634488 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f88d0ee4-6bfc-4d34-8767-196cf7055cae tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:21:25.649205 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f88d0ee4-6bfc-4d34-8767-196cf7055cae tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1195 microversion: 2.1 time: 0.114568 Apr 06 17:21:25.650324 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1737/3470] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:21:25 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1195 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:21:26.678123 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b0f94912-0bc0-4cf5-a50a-2b9927ef4c6c tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:21:26.682289 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b0f94912-0bc0-4cf5-a50a-2b9927ef4c6c tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:21:26.693315 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0f94912-0bc0-4cf5-a50a-2b9927ef4c6c tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:26.694055 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0f94912-0bc0-4cf5-a50a-2b9927ef4c6c tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:26.695127 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0f94912-0bc0-4cf5-a50a-2b9927ef4c6c tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:26.695698 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0f94912-0bc0-4cf5-a50a-2b9927ef4c6c tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:26.968600 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b0f94912-0bc0-4cf5-a50a-2b9927ef4c6c tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:21:26.977027 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b0f94912-0bc0-4cf5-a50a-2b9927ef4c6c tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1260 microversion: 2.1 time: 0.305242 Apr 06 17:21:26.977620 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1734/3471] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:21:26 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1260 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:21:27.573646 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-2639fc12-336c-4ea7-a0b7-6a8f83dfcbb7 req-c79a7b8e-f9e1-472c-b18b-af6a9a39d938 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aeb06f7-067b-45d6-9df7-427975ce3532", "tag": "4166ed5e-e08c-4143-8981-39421971dd87"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:21:27.584064 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2639fc12-336c-4ea7-a0b7-6a8f83dfcbb7 req-c79a7b8e-f9e1-472c-b18b-af6a9a39d938 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:27.584539 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-2639fc12-336c-4ea7-a0b7-6a8f83dfcbb7 req-c79a7b8e-f9e1-472c-b18b-af6a9a39d938 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:27.602746 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-2639fc12-336c-4ea7-a0b7-6a8f83dfcbb7 req-c79a7b8e-f9e1-472c-b18b-af6a9a39d938 service nova] Creating event network-changed:4166ed5e-e08c-4143-8981-39421971dd87 for instance 7aeb06f7-067b-45d6-9df7-427975ce3532 on hv-cinder-83684 Apr 06 17:21:27.609630 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-2639fc12-336c-4ea7-a0b7-6a8f83dfcbb7 req-c79a7b8e-f9e1-472c-b18b-af6a9a39d938 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039638 Apr 06 17:21:27.610644 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1738/3472] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 17:21:27.997193 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8decdf65-338a-4210-9677-8beccea43973 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:21:27.998025 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8decdf65-338a-4210-9677-8beccea43973 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:21:28.005599 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8decdf65-338a-4210-9677-8beccea43973 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:28.006414 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8decdf65-338a-4210-9677-8beccea43973 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:28.007271 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8decdf65-338a-4210-9677-8beccea43973 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:28.007961 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8decdf65-338a-4210-9677-8beccea43973 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:28.230031 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8decdf65-338a-4210-9677-8beccea43973 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:21:28.240211 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8decdf65-338a-4210-9677-8beccea43973 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1260 microversion: 2.1 time: 0.248547 Apr 06 17:21:28.240856 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1735/3473] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:21:27 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1260 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:21:29.260341 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-783681cf-c3b3-4917-9e70-66d5a4b467b1 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:21:29.260954 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-783681cf-c3b3-4917-9e70-66d5a4b467b1 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:21:29.268058 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-783681cf-c3b3-4917-9e70-66d5a4b467b1 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:29.268629 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-783681cf-c3b3-4917-9e70-66d5a4b467b1 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:29.269608 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-783681cf-c3b3-4917-9e70-66d5a4b467b1 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:29.270327 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-783681cf-c3b3-4917-9e70-66d5a4b467b1 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:29.439220 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-783681cf-c3b3-4917-9e70-66d5a4b467b1 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:21:29.448545 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-783681cf-c3b3-4917-9e70-66d5a4b467b1 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1260 microversion: 2.1 time: 0.193588 Apr 06 17:21:29.449178 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1739/3474] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:21:29 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:21:30.469253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-228f39fc-1480-40ce-bb17-c5cd1fe41ac1 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:21:30.469875 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-228f39fc-1480-40ce-bb17-c5cd1fe41ac1 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:21:30.477700 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-228f39fc-1480-40ce-bb17-c5cd1fe41ac1 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:30.478449 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-228f39fc-1480-40ce-bb17-c5cd1fe41ac1 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:30.479396 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-228f39fc-1480-40ce-bb17-c5cd1fe41ac1 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:30.479829 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-228f39fc-1480-40ce-bb17-c5cd1fe41ac1 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:30.639763 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-228f39fc-1480-40ce-bb17-c5cd1fe41ac1 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:21:30.647838 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-228f39fc-1480-40ce-bb17-c5cd1fe41ac1 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1260 microversion: 2.1 time: 0.184385 Apr 06 17:21:30.648815 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1736/3475] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:21:30 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:21:31.665880 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d9e6db1c-4c9f-4daa-89a9-503ac4d6e81e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:21:31.666497 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d9e6db1c-4c9f-4daa-89a9-503ac4d6e81e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:21:31.673595 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9e6db1c-4c9f-4daa-89a9-503ac4d6e81e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:31.674103 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9e6db1c-4c9f-4daa-89a9-503ac4d6e81e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:31.674912 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9e6db1c-4c9f-4daa-89a9-503ac4d6e81e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:31.675345 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d9e6db1c-4c9f-4daa-89a9-503ac4d6e81e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:31.825028 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-d9e6db1c-4c9f-4daa-89a9-503ac4d6e81e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:21:31.832926 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d9e6db1c-4c9f-4daa-89a9-503ac4d6e81e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1260 microversion: 2.1 time: 0.171376 Apr 06 17:21:31.833491 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1740/3476] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:21:31 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:21:32.851796 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-286850d6-1fc4-44a2-a3fa-0434b75de287 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:21:32.852579 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-286850d6-1fc4-44a2-a3fa-0434b75de287 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:21:32.859115 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-286850d6-1fc4-44a2-a3fa-0434b75de287 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:32.859585 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-286850d6-1fc4-44a2-a3fa-0434b75de287 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:32.860394 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-286850d6-1fc4-44a2-a3fa-0434b75de287 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:32.860856 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-286850d6-1fc4-44a2-a3fa-0434b75de287 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:33.024842 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-286850d6-1fc4-44a2-a3fa-0434b75de287 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:21:33.034264 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-286850d6-1fc4-44a2-a3fa-0434b75de287 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1260 microversion: 2.1 time: 0.186661 Apr 06 17:21:33.035190 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1737/3477] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:21:32 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:21:34.058988 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b338d5c9-b143-4dc9-b7c3-f0a25bc79ba6 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:21:34.059617 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b338d5c9-b143-4dc9-b7c3-f0a25bc79ba6 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:21:34.066905 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b338d5c9-b143-4dc9-b7c3-f0a25bc79ba6 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:34.067502 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b338d5c9-b143-4dc9-b7c3-f0a25bc79ba6 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:34.068287 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b338d5c9-b143-4dc9-b7c3-f0a25bc79ba6 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:34.068727 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b338d5c9-b143-4dc9-b7c3-f0a25bc79ba6 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:34.233888 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b338d5c9-b143-4dc9-b7c3-f0a25bc79ba6 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:21:34.242578 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b338d5c9-b143-4dc9-b7c3-f0a25bc79ba6 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1260 microversion: 2.1 time: 0.194664 Apr 06 17:21:34.243167 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1741/3478] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:21:34 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1260 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:21:35.265368 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-731e300d-5c12-4b06-9195-f2c3ea0a1877 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:21:35.266024 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-731e300d-5c12-4b06-9195-f2c3ea0a1877 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:21:35.273505 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-731e300d-5c12-4b06-9195-f2c3ea0a1877 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:35.274084 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-731e300d-5c12-4b06-9195-f2c3ea0a1877 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:35.274874 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-731e300d-5c12-4b06-9195-f2c3ea0a1877 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:35.275305 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-731e300d-5c12-4b06-9195-f2c3ea0a1877 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:35.443775 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-731e300d-5c12-4b06-9195-f2c3ea0a1877 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:21:35.452655 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-731e300d-5c12-4b06-9195-f2c3ea0a1877 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1260 microversion: 2.1 time: 0.191141 Apr 06 17:21:35.453429 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1738/3479] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:21:35 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1260 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:21:36.473533 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a596444e-a872-4739-980d-f7da8b32e4de tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:21:36.474275 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a596444e-a872-4739-980d-f7da8b32e4de tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:21:36.481278 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a596444e-a872-4739-980d-f7da8b32e4de tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:36.481710 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a596444e-a872-4739-980d-f7da8b32e4de tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:36.482473 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a596444e-a872-4739-980d-f7da8b32e4de tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:36.482924 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a596444e-a872-4739-980d-f7da8b32e4de tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:36.653553 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a596444e-a872-4739-980d-f7da8b32e4de tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:21:36.666007 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a596444e-a872-4739-980d-f7da8b32e4de tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1260 microversion: 2.1 time: 0.197510 Apr 06 17:21:36.666770 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1742/3480] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:21:36 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:21:37.688832 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e2f55213-d558-4844-a18e-9fee4a2587f9 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:21:37.689684 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e2f55213-d558-4844-a18e-9fee4a2587f9 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:21:37.697901 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2f55213-d558-4844-a18e-9fee4a2587f9 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:37.698347 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2f55213-d558-4844-a18e-9fee4a2587f9 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:37.699114 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2f55213-d558-4844-a18e-9fee4a2587f9 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:37.699535 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2f55213-d558-4844-a18e-9fee4a2587f9 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:37.888049 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e2f55213-d558-4844-a18e-9fee4a2587f9 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:21:37.896454 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e2f55213-d558-4844-a18e-9fee4a2587f9 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1260 microversion: 2.1 time: 0.211732 Apr 06 17:21:37.897095 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1739/3481] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:21:37 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:21:38.924156 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-73ad944c-cf0b-4e03-9d28-45c63b73f453 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:21:38.925343 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-73ad944c-cf0b-4e03-9d28-45c63b73f453 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:21:38.933978 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-ec039b7b-2a8d-4f87-a544-100f73b3befb req-b4d6cf3b-12fd-4aac-8329-a1a46c9da60c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aeb06f7-067b-45d6-9df7-427975ce3532", "name": "network-vif-plugged", "status": "completed", "tag": "4166ed5e-e08c-4143-8981-39421971dd87"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:21:38.936613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73ad944c-cf0b-4e03-9d28-45c63b73f453 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:38.937110 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73ad944c-cf0b-4e03-9d28-45c63b73f453 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:38.938330 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73ad944c-cf0b-4e03-9d28-45c63b73f453 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:38.938905 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-73ad944c-cf0b-4e03-9d28-45c63b73f453 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:38.950301 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ec039b7b-2a8d-4f87-a544-100f73b3befb req-b4d6cf3b-12fd-4aac-8329-a1a46c9da60c service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:38.951047 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ec039b7b-2a8d-4f87-a544-100f73b3befb req-b4d6cf3b-12fd-4aac-8329-a1a46c9da60c service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:38.970268 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-ec039b7b-2a8d-4f87-a544-100f73b3befb req-b4d6cf3b-12fd-4aac-8329-a1a46c9da60c service nova] Creating event network-vif-plugged:4166ed5e-e08c-4143-8981-39421971dd87 for instance 7aeb06f7-067b-45d6-9df7-427975ce3532 on hv-cinder-83684 Apr 06 17:21:38.978718 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-ec039b7b-2a8d-4f87-a544-100f73b3befb req-b4d6cf3b-12fd-4aac-8329-a1a46c9da60c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049077 Apr 06 17:21:38.979539 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1740/3482] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 17:21:39.135163 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-73ad944c-cf0b-4e03-9d28-45c63b73f453 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:21:39.151074 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-73ad944c-cf0b-4e03-9d28-45c63b73f453 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1260 microversion: 2.1 time: 0.239920 Apr 06 17:21:39.152000 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1743/3483] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:21:38 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1260 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:21:40.176835 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-08def4a9-d606-4262-8e34-4587f6cccd7d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:21:40.177535 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-08def4a9-d606-4262-8e34-4587f6cccd7d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:21:40.184264 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08def4a9-d606-4262-8e34-4587f6cccd7d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:40.184727 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08def4a9-d606-4262-8e34-4587f6cccd7d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:40.185519 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08def4a9-d606-4262-8e34-4587f6cccd7d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:40.185954 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08def4a9-d606-4262-8e34-4587f6cccd7d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:40.351790 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-08def4a9-d606-4262-8e34-4587f6cccd7d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:21:40.359615 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-08def4a9-d606-4262-8e34-4587f6cccd7d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1260 microversion: 2.1 time: 0.187829 Apr 06 17:21:40.360182 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1741/3484] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:21:40 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:21:41.376893 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-95292446-a3a8-4f3d-87e2-77c7d00411ad tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:21:41.377658 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-95292446-a3a8-4f3d-87e2-77c7d00411ad tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:21:41.384220 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95292446-a3a8-4f3d-87e2-77c7d00411ad tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:41.384672 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95292446-a3a8-4f3d-87e2-77c7d00411ad tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:41.385558 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95292446-a3a8-4f3d-87e2-77c7d00411ad tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:41.385912 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95292446-a3a8-4f3d-87e2-77c7d00411ad tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:41.534221 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-95292446-a3a8-4f3d-87e2-77c7d00411ad tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:21:41.548448 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-95292446-a3a8-4f3d-87e2-77c7d00411ad tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1443 microversion: 2.1 time: 0.175139 Apr 06 17:21:41.549993 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1744/3485] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:21:41 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1443 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:21:41.566610 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9873667f-e81c-4979-846f-c1e9f11bee99 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:21:41.567512 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9873667f-e81c-4979-846f-c1e9f11bee99 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:21:41.579467 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9873667f-e81c-4979-846f-c1e9f11bee99 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:41.580333 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9873667f-e81c-4979-846f-c1e9f11bee99 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:41.581887 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9873667f-e81c-4979-846f-c1e9f11bee99 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:41.582738 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9873667f-e81c-4979-846f-c1e9f11bee99 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:41.746960 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9873667f-e81c-4979-846f-c1e9f11bee99 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:21:41.756734 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9873667f-e81c-4979-846f-c1e9f11bee99 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1443 microversion: 2.1 time: 0.194217 Apr 06 17:21:41.757323 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1742/3486] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:21:41 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1443 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:21:43.621648 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-f74897a0-aa83-44e2-abf0-ecff2363a7cf req-e5e5a4c1-095c-4759-8b4a-29fc43ea99c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aeb06f7-067b-45d6-9df7-427975ce3532", "tag": "4166ed5e-e08c-4143-8981-39421971dd87"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:21:43.636878 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f74897a0-aa83-44e2-abf0-ecff2363a7cf req-e5e5a4c1-095c-4759-8b4a-29fc43ea99c4 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:21:43.637544 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-f74897a0-aa83-44e2-abf0-ecff2363a7cf req-e5e5a4c1-095c-4759-8b4a-29fc43ea99c4 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:21:43.656030 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-f74897a0-aa83-44e2-abf0-ecff2363a7cf req-e5e5a4c1-095c-4759-8b4a-29fc43ea99c4 service nova] Creating event network-changed:4166ed5e-e08c-4143-8981-39421971dd87 for instance 7aeb06f7-067b-45d6-9df7-427975ce3532 on hv-cinder-83684 Apr 06 17:21:43.662767 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-f74897a0-aa83-44e2-abf0-ecff2363a7cf req-e5e5a4c1-095c-4759-8b4a-29fc43ea99c4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047106 Apr 06 17:21:43.663654 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1745/3487] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:22:25.491976 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a625fcd9-b47b-4354-87d8-bddcbdc0c3b7 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-883408683", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2132919883", "security_groups": [{"name": "tempest-secgroup-smoke-706301784"}], "block_device_mapping_v2": [{"uuid": "853e1261-367e-45ff-85b1-f4302a11bcf2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "85bbf121-bd26-449c-a399-89da35ff4bb5"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:22:25.620899 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-a625fcd9-b47b-4354-87d8-bddcbdc0c3b7 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] validate_networks() for [('85bbf121-bd26-449c-a399-89da35ff4bb5', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 06 17:22:26.014840 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-a625fcd9-b47b-4354-87d8-bddcbdc0c3b7 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 06 17:22:26.015258 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-a625fcd9-b47b-4354-87d8-bddcbdc0c3b7 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 06 17:22:26.015732 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-a625fcd9-b47b-4354-87d8-bddcbdc0c3b7 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 06 17:22:26.016289 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-a625fcd9-b47b-4354-87d8-bddcbdc0c3b7 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 06 17:22:26.016888 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-a625fcd9-b47b-4354-87d8-bddcbdc0c3b7 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 06 17:22:26.026603 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a625fcd9-b47b-4354-87d8-bddcbdc0c3b7 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:26.027048 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a625fcd9-b47b-4354-87d8-bddcbdc0c3b7 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:26.027845 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a625fcd9-b47b-4354-87d8-bddcbdc0c3b7 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:26.028273 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a625fcd9-b47b-4354-87d8-bddcbdc0c3b7 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:26.046033 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-a625fcd9-b47b-4354-87d8-bddcbdc0c3b7 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Getting quotas for project d80fa131c3864ec191ac904b9e290dbc. Resources: {'instances', 'cores', 'ram'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 06 17:22:26.051031 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.quota [None req-a625fcd9-b47b-4354-87d8-bddcbdc0c3b7 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Getting quotas for user 7c1e03597fc34d69b97096c60a4b5be1 and project d80fa131c3864ec191ac904b9e290dbc. Resources: {'instances', 'cores', 'ram'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 06 17:22:26.115102 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a625fcd9-b47b-4354-87d8-bddcbdc0c3b7 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 06 17:22:26.117777 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a625fcd9-b47b-4354-87d8-bddcbdc0c3b7 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 38992546-2666-425b-80ee-2b2de955d9b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='853e1261-367e-45ff-85b1-f4302a11bcf2',volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 06 17:22:26.272051 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a625fcd9-b47b-4354-87d8-bddcbdc0c3b7 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.784027 Apr 06 17:22:26.273166 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1743/3488] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Apr 6 17:22:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 06 17:22:26.291564 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-8331782c-9406-4d52-9f18-4e0d5e009b4f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:22:26.292873 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-8331782c-9406-4d52-9f18-4e0d5e009b4f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 38992546-2666-425b-80ee-2b2de955d9b7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:22:26.358549 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-8331782c-9406-4d52-9f18-4e0d5e009b4f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:22:26.368252 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-8331782c-9406-4d52-9f18-4e0d5e009b4f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7" status: 200 len: 1094 microversion: 2.1 time: 0.084218 Apr 06 17:22:26.369456 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1746/3489] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:22:26 2022] GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7 => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:22:27.392120 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d7fe4b63-1fb6-4660-931d-4626594f1e31 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:22:27.393379 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d7fe4b63-1fb6-4660-931d-4626594f1e31 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 38992546-2666-425b-80ee-2b2de955d9b7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:22:27.404173 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7fe4b63-1fb6-4660-931d-4626594f1e31 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:27.404968 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7fe4b63-1fb6-4660-931d-4626594f1e31 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:27.406001 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7fe4b63-1fb6-4660-931d-4626594f1e31 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:27.406431 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7fe4b63-1fb6-4660-931d-4626594f1e31 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:27.482873 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d7fe4b63-1fb6-4660-931d-4626594f1e31 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:22:27.493270 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d7fe4b63-1fb6-4660-931d-4626594f1e31 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7" status: 200 len: 1200 microversion: 2.1 time: 0.106970 Apr 06 17:22:27.494113 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1744/3490] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:22:27 2022] GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7 => generated 1200 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:22:28.514791 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-88f5adc5-a026-4932-837f-a3051511548b tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:22:28.516137 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-88f5adc5-a026-4932-837f-a3051511548b tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 38992546-2666-425b-80ee-2b2de955d9b7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:22:28.525669 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88f5adc5-a026-4932-837f-a3051511548b tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:28.526114 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88f5adc5-a026-4932-837f-a3051511548b tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:28.526891 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88f5adc5-a026-4932-837f-a3051511548b tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:28.527345 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-88f5adc5-a026-4932-837f-a3051511548b tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:28.687514 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-88f5adc5-a026-4932-837f-a3051511548b tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:22:28.696095 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-88f5adc5-a026-4932-837f-a3051511548b tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7" status: 200 len: 1265 microversion: 2.1 time: 0.185975 Apr 06 17:22:28.697006 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1747/3491] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:22:28 2022] GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:22:29.064076 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-78d0eab1-e5dc-41d0-b5f5-fe598399cb2f req-76337511-c2fc-41a6-85c3-21c4bdebe0a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38992546-2666-425b-80ee-2b2de955d9b7", "tag": "85807749-2af1-4a27-a81c-6b9ee282cde2"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:22:29.083576 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-78d0eab1-e5dc-41d0-b5f5-fe598399cb2f req-76337511-c2fc-41a6-85c3-21c4bdebe0a9 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:29.085423 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-78d0eab1-e5dc-41d0-b5f5-fe598399cb2f req-76337511-c2fc-41a6-85c3-21c4bdebe0a9 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:29.104300 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-78d0eab1-e5dc-41d0-b5f5-fe598399cb2f req-76337511-c2fc-41a6-85c3-21c4bdebe0a9 service nova] Creating event network-changed:85807749-2af1-4a27-a81c-6b9ee282cde2 for instance 38992546-2666-425b-80ee-2b2de955d9b7 on hv-cinder-83684 Apr 06 17:22:29.110302 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-78d0eab1-e5dc-41d0-b5f5-fe598399cb2f req-76337511-c2fc-41a6-85c3-21c4bdebe0a9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052083 Apr 06 17:22:29.110920 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1745/3492] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:22:29.714544 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3b2fb025-da6e-4b8b-adc9-b2508011e84d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:22:29.715132 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3b2fb025-da6e-4b8b-adc9-b2508011e84d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 38992546-2666-425b-80ee-2b2de955d9b7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:22:29.722083 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b2fb025-da6e-4b8b-adc9-b2508011e84d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:29.722535 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b2fb025-da6e-4b8b-adc9-b2508011e84d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:29.723322 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b2fb025-da6e-4b8b-adc9-b2508011e84d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:29.723736 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3b2fb025-da6e-4b8b-adc9-b2508011e84d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:29.868712 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3b2fb025-da6e-4b8b-adc9-b2508011e84d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:22:29.877137 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3b2fb025-da6e-4b8b-adc9-b2508011e84d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7" status: 200 len: 1265 microversion: 2.1 time: 0.166670 Apr 06 17:22:29.877667 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1748/3493] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:22:29 2022] GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:22:30.895262 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ea53b43e-b751-49b5-b007-7774b45651bb tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:22:30.896182 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ea53b43e-b751-49b5-b007-7774b45651bb tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 38992546-2666-425b-80ee-2b2de955d9b7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:22:30.903463 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea53b43e-b751-49b5-b007-7774b45651bb tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:30.903833 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea53b43e-b751-49b5-b007-7774b45651bb tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:30.904619 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea53b43e-b751-49b5-b007-7774b45651bb tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:30.905092 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea53b43e-b751-49b5-b007-7774b45651bb tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:31.070253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ea53b43e-b751-49b5-b007-7774b45651bb tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:22:31.078556 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ea53b43e-b751-49b5-b007-7774b45651bb tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7" status: 200 len: 1265 microversion: 2.1 time: 0.187583 Apr 06 17:22:31.079130 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1746/3494] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:22:30 2022] GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:22:32.098747 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-044799f2-7dd0-48c5-9521-84f494c0e2c9 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:22:32.099385 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-044799f2-7dd0-48c5-9521-84f494c0e2c9 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 38992546-2666-425b-80ee-2b2de955d9b7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:22:32.107740 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-044799f2-7dd0-48c5-9521-84f494c0e2c9 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:32.108184 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-044799f2-7dd0-48c5-9521-84f494c0e2c9 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:32.109031 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-044799f2-7dd0-48c5-9521-84f494c0e2c9 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:32.109462 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-044799f2-7dd0-48c5-9521-84f494c0e2c9 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:32.270228 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-044799f2-7dd0-48c5-9521-84f494c0e2c9 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:22:32.279167 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-044799f2-7dd0-48c5-9521-84f494c0e2c9 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7" status: 200 len: 1265 microversion: 2.1 time: 0.184269 Apr 06 17:22:32.279759 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1749/3495] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:22:32 2022] GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:22:33.297963 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-31c7409f-b56c-4a26-9610-5a4308e66a0f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:22:33.298697 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-31c7409f-b56c-4a26-9610-5a4308e66a0f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 38992546-2666-425b-80ee-2b2de955d9b7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:22:33.305951 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31c7409f-b56c-4a26-9610-5a4308e66a0f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:33.306405 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31c7409f-b56c-4a26-9610-5a4308e66a0f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:33.307201 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31c7409f-b56c-4a26-9610-5a4308e66a0f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:33.307664 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31c7409f-b56c-4a26-9610-5a4308e66a0f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:33.485349 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-31c7409f-b56c-4a26-9610-5a4308e66a0f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:22:33.493538 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-31c7409f-b56c-4a26-9610-5a4308e66a0f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7" status: 200 len: 1265 microversion: 2.1 time: 0.199696 Apr 06 17:22:33.494146 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1747/3496] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:22:33 2022] GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:22:34.511288 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-95be9407-3433-4695-bda0-c69bacafc634 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:22:34.511964 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-95be9407-3433-4695-bda0-c69bacafc634 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 38992546-2666-425b-80ee-2b2de955d9b7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:22:34.518778 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95be9407-3433-4695-bda0-c69bacafc634 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:34.519251 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95be9407-3433-4695-bda0-c69bacafc634 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:34.520036 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95be9407-3433-4695-bda0-c69bacafc634 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:34.520505 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-95be9407-3433-4695-bda0-c69bacafc634 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:34.667992 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-95be9407-3433-4695-bda0-c69bacafc634 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:22:34.676056 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-95be9407-3433-4695-bda0-c69bacafc634 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7" status: 200 len: 1265 microversion: 2.1 time: 0.168897 Apr 06 17:22:34.676648 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1750/3497] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:22:34 2022] GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:22:35.762060 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ea1e0efd-b5d9-4198-8bff-8d4ccdac2af8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:22:35.762694 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ea1e0efd-b5d9-4198-8bff-8d4ccdac2af8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 38992546-2666-425b-80ee-2b2de955d9b7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:22:35.769138 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea1e0efd-b5d9-4198-8bff-8d4ccdac2af8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:35.769584 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea1e0efd-b5d9-4198-8bff-8d4ccdac2af8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:35.770358 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea1e0efd-b5d9-4198-8bff-8d4ccdac2af8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:35.770794 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea1e0efd-b5d9-4198-8bff-8d4ccdac2af8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:35.925033 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-ea1e0efd-b5d9-4198-8bff-8d4ccdac2af8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:22:35.932373 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ea1e0efd-b5d9-4198-8bff-8d4ccdac2af8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7" status: 200 len: 1265 microversion: 2.1 time: 0.241638 Apr 06 17:22:35.932979 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1748/3498] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:22:35 2022] GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7 => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:22:36.952378 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2bf9ae53-3fe4-40a9-9e0b-a67e10d15f4e tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:22:36.953167 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2bf9ae53-3fe4-40a9-9e0b-a67e10d15f4e tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 38992546-2666-425b-80ee-2b2de955d9b7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:22:36.959863 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bf9ae53-3fe4-40a9-9e0b-a67e10d15f4e tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:36.960316 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bf9ae53-3fe4-40a9-9e0b-a67e10d15f4e tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:36.961156 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bf9ae53-3fe4-40a9-9e0b-a67e10d15f4e tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:36.961666 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2bf9ae53-3fe4-40a9-9e0b-a67e10d15f4e tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:37.120613 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2bf9ae53-3fe4-40a9-9e0b-a67e10d15f4e tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:22:37.129231 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2bf9ae53-3fe4-40a9-9e0b-a67e10d15f4e tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7" status: 200 len: 1265 microversion: 2.1 time: 0.180865 Apr 06 17:22:37.129833 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1751/3499] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:22:36 2022] GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:22:38.147202 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a1a5fc63-1e80-4f6d-9a48-08c0b969ca37 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:22:38.147863 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a1a5fc63-1e80-4f6d-9a48-08c0b969ca37 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 38992546-2666-425b-80ee-2b2de955d9b7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:22:38.154941 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1a5fc63-1e80-4f6d-9a48-08c0b969ca37 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:38.155421 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1a5fc63-1e80-4f6d-9a48-08c0b969ca37 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:38.156232 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1a5fc63-1e80-4f6d-9a48-08c0b969ca37 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:38.156662 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1a5fc63-1e80-4f6d-9a48-08c0b969ca37 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:38.303732 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a1a5fc63-1e80-4f6d-9a48-08c0b969ca37 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:22:38.312810 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a1a5fc63-1e80-4f6d-9a48-08c0b969ca37 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7" status: 200 len: 1265 microversion: 2.1 time: 0.169454 Apr 06 17:22:38.313400 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1749/3500] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:22:38 2022] GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:22:39.208225 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-5b1eba9e-4a10-45ed-8004-03261f50d9aa req-62e56dde-ffb4-468e-8a28-0750522aac97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38992546-2666-425b-80ee-2b2de955d9b7", "name": "network-vif-plugged", "status": "completed", "tag": "85807749-2af1-4a27-a81c-6b9ee282cde2"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:22:39.224748 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5b1eba9e-4a10-45ed-8004-03261f50d9aa req-62e56dde-ffb4-468e-8a28-0750522aac97 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:39.225477 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5b1eba9e-4a10-45ed-8004-03261f50d9aa req-62e56dde-ffb4-468e-8a28-0750522aac97 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:39.239656 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-5b1eba9e-4a10-45ed-8004-03261f50d9aa req-62e56dde-ffb4-468e-8a28-0750522aac97 service nova] Creating event network-vif-plugged:85807749-2af1-4a27-a81c-6b9ee282cde2 for instance 38992546-2666-425b-80ee-2b2de955d9b7 on hv-cinder-83684 Apr 06 17:22:39.246522 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-5b1eba9e-4a10-45ed-8004-03261f50d9aa req-62e56dde-ffb4-468e-8a28-0750522aac97 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044055 Apr 06 17:22:39.247654 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1752/3501] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:22:39.330255 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e2c71392-87aa-41cf-a7ee-2cbb44511cee tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:22:39.331208 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e2c71392-87aa-41cf-a7ee-2cbb44511cee tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 38992546-2666-425b-80ee-2b2de955d9b7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:22:39.339404 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2c71392-87aa-41cf-a7ee-2cbb44511cee tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:39.339860 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2c71392-87aa-41cf-a7ee-2cbb44511cee tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:39.340677 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2c71392-87aa-41cf-a7ee-2cbb44511cee tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:39.341150 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2c71392-87aa-41cf-a7ee-2cbb44511cee tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:39.511269 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-e2c71392-87aa-41cf-a7ee-2cbb44511cee tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:22:39.519274 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e2c71392-87aa-41cf-a7ee-2cbb44511cee tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7" status: 200 len: 1265 microversion: 2.1 time: 0.193072 Apr 06 17:22:39.519873 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1750/3502] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:22:39 2022] GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:22:40.537846 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-30a33002-49e6-4de1-9caf-b5213622189d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:22:40.538533 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-30a33002-49e6-4de1-9caf-b5213622189d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 38992546-2666-425b-80ee-2b2de955d9b7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:22:40.546073 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30a33002-49e6-4de1-9caf-b5213622189d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:40.546520 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30a33002-49e6-4de1-9caf-b5213622189d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:40.547287 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30a33002-49e6-4de1-9caf-b5213622189d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:40.547720 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-30a33002-49e6-4de1-9caf-b5213622189d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:40.692782 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-30a33002-49e6-4de1-9caf-b5213622189d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:22:40.701497 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-30a33002-49e6-4de1-9caf-b5213622189d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7" status: 200 len: 1265 microversion: 2.1 time: 0.167889 Apr 06 17:22:40.702104 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1753/3503] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:22:40 2022] GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:22:41.719840 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fa84b30d-0a25-4dc3-9a47-153ab5515c05 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:22:41.720463 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fa84b30d-0a25-4dc3-9a47-153ab5515c05 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 38992546-2666-425b-80ee-2b2de955d9b7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:22:41.729510 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa84b30d-0a25-4dc3-9a47-153ab5515c05 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:41.730087 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa84b30d-0a25-4dc3-9a47-153ab5515c05 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:41.731137 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa84b30d-0a25-4dc3-9a47-153ab5515c05 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:41.732240 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa84b30d-0a25-4dc3-9a47-153ab5515c05 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:41.893330 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-fa84b30d-0a25-4dc3-9a47-153ab5515c05 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:22:41.901882 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fa84b30d-0a25-4dc3-9a47-153ab5515c05 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7" status: 200 len: 1452 microversion: 2.1 time: 0.186077 Apr 06 17:22:41.902455 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1751/3504] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:22:41 2022] GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7 => generated 1452 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:22:41.918527 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-673b0d02-4d39-4555-aad1-566d713fdc67 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:22:41.919109 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-673b0d02-4d39-4555-aad1-566d713fdc67 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 38992546-2666-425b-80ee-2b2de955d9b7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:22:41.925887 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-673b0d02-4d39-4555-aad1-566d713fdc67 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:41.926338 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-673b0d02-4d39-4555-aad1-566d713fdc67 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:41.927101 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-673b0d02-4d39-4555-aad1-566d713fdc67 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:41.927536 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-673b0d02-4d39-4555-aad1-566d713fdc67 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:42.085906 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-673b0d02-4d39-4555-aad1-566d713fdc67 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:22:42.094464 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-673b0d02-4d39-4555-aad1-566d713fdc67 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7" status: 200 len: 1452 microversion: 2.1 time: 0.179914 Apr 06 17:22:42.095033 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1754/3505] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:22:41 2022] GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7 => generated 1452 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:22:44.217892 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-81821851-eeeb-428c-b06d-5bb9b861c574 req-eafc7a59-ec68-4acf-94e6-9e7e236b7037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38992546-2666-425b-80ee-2b2de955d9b7", "tag": "85807749-2af1-4a27-a81c-6b9ee282cde2"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:22:44.237253 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-81821851-eeeb-428c-b06d-5bb9b861c574 req-eafc7a59-ec68-4acf-94e6-9e7e236b7037 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:22:44.237699 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-81821851-eeeb-428c-b06d-5bb9b861c574 req-eafc7a59-ec68-4acf-94e6-9e7e236b7037 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:22:44.250177 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-81821851-eeeb-428c-b06d-5bb9b861c574 req-eafc7a59-ec68-4acf-94e6-9e7e236b7037 service nova] Creating event network-changed:85807749-2af1-4a27-a81c-6b9ee282cde2 for instance 38992546-2666-425b-80ee-2b2de955d9b7 on hv-cinder-83684 Apr 06 17:22:44.256456 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-81821851-eeeb-428c-b06d-5bb9b861c574 req-eafc7a59-ec68-4acf-94e6-9e7e236b7037 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042191 Apr 06 17:22:44.257120 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1752/3506] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:23:38.003840 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4f59b52f-a0e6-4ced-b222-e9d65a16032a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:23:38.004430 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4f59b52f-a0e6-4ced-b222-e9d65a16032a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:23:38.010589 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f59b52f-a0e6-4ced-b222-e9d65a16032a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:38.011010 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f59b52f-a0e6-4ced-b222-e9d65a16032a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:38.011791 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f59b52f-a0e6-4ced-b222-e9d65a16032a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:38.012356 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4f59b52f-a0e6-4ced-b222-e9d65a16032a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:38.036481 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.objects.instance [None req-4f59b52f-a0e6-4ced-b222-e9d65a16032a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lazy-loading 'flavor' on Instance uuid 7aeb06f7-067b-45d6-9df7-427975ce3532 {{(pid=128861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 06 17:23:38.120508 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4f59b52f-a0e6-4ced-b222-e9d65a16032a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "POST /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532/action" status: 202 len: 0 microversion: 2.1 time: 0.120460 Apr 06 17:23:38.121367 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1755/3507] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Apr 6 17:23:37 2022] POST /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 06 17:23:38.134747 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5be7f477-d251-4c23-99e3-287694fcca67 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:23:38.136013 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5be7f477-d251-4c23-99e3-287694fcca67 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:23:38.145831 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be7f477-d251-4c23-99e3-287694fcca67 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:38.146479 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be7f477-d251-4c23-99e3-287694fcca67 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:38.147571 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be7f477-d251-4c23-99e3-287694fcca67 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:38.148023 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be7f477-d251-4c23-99e3-287694fcca67 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:38.208776 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:23:38.209073 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 17:23:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 (ip 10.222.0.64) !!! Apr 06 17:23:38.305618 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5be7f477-d251-4c23-99e3-287694fcca67 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:23:38.313849 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5be7f477-d251-4c23-99e3-287694fcca67 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1568 microversion: 2.1 time: 0.186371 Apr 06 17:23:38.314421 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1753/3508] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:23:38 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:23:39.336623 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-fe887718-7d46-4246-a703-4b17f4ac08b7 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:23:39.337493 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-fe887718-7d46-4246-a703-4b17f4ac08b7 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:23:39.344271 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe887718-7d46-4246-a703-4b17f4ac08b7 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:39.344729 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe887718-7d46-4246-a703-4b17f4ac08b7 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:39.345496 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe887718-7d46-4246-a703-4b17f4ac08b7 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:39.345936 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-fe887718-7d46-4246-a703-4b17f4ac08b7 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:39.601546 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-fe887718-7d46-4246-a703-4b17f4ac08b7 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:23:39.609914 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-fe887718-7d46-4246-a703-4b17f4ac08b7 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1568 microversion: 2.1 time: 0.278261 Apr 06 17:23:39.610501 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1756/3509] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:23:39 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1568 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:23:40.628280 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c5060ba1-237d-4770-8676-bfb8f8bd0508 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:23:40.628921 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c5060ba1-237d-4770-8676-bfb8f8bd0508 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:23:40.635766 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5060ba1-237d-4770-8676-bfb8f8bd0508 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:40.636204 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5060ba1-237d-4770-8676-bfb8f8bd0508 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:40.637271 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5060ba1-237d-4770-8676-bfb8f8bd0508 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:40.637750 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5060ba1-237d-4770-8676-bfb8f8bd0508 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:40.788073 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c5060ba1-237d-4770-8676-bfb8f8bd0508 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:23:40.800104 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c5060ba1-237d-4770-8676-bfb8f8bd0508 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1568 microversion: 2.1 time: 0.175890 Apr 06 17:23:40.800673 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1754/3510] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:23:40 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:23:41.818073 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-83859fec-792b-4bf5-ae7e-ed65a449d434 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:23:41.818718 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-83859fec-792b-4bf5-ae7e-ed65a449d434 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:23:41.825847 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83859fec-792b-4bf5-ae7e-ed65a449d434 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:41.826314 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83859fec-792b-4bf5-ae7e-ed65a449d434 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:41.827088 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83859fec-792b-4bf5-ae7e-ed65a449d434 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:41.827508 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-83859fec-792b-4bf5-ae7e-ed65a449d434 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:41.990167 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-83859fec-792b-4bf5-ae7e-ed65a449d434 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:23:41.998360 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-83859fec-792b-4bf5-ae7e-ed65a449d434 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1568 microversion: 2.1 time: 0.184189 Apr 06 17:23:41.998967 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1757/3511] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:23:41 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:23:43.023597 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5b3c269b-8a9d-42c2-8fc6-baa2704a5a77 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:23:43.024395 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5b3c269b-8a9d-42c2-8fc6-baa2704a5a77 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:23:43.031128 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b3c269b-8a9d-42c2-8fc6-baa2704a5a77 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:43.031579 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b3c269b-8a9d-42c2-8fc6-baa2704a5a77 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:43.032355 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b3c269b-8a9d-42c2-8fc6-baa2704a5a77 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:43.032815 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b3c269b-8a9d-42c2-8fc6-baa2704a5a77 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:43.197497 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5b3c269b-8a9d-42c2-8fc6-baa2704a5a77 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:23:43.205884 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5b3c269b-8a9d-42c2-8fc6-baa2704a5a77 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1568 microversion: 2.1 time: 0.186402 Apr 06 17:23:43.206448 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1755/3512] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:23:43 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:23:44.102644 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:23:44.103241 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 17:23:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:23:44.223928 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-3a0bbe71-eb8d-48cd-9d13-125755eb366a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:23:44.224528 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-3a0bbe71-eb8d-48cd-9d13-125755eb366a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:23:44.231626 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a0bbe71-eb8d-48cd-9d13-125755eb366a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:44.232356 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a0bbe71-eb8d-48cd-9d13-125755eb366a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:44.233164 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a0bbe71-eb8d-48cd-9d13-125755eb366a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:44.233594 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-3a0bbe71-eb8d-48cd-9d13-125755eb366a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:44.388665 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-3a0bbe71-eb8d-48cd-9d13-125755eb366a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:23:44.400535 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-3a0bbe71-eb8d-48cd-9d13-125755eb366a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1568 microversion: 2.1 time: 0.180340 Apr 06 17:23:44.401378 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1758/3513] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:23:44 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:23:45.423313 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a838c5e2-ee61-4351-bf0e-09162860c9cf tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:23:45.423914 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a838c5e2-ee61-4351-bf0e-09162860c9cf tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:23:45.430920 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a838c5e2-ee61-4351-bf0e-09162860c9cf tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:45.431364 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a838c5e2-ee61-4351-bf0e-09162860c9cf tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:45.432129 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a838c5e2-ee61-4351-bf0e-09162860c9cf tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:45.432564 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a838c5e2-ee61-4351-bf0e-09162860c9cf tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:45.621595 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a838c5e2-ee61-4351-bf0e-09162860c9cf tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:23:45.631182 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a838c5e2-ee61-4351-bf0e-09162860c9cf tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1568 microversion: 2.1 time: 0.211832 Apr 06 17:23:45.631771 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1756/3514] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:23:45 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1568 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:23:46.651734 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-a2a8a64e-3c07-4dd0-b6f8-bfc8b21721bd tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:23:46.652398 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-a2a8a64e-3c07-4dd0-b6f8-bfc8b21721bd tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:23:46.660582 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2a8a64e-3c07-4dd0-b6f8-bfc8b21721bd tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:46.661070 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2a8a64e-3c07-4dd0-b6f8-bfc8b21721bd tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:46.661845 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2a8a64e-3c07-4dd0-b6f8-bfc8b21721bd tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:46.662260 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-a2a8a64e-3c07-4dd0-b6f8-bfc8b21721bd tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:46.820009 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-a2a8a64e-3c07-4dd0-b6f8-bfc8b21721bd tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:23:46.828573 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-a2a8a64e-3c07-4dd0-b6f8-bfc8b21721bd tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1568 microversion: 2.1 time: 0.180716 Apr 06 17:23:46.829270 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1759/3515] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:23:46 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:23:47.853416 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-488e168c-7954-4b9a-8e7b-29145ecdc9ad tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:23:47.854495 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-488e168c-7954-4b9a-8e7b-29145ecdc9ad tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:23:47.865672 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-488e168c-7954-4b9a-8e7b-29145ecdc9ad tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:47.866443 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-488e168c-7954-4b9a-8e7b-29145ecdc9ad tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:47.867812 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-488e168c-7954-4b9a-8e7b-29145ecdc9ad tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:47.868592 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-488e168c-7954-4b9a-8e7b-29145ecdc9ad tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:48.050808 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-488e168c-7954-4b9a-8e7b-29145ecdc9ad tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:23:48.058481 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-488e168c-7954-4b9a-8e7b-29145ecdc9ad tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1568 microversion: 2.1 time: 0.211461 Apr 06 17:23:48.059223 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1757/3516] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:23:47 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1568 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:23:49.079659 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2b675534-db05-4ecb-8e3a-66b393dc3fca tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:23:49.080769 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2b675534-db05-4ecb-8e3a-66b393dc3fca tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:23:49.089246 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b675534-db05-4ecb-8e3a-66b393dc3fca tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:49.089694 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b675534-db05-4ecb-8e3a-66b393dc3fca tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:49.090689 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b675534-db05-4ecb-8e3a-66b393dc3fca tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:49.091133 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2b675534-db05-4ecb-8e3a-66b393dc3fca tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:49.508458 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2b675534-db05-4ecb-8e3a-66b393dc3fca tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:23:49.517504 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2b675534-db05-4ecb-8e3a-66b393dc3fca tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1568 microversion: 2.1 time: 0.444828 Apr 06 17:23:49.518103 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1760/3517] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:23:49 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1568 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:23:50.536414 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-698a0672-74a0-4b0b-a69f-4318d4200861 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:23:50.536414 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-698a0672-74a0-4b0b-a69f-4318d4200861 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:23:50.543211 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-698a0672-74a0-4b0b-a69f-4318d4200861 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:50.543721 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-698a0672-74a0-4b0b-a69f-4318d4200861 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:50.544798 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-698a0672-74a0-4b0b-a69f-4318d4200861 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:50.545307 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-698a0672-74a0-4b0b-a69f-4318d4200861 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:50.727404 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-698a0672-74a0-4b0b-a69f-4318d4200861 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:23:50.736956 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-698a0672-74a0-4b0b-a69f-4318d4200861 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1568 microversion: 2.1 time: 0.205674 Apr 06 17:23:50.737718 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1758/3518] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:23:50 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1568 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:23:51.756744 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0201cedf-6edf-488a-a994-5bc7adf1f03a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:23:51.757361 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0201cedf-6edf-488a-a994-5bc7adf1f03a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:23:51.764403 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0201cedf-6edf-488a-a994-5bc7adf1f03a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:51.764891 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0201cedf-6edf-488a-a994-5bc7adf1f03a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:51.765687 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0201cedf-6edf-488a-a994-5bc7adf1f03a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:51.766174 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0201cedf-6edf-488a-a994-5bc7adf1f03a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:51.924716 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-0201cedf-6edf-488a-a994-5bc7adf1f03a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:23:51.934290 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0201cedf-6edf-488a-a994-5bc7adf1f03a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1509 microversion: 2.1 time: 0.182678 Apr 06 17:23:51.935023 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1761/3519] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:23:51 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1509 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:23:51.960068 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-56ee5d4a-6136-4f43-a8d7-d3bdb4c03d9d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:23:51.960883 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-56ee5d4a-6136-4f43-a8d7-d3bdb4c03d9d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:23:51.968051 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56ee5d4a-6136-4f43-a8d7-d3bdb4c03d9d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:51.968504 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56ee5d4a-6136-4f43-a8d7-d3bdb4c03d9d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:51.969326 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56ee5d4a-6136-4f43-a8d7-d3bdb4c03d9d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:51.969763 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56ee5d4a-6136-4f43-a8d7-d3bdb4c03d9d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:52.076234 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-56ee5d4a-6136-4f43-a8d7-d3bdb4c03d9d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "POST /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532/action" status: 202 len: 0 microversion: 2.1 time: 0.120793 Apr 06 17:23:52.077333 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1759/3520] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Apr 6 17:23:51 2022] POST /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 06 17:23:52.085919 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-e85f655b-0866-4a36-80d1-2f3c200329c0 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:23:52.086624 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-e85f655b-0866-4a36-80d1-2f3c200329c0 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:23:52.093986 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e85f655b-0866-4a36-80d1-2f3c200329c0 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:52.094538 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e85f655b-0866-4a36-80d1-2f3c200329c0 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:52.095453 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e85f655b-0866-4a36-80d1-2f3c200329c0 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:52.095871 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-e85f655b-0866-4a36-80d1-2f3c200329c0 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:52.311012 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-e85f655b-0866-4a36-80d1-2f3c200329c0 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:23:52.323147 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-e85f655b-0866-4a36-80d1-2f3c200329c0 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1517 microversion: 2.1 time: 0.241132 Apr 06 17:23:52.324631 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1762/3521] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:23:52 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1517 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:23:53.017384 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:23:53.018060 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 17:23:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:23:53.352663 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a6ace255-890d-4bba-bfb3-db96a3f12b5a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:23:53.353827 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a6ace255-890d-4bba-bfb3-db96a3f12b5a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:23:53.366660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6ace255-890d-4bba-bfb3-db96a3f12b5a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:53.367467 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6ace255-890d-4bba-bfb3-db96a3f12b5a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:53.368940 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6ace255-890d-4bba-bfb3-db96a3f12b5a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:53.369732 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6ace255-890d-4bba-bfb3-db96a3f12b5a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:53.654411 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-5ec38e49-8ac9-4dbe-99c9-4d6c7eb717b9 req-181852f9-bc3a-433e-9926-68bf5c8e29d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aeb06f7-067b-45d6-9df7-427975ce3532", "name": "network-vif-unplugged", "status": "completed", "tag": "4166ed5e-e08c-4143-8981-39421971dd87"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:23:53.668105 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5ec38e49-8ac9-4dbe-99c9-4d6c7eb717b9 req-181852f9-bc3a-433e-9926-68bf5c8e29d9 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:53.669357 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-5ec38e49-8ac9-4dbe-99c9-4d6c7eb717b9 req-181852f9-bc3a-433e-9926-68bf5c8e29d9 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:53.685494 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.compute.server_external_events [req-5ec38e49-8ac9-4dbe-99c9-4d6c7eb717b9 req-181852f9-bc3a-433e-9926-68bf5c8e29d9 service nova] Unable to find a host for instance 7aeb06f7-067b-45d6-9df7-427975ce3532. Dropping event network-vif-unplugged {{(pid=128861) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 06 17:23:53.687147 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-a6ace255-890d-4bba-bfb3-db96a3f12b5a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:23:53.687828 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-5ec38e49-8ac9-4dbe-99c9-4d6c7eb717b9 req-181852f9-bc3a-433e-9926-68bf5c8e29d9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.043941 Apr 06 17:23:53.689159 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1763/3522] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 06 17:23:53.697204 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a6ace255-890d-4bba-bfb3-db96a3f12b5a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1517 microversion: 2.1 time: 0.352272 Apr 06 17:23:53.706782 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1760/3523] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:23:53 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1517 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:23:54.720604 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-055de06f-776f-44b9-8d44-167851f5871a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:23:54.721466 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-055de06f-776f-44b9-8d44-167851f5871a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:23:54.728544 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-055de06f-776f-44b9-8d44-167851f5871a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:54.729022 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-055de06f-776f-44b9-8d44-167851f5871a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:54.729830 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-055de06f-776f-44b9-8d44-167851f5871a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:54.730235 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-055de06f-776f-44b9-8d44-167851f5871a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:54.923424 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-055de06f-776f-44b9-8d44-167851f5871a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:23:54.932032 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-055de06f-776f-44b9-8d44-167851f5871a tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1517 microversion: 2.1 time: 0.219671 Apr 06 17:23:54.932623 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1764/3524] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:23:54 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1517 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:23:55.950411 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9fbbd58a-486d-4847-a780-8340b0d49f51 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:23:55.951163 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9fbbd58a-486d-4847-a780-8340b0d49f51 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:23:55.958524 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9fbbd58a-486d-4847-a780-8340b0d49f51 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:55.959216 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9fbbd58a-486d-4847-a780-8340b0d49f51 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:55.960134 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9fbbd58a-486d-4847-a780-8340b0d49f51 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:55.960566 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9fbbd58a-486d-4847-a780-8340b0d49f51 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:56.177420 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-9fbbd58a-486d-4847-a780-8340b0d49f51 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:23:56.195115 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9fbbd58a-486d-4847-a780-8340b0d49f51 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1575 microversion: 2.1 time: 0.248376 Apr 06 17:23:56.196482 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1761/3525] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:23:55 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1575 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:23:57.221006 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-5f3d9c66-3f5c-41fe-9bd4-16894843925d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:23:57.221936 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-5f3d9c66-3f5c-41fe-9bd4-16894843925d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:23:57.231560 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f3d9c66-3f5c-41fe-9bd4-16894843925d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:57.232220 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f3d9c66-3f5c-41fe-9bd4-16894843925d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:57.233041 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f3d9c66-3f5c-41fe-9bd4-16894843925d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:57.233474 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-5f3d9c66-3f5c-41fe-9bd4-16894843925d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:57.376508 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-5f3d9c66-3f5c-41fe-9bd4-16894843925d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:23:57.386312 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-5f3d9c66-3f5c-41fe-9bd4-16894843925d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1575 microversion: 2.1 time: 0.171643 Apr 06 17:23:57.386984 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1765/3526] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:23:57 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:23:58.405857 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-277cb9c3-ec50-4f68-bcce-4a685ba389d9 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:23:58.407506 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-277cb9c3-ec50-4f68-bcce-4a685ba389d9 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:23:58.414541 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-277cb9c3-ec50-4f68-bcce-4a685ba389d9 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:58.414990 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-277cb9c3-ec50-4f68-bcce-4a685ba389d9 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:58.415770 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-277cb9c3-ec50-4f68-bcce-4a685ba389d9 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:58.416174 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-277cb9c3-ec50-4f68-bcce-4a685ba389d9 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:58.567506 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-277cb9c3-ec50-4f68-bcce-4a685ba389d9 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:23:58.576026 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-277cb9c3-ec50-4f68-bcce-4a685ba389d9 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1575 microversion: 2.1 time: 0.175033 Apr 06 17:23:58.576605 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1762/3527] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:23:58 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:23:59.594702 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-2e597256-d756-44a2-a7f0-38ad4a1dc288 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:23:59.595602 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-2e597256-d756-44a2-a7f0-38ad4a1dc288 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:23:59.602324 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e597256-d756-44a2-a7f0-38ad4a1dc288 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:59.602771 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e597256-d756-44a2-a7f0-38ad4a1dc288 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:59.603545 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e597256-d756-44a2-a7f0-38ad4a1dc288 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:23:59.603981 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-2e597256-d756-44a2-a7f0-38ad4a1dc288 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:23:59.761707 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-2e597256-d756-44a2-a7f0-38ad4a1dc288 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:23:59.771650 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-2e597256-d756-44a2-a7f0-38ad4a1dc288 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1575 microversion: 2.1 time: 0.182468 Apr 06 17:23:59.772230 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1766/3528] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:23:59 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:24:00.791608 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8888bd69-6753-4552-a0fb-43b677323763 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:24:00.792215 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8888bd69-6753-4552-a0fb-43b677323763 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:24:00.799475 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8888bd69-6753-4552-a0fb-43b677323763 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:00.799935 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8888bd69-6753-4552-a0fb-43b677323763 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:00.800892 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8888bd69-6753-4552-a0fb-43b677323763 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:00.801356 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8888bd69-6753-4552-a0fb-43b677323763 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:00.945348 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-8888bd69-6753-4552-a0fb-43b677323763 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:24:00.952966 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8888bd69-6753-4552-a0fb-43b677323763 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1575 microversion: 2.1 time: 0.165503 Apr 06 17:24:00.953536 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1763/3529] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:24:00 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:24:01.971091 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-7bc82568-fc6e-49c8-852f-e1f0a5e58a64 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:24:01.971682 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-7bc82568-fc6e-49c8-852f-e1f0a5e58a64 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:24:01.978721 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bc82568-fc6e-49c8-852f-e1f0a5e58a64 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:01.979168 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bc82568-fc6e-49c8-852f-e1f0a5e58a64 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:01.979991 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bc82568-fc6e-49c8-852f-e1f0a5e58a64 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:01.980427 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-7bc82568-fc6e-49c8-852f-e1f0a5e58a64 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:02.134387 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-7bc82568-fc6e-49c8-852f-e1f0a5e58a64 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:24:02.144378 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-7bc82568-fc6e-49c8-852f-e1f0a5e58a64 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1575 microversion: 2.1 time: 0.176793 Apr 06 17:24:02.145548 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1767/3530] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:24:01 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:24:03.164360 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c22cea1a-0d5f-4324-96e6-7193a3c49055 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:24:03.165075 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c22cea1a-0d5f-4324-96e6-7193a3c49055 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:24:03.171606 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c22cea1a-0d5f-4324-96e6-7193a3c49055 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:03.172043 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c22cea1a-0d5f-4324-96e6-7193a3c49055 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:03.172850 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c22cea1a-0d5f-4324-96e6-7193a3c49055 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:03.173281 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c22cea1a-0d5f-4324-96e6-7193a3c49055 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:03.339389 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-c22cea1a-0d5f-4324-96e6-7193a3c49055 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:24:03.347482 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c22cea1a-0d5f-4324-96e6-7193a3c49055 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1575 microversion: 2.1 time: 0.187579 Apr 06 17:24:03.348158 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1764/3531] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:24:03 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1575 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:24:04.366041 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-99b80c9f-fe8e-4dcc-91ac-775ddf96e00e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:24:04.366753 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-99b80c9f-fe8e-4dcc-91ac-775ddf96e00e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:24:04.373612 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99b80c9f-fe8e-4dcc-91ac-775ddf96e00e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:04.374060 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99b80c9f-fe8e-4dcc-91ac-775ddf96e00e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:04.374833 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99b80c9f-fe8e-4dcc-91ac-775ddf96e00e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:04.375264 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99b80c9f-fe8e-4dcc-91ac-775ddf96e00e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:04.526288 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-99b80c9f-fe8e-4dcc-91ac-775ddf96e00e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:24:04.537687 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-99b80c9f-fe8e-4dcc-91ac-775ddf96e00e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1575 microversion: 2.1 time: 0.175325 Apr 06 17:24:04.539711 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1768/3532] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:24:04 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:24:05.564557 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6025a0a8-3aad-43d3-8e73-c8d06ac81c2e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:24:05.565228 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6025a0a8-3aad-43d3-8e73-c8d06ac81c2e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:24:05.572210 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6025a0a8-3aad-43d3-8e73-c8d06ac81c2e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:05.572660 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6025a0a8-3aad-43d3-8e73-c8d06ac81c2e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:05.573472 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6025a0a8-3aad-43d3-8e73-c8d06ac81c2e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:05.573905 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6025a0a8-3aad-43d3-8e73-c8d06ac81c2e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:05.717650 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-6025a0a8-3aad-43d3-8e73-c8d06ac81c2e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:24:05.727588 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6025a0a8-3aad-43d3-8e73-c8d06ac81c2e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1575 microversion: 2.1 time: 0.167573 Apr 06 17:24:05.728187 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1765/3533] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:24:05 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:24:05.761005 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-7ad1a998-0e0b-4b9a-9e13-33fbab754609 req-986d7de2-1575-4595-a693-15d911e5fe26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aeb06f7-067b-45d6-9df7-427975ce3532", "name": "network-vif-plugged", "status": "completed", "tag": "4166ed5e-e08c-4143-8981-39421971dd87"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:24:05.772294 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7ad1a998-0e0b-4b9a-9e13-33fbab754609 req-986d7de2-1575-4595-a693-15d911e5fe26 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:05.772749 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-7ad1a998-0e0b-4b9a-9e13-33fbab754609 req-986d7de2-1575-4595-a693-15d911e5fe26 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:05.784065 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-7ad1a998-0e0b-4b9a-9e13-33fbab754609 req-986d7de2-1575-4595-a693-15d911e5fe26 service nova] Creating event network-vif-plugged:4166ed5e-e08c-4143-8981-39421971dd87 for instance 7aeb06f7-067b-45d6-9df7-427975ce3532 on hv-cinder-83684 Apr 06 17:24:05.792093 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-7ad1a998-0e0b-4b9a-9e13-33fbab754609 req-986d7de2-1575-4595-a693-15d911e5fe26 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042138 Apr 06 17:24:05.792774 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1769/3534] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 17:24:06.752232 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b50043e6-42f4-4e07-a348-beffe996d861 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:24:06.753035 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b50043e6-42f4-4e07-a348-beffe996d861 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:24:06.761783 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b50043e6-42f4-4e07-a348-beffe996d861 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:06.762315 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b50043e6-42f4-4e07-a348-beffe996d861 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:06.763108 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b50043e6-42f4-4e07-a348-beffe996d861 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:06.763548 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b50043e6-42f4-4e07-a348-beffe996d861 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:06.908129 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-b50043e6-42f4-4e07-a348-beffe996d861 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:24:06.916225 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b50043e6-42f4-4e07-a348-beffe996d861 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1575 microversion: 2.1 time: 0.168123 Apr 06 17:24:06.916793 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1766/3535] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:24:06 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:24:07.935724 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-f32b894b-2456-4656-a1aa-3181ec3beaa1 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:24:07.936306 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-f32b894b-2456-4656-a1aa-3181ec3beaa1 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:24:07.943281 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f32b894b-2456-4656-a1aa-3181ec3beaa1 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:07.943733 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f32b894b-2456-4656-a1aa-3181ec3beaa1 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:07.944497 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f32b894b-2456-4656-a1aa-3181ec3beaa1 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:07.944960 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-f32b894b-2456-4656-a1aa-3181ec3beaa1 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:08.105426 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-f32b894b-2456-4656-a1aa-3181ec3beaa1 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:24:08.118862 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-f32b894b-2456-4656-a1aa-3181ec3beaa1 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1562 microversion: 2.1 time: 0.188173 Apr 06 17:24:08.119453 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1770/3536] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:24:07 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1562 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:24:12.460013 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4430cf7d-658e-4ed2-b94d-c4a1b40e6175 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:24:12.460607 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4430cf7d-658e-4ed2-b94d-c4a1b40e6175 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 38992546-2666-425b-80ee-2b2de955d9b7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:24:12.467442 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4430cf7d-658e-4ed2-b94d-c4a1b40e6175 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:12.467894 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4430cf7d-658e-4ed2-b94d-c4a1b40e6175 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:12.468730 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4430cf7d-658e-4ed2-b94d-c4a1b40e6175 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:12.469205 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4430cf7d-658e-4ed2-b94d-c4a1b40e6175 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:12.494008 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4430cf7d-658e-4ed2-b94d-c4a1b40e6175 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 38992546-2666-425b-80ee-2b2de955d9b7] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 06 17:24:12.536503 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-466862bb-ffdd-420c-8cb5-78836d0cd5f1 req-530366ec-5ac2-4dfb-9a87-b0dc9101ef45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38992546-2666-425b-80ee-2b2de955d9b7", "tag": "85807749-2af1-4a27-a81c-6b9ee282cde2"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:24:12.545348 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-466862bb-ffdd-420c-8cb5-78836d0cd5f1 req-530366ec-5ac2-4dfb-9a87-b0dc9101ef45 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:12.546125 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-466862bb-ffdd-420c-8cb5-78836d0cd5f1 req-530366ec-5ac2-4dfb-9a87-b0dc9101ef45 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:12.559148 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-466862bb-ffdd-420c-8cb5-78836d0cd5f1 req-530366ec-5ac2-4dfb-9a87-b0dc9101ef45 service nova] Creating event network-changed:85807749-2af1-4a27-a81c-6b9ee282cde2 for instance 38992546-2666-425b-80ee-2b2de955d9b7 on hv-cinder-83684 Apr 06 17:24:12.576735 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4430cf7d-658e-4ed2-b94d-c4a1b40e6175 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "DELETE /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7" status: 204 len: 0 microversion: 2.1 time: 0.123203 Apr 06 17:24:12.577597 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1767/3537] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 17:24:12 2022] DELETE /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 06 17:24:12.579516 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-466862bb-ffdd-420c-8cb5-78836d0cd5f1 req-530366ec-5ac2-4dfb-9a87-b0dc9101ef45 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123124 Apr 06 17:24:12.580801 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1771/3538] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:24:12.589674 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f950149a-ce77-4cf3-b381-90f94e4a90b7 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:24:12.590764 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f950149a-ce77-4cf3-b381-90f94e4a90b7 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 38992546-2666-425b-80ee-2b2de955d9b7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:24:12.597797 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f950149a-ce77-4cf3-b381-90f94e4a90b7 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:12.598331 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f950149a-ce77-4cf3-b381-90f94e4a90b7 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:12.599348 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f950149a-ce77-4cf3-b381-90f94e4a90b7 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:12.599847 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f950149a-ce77-4cf3-b381-90f94e4a90b7 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:12.742873 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-f950149a-ce77-4cf3-b381-90f94e4a90b7 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:24:12.751221 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f950149a-ce77-4cf3-b381-90f94e4a90b7 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7" status: 200 len: 1576 microversion: 2.1 time: 0.168263 Apr 06 17:24:12.752024 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1768/3539] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:24:12 2022] GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:24:13.770695 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-edddb660-f87c-4e13-b522-535fa2c932be tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:24:13.771396 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-edddb660-f87c-4e13-b522-535fa2c932be tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 38992546-2666-425b-80ee-2b2de955d9b7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:24:13.778381 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edddb660-f87c-4e13-b522-535fa2c932be tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:13.778845 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edddb660-f87c-4e13-b522-535fa2c932be tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:13.779636 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edddb660-f87c-4e13-b522-535fa2c932be tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:13.780074 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-edddb660-f87c-4e13-b522-535fa2c932be tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:13.946255 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-edddb660-f87c-4e13-b522-535fa2c932be tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:24:13.954533 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-edddb660-f87c-4e13-b522-535fa2c932be tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7" status: 200 len: 1576 microversion: 2.1 time: 0.188650 Apr 06 17:24:13.955333 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1772/3540] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:24:13 2022] GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7 => generated 1576 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:24:14.843169 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-c42df04e-2df9-4e40-84cc-0833413166b2 req-338e99a4-0d95-4597-abee-67100e713bae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38992546-2666-425b-80ee-2b2de955d9b7", "name": "network-vif-deleted", "tag": "85807749-2af1-4a27-a81c-6b9ee282cde2"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:24:14.853502 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c42df04e-2df9-4e40-84cc-0833413166b2 req-338e99a4-0d95-4597-abee-67100e713bae service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:14.853943 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c42df04e-2df9-4e40-84cc-0833413166b2 req-338e99a4-0d95-4597-abee-67100e713bae service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:14.866236 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-c42df04e-2df9-4e40-84cc-0833413166b2 req-338e99a4-0d95-4597-abee-67100e713bae service nova] Creating event network-vif-deleted:85807749-2af1-4a27-a81c-6b9ee282cde2 for instance 38992546-2666-425b-80ee-2b2de955d9b7 on hv-cinder-83684 Apr 06 17:24:14.871667 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-c42df04e-2df9-4e40-84cc-0833413166b2 req-338e99a4-0d95-4597-abee-67100e713bae service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032608 Apr 06 17:24:14.872394 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1769/3541] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:24:14.973151 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-261df89f-3633-4244-b90a-79ad8ca431eb tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:24:14.973846 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-261df89f-3633-4244-b90a-79ad8ca431eb tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 38992546-2666-425b-80ee-2b2de955d9b7] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:24:14.980676 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-261df89f-3633-4244-b90a-79ad8ca431eb tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:14.981146 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-261df89f-3633-4244-b90a-79ad8ca431eb tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:14.981938 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-261df89f-3633-4244-b90a-79ad8ca431eb tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:14.982375 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-261df89f-3633-4244-b90a-79ad8ca431eb tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:15.046460 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-261df89f-3633-4244-b90a-79ad8ca431eb tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:24:15.054401 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-261df89f-3633-4244-b90a-79ad8ca431eb tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7" status: 200 len: 1225 microversion: 2.1 time: 0.085217 Apr 06 17:24:15.054911 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1773/3542] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:24:14 2022] GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:24:16.073440 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e66ca1c1-a697-46b2-889e-d00de64ffda5 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:24:16.074179 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e66ca1c1-a697-46b2-889e-d00de64ffda5 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 38992546-2666-425b-80ee-2b2de955d9b7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:24:16.081909 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e66ca1c1-a697-46b2-889e-d00de64ffda5 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:16.082388 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e66ca1c1-a697-46b2-889e-d00de64ffda5 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:16.083221 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e66ca1c1-a697-46b2-889e-d00de64ffda5 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:16.083635 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e66ca1c1-a697-46b2-889e-d00de64ffda5 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:16.099181 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-e66ca1c1-a697-46b2-889e-d00de64ffda5 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] HTTP exception thrown: Instance 38992546-2666-425b-80ee-2b2de955d9b7 could not be found. Apr 06 17:24:16.099786 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e66ca1c1-a697-46b2-889e-d00de64ffda5 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Returning 404 to user: Instance 38992546-2666-425b-80ee-2b2de955d9b7 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:24:16.100633 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e66ca1c1-a697-46b2-889e-d00de64ffda5 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7" status: 404 len: 111 microversion: 2.1 time: 0.032289 Apr 06 17:24:16.101250 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1770/3543] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:24:16 2022] GET /compute/v2.1/servers/38992546-2666-425b-80ee-2b2de955d9b7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:24:19.623843 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-d719eee5-c532-4310-a90a-ce9827d36c9d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:24:19.624395 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d719eee5-c532-4310-a90a-ce9827d36c9d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 07317980-54b7-47cb-b8df-4152ab005b87] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:24:19.631415 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d719eee5-c532-4310-a90a-ce9827d36c9d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:19.632006 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d719eee5-c532-4310-a90a-ce9827d36c9d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:19.632674 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d719eee5-c532-4310-a90a-ce9827d36c9d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:19.633138 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-d719eee5-c532-4310-a90a-ce9827d36c9d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:19.662163 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-d719eee5-c532-4310-a90a-ce9827d36c9d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 07317980-54b7-47cb-b8df-4152ab005b87] Going to try to terminate instance {{(pid=128861) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 06 17:24:19.693549 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-b74145a7-9737-4d21-a373-dbd63510625e req-e8948990-4982-4b10-a908-db98e0844290 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07317980-54b7-47cb-b8df-4152ab005b87", "tag": "638cdf56-1af6-4e4a-900d-b7a3902711ad"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:24:19.702722 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b74145a7-9737-4d21-a373-dbd63510625e req-e8948990-4982-4b10-a908-db98e0844290 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:19.703319 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b74145a7-9737-4d21-a373-dbd63510625e req-e8948990-4982-4b10-a908-db98e0844290 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:19.721000 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-b74145a7-9737-4d21-a373-dbd63510625e req-e8948990-4982-4b10-a908-db98e0844290 service nova] Creating event network-changed:638cdf56-1af6-4e4a-900d-b7a3902711ad for instance 07317980-54b7-47cb-b8df-4152ab005b87 on hv-cinder-83684 Apr 06 17:24:19.727755 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-b74145a7-9737-4d21-a373-dbd63510625e req-e8948990-4982-4b10-a908-db98e0844290 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098916 Apr 06 17:24:19.728470 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1771/3544] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:24:19.757619 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-d719eee5-c532-4310-a90a-ce9827d36c9d tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "DELETE /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87" status: 204 len: 0 microversion: 2.1 time: 0.137478 Apr 06 17:24:19.758585 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1774/3545] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 17:24:19 2022] DELETE /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 06 17:24:19.768547 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d4fb9e09-5aea-47c8-a87f-838e224b2c76 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:24:19.770576 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d4fb9e09-5aea-47c8-a87f-838e224b2c76 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 07317980-54b7-47cb-b8df-4152ab005b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:24:19.794617 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4fb9e09-5aea-47c8-a87f-838e224b2c76 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:19.795972 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4fb9e09-5aea-47c8-a87f-838e224b2c76 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:19.797427 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4fb9e09-5aea-47c8-a87f-838e224b2c76 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:19.798526 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4fb9e09-5aea-47c8-a87f-838e224b2c76 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:19.962444 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-d4fb9e09-5aea-47c8-a87f-838e224b2c76 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:24:19.972055 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d4fb9e09-5aea-47c8-a87f-838e224b2c76 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87" status: 200 len: 1578 microversion: 2.1 time: 0.208628 Apr 06 17:24:19.972620 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1772/3546] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:24:19 2022] GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87 => generated 1578 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:24:20.994657 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-4ecf4504-ca9b-4800-ba36-2a2ed8aa5388 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:24:20.995274 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-4ecf4504-ca9b-4800-ba36-2a2ed8aa5388 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 07317980-54b7-47cb-b8df-4152ab005b87] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:24:21.001746 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ecf4504-ca9b-4800-ba36-2a2ed8aa5388 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:21.002432 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ecf4504-ca9b-4800-ba36-2a2ed8aa5388 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:21.003406 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ecf4504-ca9b-4800-ba36-2a2ed8aa5388 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:21.003840 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-4ecf4504-ca9b-4800-ba36-2a2ed8aa5388 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:21.170800 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-4ecf4504-ca9b-4800-ba36-2a2ed8aa5388 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:24:21.179175 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-4ecf4504-ca9b-4800-ba36-2a2ed8aa5388 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87" status: 200 len: 1578 microversion: 2.1 time: 0.188575 Apr 06 17:24:21.179878 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1775/3547] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:24:20 2022] GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87 => generated 1578 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:24:22.090955 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-c7ee4f8d-ab5b-4c1f-849f-99725d6cd99f req-6cdc3859-99a9-405f-adb0-0618ddace9ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07317980-54b7-47cb-b8df-4152ab005b87", "name": "network-vif-deleted", "tag": "638cdf56-1af6-4e4a-900d-b7a3902711ad"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:24:22.109334 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c7ee4f8d-ab5b-4c1f-849f-99725d6cd99f req-6cdc3859-99a9-405f-adb0-0618ddace9ca service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:22.109961 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c7ee4f8d-ab5b-4c1f-849f-99725d6cd99f req-6cdc3859-99a9-405f-adb0-0618ddace9ca service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:22.123403 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-c7ee4f8d-ab5b-4c1f-849f-99725d6cd99f req-6cdc3859-99a9-405f-adb0-0618ddace9ca service nova] Creating event network-vif-deleted:638cdf56-1af6-4e4a-900d-b7a3902711ad for instance 07317980-54b7-47cb-b8df-4152ab005b87 on hv-cinder-83684 Apr 06 17:24:22.129087 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-c7ee4f8d-ab5b-4c1f-849f-99725d6cd99f req-6cdc3859-99a9-405f-adb0-0618ddace9ca service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041756 Apr 06 17:24:22.129710 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1773/3548] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:24:22.199078 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-b7e475a6-27b7-40ab-a006-85f0bf999caf tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:24:22.199908 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-b7e475a6-27b7-40ab-a006-85f0bf999caf tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 07317980-54b7-47cb-b8df-4152ab005b87] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:24:22.207501 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7e475a6-27b7-40ab-a006-85f0bf999caf tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:22.207962 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7e475a6-27b7-40ab-a006-85f0bf999caf tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:22.208734 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7e475a6-27b7-40ab-a006-85f0bf999caf tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:22.209175 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-b7e475a6-27b7-40ab-a006-85f0bf999caf tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:22.285506 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-b7e475a6-27b7-40ab-a006-85f0bf999caf tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e03597fc34d69b97096c60a4b5be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80fa131c3864ec191ac904b9e290dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:24:22.293997 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-b7e475a6-27b7-40ab-a006-85f0bf999caf tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87" status: 200 len: 1226 microversion: 2.1 time: 0.099792 Apr 06 17:24:22.294615 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1776/3549] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:24:22 2022] GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:24:23.316070 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-366d11bb-b12b-425b-8513-985d895055e3 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:24:23.316800 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-366d11bb-b12b-425b-8513-985d895055e3 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 07317980-54b7-47cb-b8df-4152ab005b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:24:23.323398 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-366d11bb-b12b-425b-8513-985d895055e3 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:23.323935 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-366d11bb-b12b-425b-8513-985d895055e3 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:23.324915 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-366d11bb-b12b-425b-8513-985d895055e3 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:23.325349 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-366d11bb-b12b-425b-8513-985d895055e3 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:23.341448 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-366d11bb-b12b-425b-8513-985d895055e3 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] HTTP exception thrown: Instance 07317980-54b7-47cb-b8df-4152ab005b87 could not be found. Apr 06 17:24:23.342047 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-366d11bb-b12b-425b-8513-985d895055e3 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Returning 404 to user: Instance 07317980-54b7-47cb-b8df-4152ab005b87 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:24:23.342885 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-366d11bb-b12b-425b-8513-985d895055e3 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87" status: 404 len: 111 microversion: 2.1 time: 0.034598 Apr 06 17:24:23.343450 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1774/3550] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:24:23 2022] GET /compute/v2.1/servers/07317980-54b7-47cb-b8df-4152ab005b87 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:24:23.857937 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-99cc74a6-60dd-45b8-880e-1d70a82d776f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:24:23.858463 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-99cc74a6-60dd-45b8-880e-1d70a82d776f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 7fb9f502-78ea-4787-8899-743c71d590e6] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:24:23.865159 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99cc74a6-60dd-45b8-880e-1d70a82d776f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:23.865618 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99cc74a6-60dd-45b8-880e-1d70a82d776f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:23.866404 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99cc74a6-60dd-45b8-880e-1d70a82d776f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:23.866808 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-99cc74a6-60dd-45b8-880e-1d70a82d776f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:23.885574 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-99cc74a6-60dd-45b8-880e-1d70a82d776f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] HTTP exception thrown: Instance 7fb9f502-78ea-4787-8899-743c71d590e6 could not be found. Apr 06 17:24:23.886310 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-99cc74a6-60dd-45b8-880e-1d70a82d776f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Returning 404 to user: Instance 7fb9f502-78ea-4787-8899-743c71d590e6 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:24:23.887488 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-99cc74a6-60dd-45b8-880e-1d70a82d776f tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "DELETE /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6" status: 404 len: 111 microversion: 2.1 time: 0.033381 Apr 06 17:24:23.888242 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1777/3551] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 17:24:23 2022] DELETE /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:24:23.898204 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9566d9a4-9dc6-4c7d-81ef-8acc953db0e8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:24:23.898798 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9566d9a4-9dc6-4c7d-81ef-8acc953db0e8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] [instance: 7fb9f502-78ea-4787-8899-743c71d590e6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:24:23.905034 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9566d9a4-9dc6-4c7d-81ef-8acc953db0e8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:23.905475 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9566d9a4-9dc6-4c7d-81ef-8acc953db0e8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:23.906228 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9566d9a4-9dc6-4c7d-81ef-8acc953db0e8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:24:23.906653 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9566d9a4-9dc6-4c7d-81ef-8acc953db0e8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:24:23.920344 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-9566d9a4-9dc6-4c7d-81ef-8acc953db0e8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] HTTP exception thrown: Instance 7fb9f502-78ea-4787-8899-743c71d590e6 could not be found. Apr 06 17:24:23.920969 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9566d9a4-9dc6-4c7d-81ef-8acc953db0e8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Returning 404 to user: Instance 7fb9f502-78ea-4787-8899-743c71d590e6 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:24:23.921782 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9566d9a4-9dc6-4c7d-81ef-8acc953db0e8 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6" status: 404 len: 111 microversion: 2.1 time: 0.027810 Apr 06 17:24:23.922330 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1775/3552] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:24:23 2022] GET /compute/v2.1/servers/7fb9f502-78ea-4787-8899-743c71d590e6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:24:25.239875 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-9b25fed8-9026-4c28-bc58-c0f9dbfe7d84 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] Calling method '.version_select at 0x7fa9cf0a5940>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:24:25.268358 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-9b25fed8-9026-4c28-bc58-c0f9dbfe7d84 tempest-TestVolumeBootPattern-727041627 tempest-TestVolumeBootPattern-727041627-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2132919883" status: 202 len: 0 microversion: 2.1 time: 0.032609 Apr 06 17:24:25.269486 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1778/3553] 10.222.0.64 () {58 vars in 1262 bytes} [Wed Apr 6 17:24:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2132919883 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 06 17:25:21.965476 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-82ff3e08-ce06-4830-b715-0da29cf01cd0 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:25:21.966729 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-82ff3e08-ce06-4830-b715-0da29cf01cd0 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:25:21.968253 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-1e300af8-cd10-405b-ada8-17dc98744e4a req-0fba6b24-0fa8-4015-9ec7-bf4804a01c34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aeb06f7-067b-45d6-9df7-427975ce3532", "tag": "4166ed5e-e08c-4143-8981-39421971dd87"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:25:21.973357 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82ff3e08-ce06-4830-b715-0da29cf01cd0 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:25:21.973802 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82ff3e08-ce06-4830-b715-0da29cf01cd0 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:25:21.974566 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82ff3e08-ce06-4830-b715-0da29cf01cd0 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:25:21.975020 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82ff3e08-ce06-4830-b715-0da29cf01cd0 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:25:21.977532 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1e300af8-cd10-405b-ada8-17dc98744e4a req-0fba6b24-0fa8-4015-9ec7-bf4804a01c34 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:25:21.978177 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-1e300af8-cd10-405b-ada8-17dc98744e4a req-0fba6b24-0fa8-4015-9ec7-bf4804a01c34 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:25:21.989770 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-1e300af8-cd10-405b-ada8-17dc98744e4a req-0fba6b24-0fa8-4015-9ec7-bf4804a01c34 service nova] Creating event network-changed:4166ed5e-e08c-4143-8981-39421971dd87 for instance 7aeb06f7-067b-45d6-9df7-427975ce3532 on hv-cinder-83684 Apr 06 17:25:21.995807 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-1e300af8-cd10-405b-ada8-17dc98744e4a req-0fba6b24-0fa8-4015-9ec7-bf4804a01c34 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031725 Apr 06 17:25:21.996492 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1779/3554] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 06 17:25:22.003619 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-82ff3e08-ce06-4830-b715-0da29cf01cd0 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 06 17:25:22.091700 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-82ff3e08-ce06-4830-b715-0da29cf01cd0 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "DELETE /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 204 len: 0 microversion: 2.1 time: 0.130346 Apr 06 17:25:22.092928 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1776/3555] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Apr 6 17:25:21 2022] DELETE /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 06 17:25:22.104042 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-bc7e39d3-b1a7-4b35-9ad3-4c7c3daee76b tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:25:22.105034 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-bc7e39d3-b1a7-4b35-9ad3-4c7c3daee76b tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:25:22.113488 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc7e39d3-b1a7-4b35-9ad3-4c7c3daee76b tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:25:22.113931 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc7e39d3-b1a7-4b35-9ad3-4c7c3daee76b tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:25:22.114899 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc7e39d3-b1a7-4b35-9ad3-4c7c3daee76b tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:25:22.115337 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-bc7e39d3-b1a7-4b35-9ad3-4c7c3daee76b tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:25:22.256282 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.policy [None req-bc7e39d3-b1a7-4b35-9ad3-4c7c3daee76b tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128861) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:25:22.264425 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-bc7e39d3-b1a7-4b35-9ad3-4c7c3daee76b tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1568 microversion: 2.1 time: 0.166784 Apr 06 17:25:22.265050 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1780/3556] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:25:22 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 06 17:25:23.282547 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-198bf71c-f958-4023-aeb9-48514a867f2d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:25:23.283372 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-198bf71c-f958-4023-aeb9-48514a867f2d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:25:23.291272 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-198bf71c-f958-4023-aeb9-48514a867f2d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:25:23.291724 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-198bf71c-f958-4023-aeb9-48514a867f2d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:25:23.292512 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-198bf71c-f958-4023-aeb9-48514a867f2d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:25:23.292969 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-198bf71c-f958-4023-aeb9-48514a867f2d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:25:23.705942 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-198bf71c-f958-4023-aeb9-48514a867f2d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:25:23.715126 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-198bf71c-f958-4023-aeb9-48514a867f2d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1568 microversion: 2.1 time: 0.436795 Apr 06 17:25:23.715717 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1777/3557] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:25:23 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1568 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:25:24.588624 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [req-b69191fa-8e3a-4a00-af21-50249b791a35 req-c04ad4fc-83d6-4c7d-9028-64ce9b0e9936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aeb06f7-067b-45d6-9df7-427975ce3532", "name": "network-vif-deleted", "tag": "4166ed5e-e08c-4143-8981-39421971dd87"}]} {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 06 17:25:24.599778 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b69191fa-8e3a-4a00-af21-50249b791a35 req-c04ad4fc-83d6-4c7d-9028-64ce9b0e9936 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:25:24.600221 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [req-b69191fa-8e3a-4a00-af21-50249b791a35 req-c04ad4fc-83d6-4c7d-9028-64ce9b0e9936 service nova] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:25:24.613218 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.compute.server_external_events [req-b69191fa-8e3a-4a00-af21-50249b791a35 req-c04ad4fc-83d6-4c7d-9028-64ce9b0e9936 service nova] Creating event network-vif-deleted:4166ed5e-e08c-4143-8981-39421971dd87 for instance 7aeb06f7-067b-45d6-9df7-427975ce3532 on hv-cinder-83684 Apr 06 17:25:24.620144 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [req-b69191fa-8e3a-4a00-af21-50249b791a35 req-c04ad4fc-83d6-4c7d-9028-64ce9b0e9936 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035283 Apr 06 17:25:24.622193 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1781/3558] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Apr 6 17:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 06 17:25:24.734092 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5b7735af-4ef7-40a8-bb7f-4cdcd681aa12 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:25:24.734703 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5b7735af-4ef7-40a8-bb7f-4cdcd681aa12 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:25:24.741684 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b7735af-4ef7-40a8-bb7f-4cdcd681aa12 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:25:24.742148 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b7735af-4ef7-40a8-bb7f-4cdcd681aa12 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:25:24.742904 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b7735af-4ef7-40a8-bb7f-4cdcd681aa12 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:25:24.743520 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b7735af-4ef7-40a8-bb7f-4cdcd681aa12 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:25:24.805982 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.policy [None req-5b7735af-4ef7-40a8-bb7f-4cdcd681aa12 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b405ad574b74a9ebeb7c13970d3313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ecd2071a704b60b72c2b81c2595cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Apr 06 17:25:24.814680 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5b7735af-4ef7-40a8-bb7f-4cdcd681aa12 tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 200 len: 1220 microversion: 2.1 time: 0.084570 Apr 06 17:25:24.815241 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1778/3559] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:25:24 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 06 17:25:25.837478 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0f72fa79-3587-44b7-a89b-5ffcf090079e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '>' {{(pid=128861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:25:25.838502 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.compute.api [None req-0f72fa79-3587-44b7-a89b-5ffcf090079e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] [instance: 7aeb06f7-067b-45d6-9df7-427975ce3532] Fetching instance by UUID {{(pid=128861) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 06 17:25:25.848673 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f72fa79-3587-44b7-a89b-5ffcf090079e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:25:25.849408 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f72fa79-3587-44b7-a89b-5ffcf090079e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:25:25.850590 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f72fa79-3587-44b7-a89b-5ffcf090079e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 06 17:25:25.851257 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG oslo_concurrency.lockutils [None req-0f72fa79-3587-44b7-a89b-5ffcf090079e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Lock "1d668fef-de9c-4391-8526-0546ba1208c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 06 17:25:25.865998 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.wsgi [None req-0f72fa79-3587-44b7-a89b-5ffcf090079e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] HTTP exception thrown: Instance 7aeb06f7-067b-45d6-9df7-427975ce3532 could not be found. Apr 06 17:25:25.866598 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: DEBUG nova.api.openstack.wsgi [None req-0f72fa79-3587-44b7-a89b-5ffcf090079e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Returning 404 to user: Instance 7aeb06f7-067b-45d6-9df7-427975ce3532 could not be found. {{(pid=128861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 06 17:25:25.867428 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO nova.api.openstack.requestlog [None req-0f72fa79-3587-44b7-a89b-5ffcf090079e tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532" status: 404 len: 111 microversion: 2.1 time: 0.037194 Apr 06 17:25:25.867980 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: [pid: 128861|app: 0|req: 1782/3560] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Apr 6 17:25:25 2022] GET /compute/v2.1/servers/7aeb06f7-067b-45d6-9df7-427975ce3532 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 06 17:25:26.065214 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a4b75830-6fda-4d49-bcb4-a4b420302e0d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] Calling method '.version_select at 0x7fa9ca0524c0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 06 17:25:26.091870 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a4b75830-6fda-4d49-bcb4-a4b420302e0d tempest-TestShelveInstance-888642016 tempest-TestShelveInstance-888642016-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1182119716" status: 202 len: 0 microversion: 2.1 time: 0.030335 Apr 06 17:25:26.092340 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1779/3561] 10.222.0.64 () {58 vars in 1253 bytes} [Wed Apr 6 17:25:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1182119716 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 06 17:26:45.968928 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:26:45.969761 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 17:26:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:27:04.112474 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:27:04.113167 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 17:27:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:27:13.028646 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:27:13.029891 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 17:27:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:28:38.221076 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:28:38.222088 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 17:28:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:30:05.980292 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:30:05.981125 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 17:30:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:30:24.122331 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:30:24.123473 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 17:30:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:30:31.600532 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:30:31.601638 dv-cinder-836848-1-iscsi devstack@n-api.service[128860]: Wed Apr 6 17:30:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:30:33.043263 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:30:33.043980 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 17:30:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 06 17:30:43.224105 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 06 17:30:43.225365 dv-cinder-836848-1-iscsi devstack@n-api.service[128861]: Wed Apr 6 17:30:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!